alina🐾💖✨🏳️⚧️ on Nostr: my dataset importers have accumulated 120 million rows in postgres so far, and they ...
my dataset importers have accumulated 120 million rows in postgres so far, and they are 10% done
fucking hell i may have unlimited cloud resources but analyzing 8TB and storing 2TB in a "cloud volume" (writing to hard drives in another datacenter) still takes forever :/
Published at
2026-10-11 02:33:31 UTCEvent JSON
{
"id": "15d978feea1c36f45f804df428c2a75df1e31b9698cd6d058c157f1c72bb010e",
"pubkey": "06e0f5cf646336f2be600734fe5801a493b83d832b4593fd541a78a47d691fc6",
"created_at": 1791686011,
"kind": 1,
"tags": [
[
"proxy",
"https://girldick.gay/users/alina/statuses/117419934441295744",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "my dataset importers have accumulated 120 million rows in postgres so far, and they are 10% done\n\nfucking hell i may have unlimited cloud resources but analyzing 8TB and storing 2TB in a \"cloud volume\" (writing to hard drives in another datacenter) still takes forever :/",
"sig": "d2e52023293bbdbaa7fda0edc66462efb8211834e6c357e18a223f8ffe647835c76f8bfc3a25ed950040886e837e4271086d14f63f17463065737e16b2fec638"
}