Have you heard of SeaweedFS? Pretty different project, but there might be some good ideas in there for scaling when dealing with lots of small files and a designing distributed hash based lookup.
https://github.com/seaweedfs/seaweedfs?tab=readme-ov-file#master-server-and-volume-server
lingmann / ⚡️₿⚡️
npub1rf…mdtwe
2024-05-27 16:42:14 UTC
in reply to nevent1q…e7dd
Author Public Key
npub1rf9g77w2uzteagu9ck9tn725lkkv6meyteh6gag2084h2y9ww48qlmdtwePublished at
2024-05-27 16:42:14 UTCEvent JSON
{
"id": "5e90860b59bf983a5b528ef4d5a97b28255e1262187edf6d5fc4bd185dc58dae",
"pubkey": "1a4a8f79cae0979ea385c58ab9f954fdaccd6f245e6fa4750a79eb7510ae754e",
"created_at": 1716828134,
"kind": 1,
"tags": [
[
"e",
"50a0306e7facc803bd663fcb413c9ed795cf48ff7bf09d9249174cfc40849925",
"wss://offchain.pub/",
"root"
],
[
"e",
"50a0306e7facc803bd663fcb413c9ed795cf48ff7bf09d9249174cfc40849925",
"wss://offchain.pub/",
"reply"
],
[
"p",
"266815e0c9210dfa324c6cba3573b14bee49da4209a9456f9484e5106cd408a5",
"wss://nostr.wine/",
"mention"
]
],
"content": "Have you heard of SeaweedFS? Pretty different project, but there might be some good ideas in there for scaling when dealing with lots of small files and a designing distributed hash based lookup.\n\nhttps://github.com/seaweedfs/seaweedfs?tab=readme-ov-file#master-server-and-volume-server",
"sig": "ba877bfa56770012d33801ba52f72f0b6fdf21dcf000dcd41959dd61ea717d309f204bf626b1487d2569f18276714ee7c22811466436065d9dd68c9533bba921"
}