Is there some kind of file #storage that does delta compression? I'd love to have a file #archive with
• revisions (i.e. changes to files are tracked)
• deduplication (identical files only take up space once)
• deltas (small changes to large files only take up the size of the difference)
Git would cover this, but doesn't work well with TBs of data. Backup software with delta support like Borg or restic can do it too, but have bad UX for tracking file revisions.
#DataHoarding #archival
scy
npub1ds…dpdsr
2025-01-09 09:24:58 UTC
Author Public Key
npub1ds9uccvzttwannk5cnf09k8f6wxeuvy84srqhlc98q794n8p5vaq0dpdsrSeen on
wss://relay.mostr.pubPublished at
2025-01-09 09:24:58 UTCEvent JSON
{
"id": "4a4f8d65e2d87d446e1c5f39386c3992bb6abb4adbe1cb06198193e8a5295352",
"pubkey": "6c0bcc61825addd9ced4c4d2f2d8e9d38d9e3087ac060bff05383c5acce1a33a",
"created_at": 1736414698,
"kind": 1,
"tags": [
[
"t",
"storage"
],
[
"t",
"archive"
],
[
"t",
"datahoarding"
],
[
"t",
"archival"
],
[
"proxy",
"https://chaos.social/users/scy/statuses/113797673656959012",
"activitypub"
]
],
"content": "Is there some kind of file #storage that does delta compression? I'd love to have a file #archive with\n\n• revisions (i.e. changes to files are tracked)\n• deduplication (identical files only take up space once)\n• deltas (small changes to large files only take up the size of the difference)\n\nGit would cover this, but doesn't work well with TBs of data. Backup software with delta support like Borg or restic can do it too, but have bad UX for tracking file revisions.\n\n#DataHoarding #archival",
"sig": "c9e480d80a8cd832216dfb64e635a9ff2293f13131cc11ff7c7f86d4b2f3d179e1ba79f150182808f7429b8dffd40f34943629cd45d1ec317bddcd69613bf7c8"
}