I implemented something similar to this solution, but it's not ideal.
I have a few issues with this though. I set the block size pretty low, to ensure the APPEND trick works well, which it does, but the overhead for the APPEND call is not great. A 55 kB stream (i.e. roughly 50 separate APPENDS) turns a 50 ms operation into 2 seconds.
Sure, it'll be much less bad when I create the buffer size, but this suggests that while the idea works, it's not perfect.
https://codeberg.org/loke/array/commit/c41c9daa5aceb46b4dbfcab1ac34389646d3be5e
Elias Mårtenson
npub1qh…3qhxt
2025-08-23 14:04:38 UTC
in reply to nevent1q…gem6
Author Public Key
npub1qhmvul058af20389edx4p2vnuxs68d9cehk544e4hj0l0rkhwuasn3qhxtSeen on
wss://relay.momostr.pinkPublished at
2025-08-23 14:04:38 UTCEvent JSON
{
"id": "6a911acfc0b467c571e982aeff5ef9df5ae0cda87bfe0eeee1fac73bda2666a2",
"pubkey": "05f6ce7df43f52a7c4e5cb4d50a993e1a1a3b4b8cded4ad735bc9ff78ed7773b",
"created_at": 1755957878,
"kind": 1,
"tags": [
[
"p",
"5f2dac217c35680cbce574baa0ae609373a356ef1de1ab2ed0a920abb9db3fff"
],
[
"e",
"4d32c0dcf97a620675232a81a903dc5279283493eacca60d227f6199297b23f1",
"",
"reply",
"5f2dac217c35680cbce574baa0ae609373a356ef1de1ab2ed0a920abb9db3fff"
],
[
"proxy",
"https://functional.cafe/@loke/115078455542583936",
"web"
],
[
"p",
"05f6ce7df43f52a7c4e5cb4d50a993e1a1a3b4b8cded4ad735bc9ff78ed7773b"
],
[
"e",
"44237555255f134f63cd6ec8edfb198223290c8ce01e870f49130f3633a80dba",
"",
"root",
"5f2dac217c35680cbce574baa0ae609373a356ef1de1ab2ed0a920abb9db3fff"
],
[
"proxy",
"https://functional.cafe/users/loke/statuses/115078455542583936",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://functional.cafe/users/loke/statuses/115078455542583936",
"pink.momostr"
],
[
"-"
]
],
"content": "I implemented something similar to this solution, but it's not ideal.\n\nI have a few issues with this though. I set the block size pretty low, to ensure the APPEND trick works well, which it does, but the overhead for the APPEND call is not great. A 55 kB stream (i.e. roughly 50 separate APPENDS) turns a 50 ms operation into 2 seconds.\n\nSure, it'll be much less bad when I create the buffer size, but this suggests that while the idea works, it's not perfect.\n\nhttps://codeberg.org/loke/array/commit/c41c9daa5aceb46b4dbfcab1ac34389646d3be5e",
"sig": "33f7a53e30ea610d05585ca9202b2b941ceccc1ea9b26e1dd45a1c9fc11f0e5f2d1c8af48cf34c5938f88b74987e85812b43ea80fe662ae50f2f29e6ad647749"
}