utxo the webmaster 🧑💻🍁 on Nostr: More community optimizations for old hardware Qwen27b fp8 - 115 Tok/s on 2x 3090s ...
More community optimizations for old hardware
Qwen27b fp8 - 115 Tok/s on 2x 3090s 🤯
Published at
2026-10-19 10:07:14 UTCEvent JSON
{
"id": "000012f36812a07d358571f1dc969af46015caba2ce4ec858760ac867a16966d",
"pubkey": "e2ccf7cf20403f3f2a4a55b328f0de3be38558a7d5f33632fdaaefc726c1c8eb",
"created_at": 1792404434,
"kind": 1,
"tags": [
[
"client",
"Wisp"
],
[
"nonce",
"7726",
"16"
]
],
"content": "More community optimizations for old hardware\n\nQwen27b fp8 - 115 Tok/s on 2x 3090s 🤯 \nhttps://relay.utxo.one/edb2dfe878f389a22906e11455eecbf1442725fca96d9853e9e8762f4727fee9.mp4",
"sig": "7739b0779270a32de2714511cf2eb235357b49a0cfe6ac32b00336d0c8bc6cb95925426e4900d26d573bb023f78161cd2f15619f202d64e013916a687ad992b3"
}
