Zygmunt Krynicki on Nostr: Having a local LLM with 128GB of vram makes interesting things possible. The biggest ...
Having a local LLM with 128GB of vram makes interesting things possible. The biggest advantage is that I could not care less about copilot or claude price hikes and the freedom to work offline (although I do need to bring my power supply).
I know this is rare kind of luxury, but it is real.
Published at
2026-05-20 11:55:40 UTCEvent JSON
{
"id": "cb14946b2d41b6a22b29859729c8bdfa2c3c5d4d2c8219d657f1e2c07678ad88",
"pubkey": "1590cda1f71fae64a882999896d80f8c2b89456fc4dfff305b932ae3d986a33e",
"created_at": 1779278140,
"kind": 1,
"tags": [
[
"proxy",
"https://fosstodon.org/users/zygoon/statuses/116606772190968006",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "Having a local LLM with 128GB of vram makes interesting things possible. The biggest advantage is that I could not care less about copilot or claude price hikes and the freedom to work offline (although I do need to bring my power supply).\n\nI know this is rare kind of luxury, but it is real.",
"sig": "12cff99fe2359a619ec68bcc2818c7f0f39c88bfa6927b417fd2d41384315a70acb193863f8dea79b8f7e2a3b99c6e13c152d1825f67fc7d9db05a0130ed1775"
}