nomadshiba on Nostr: if you have a decent laptop, with good some not so much ram. you should really try ...
if you have a decent laptop, with good some not so much ram.
you should really try this: Qwen3.6-35B-A3B-Q4_K_M
its fast, it takes like 30% of the memory in mmap mode.
and actually good. context size might be an issue but great for small projects.
im surprised how good its.
you can take some help from llms to optimize llma parameters and your specific hardware.
Published at
2026-10-17 18:32:45 UTCEvent JSON
{
"id": "60143333d5b3585f771de3aab32a779ce43ce060524d866126f9c4f2b781c5a0",
"pubkey": "45835c36f41d979bc8129830f2f5d92562f5343d6feddd6f30aa79480730f26e",
"created_at": 1792261965,
"kind": 1,
"tags": [
[
"client",
"nstr.app"
]
],
"content": "if you have a decent laptop, with good some not so much ram.\nyou should really try this: Qwen3.6-35B-A3B-Q4_K_M\n\nits fast, it takes like 30% of the memory in mmap mode.\nand actually good. context size might be an issue but great for small projects.\n\nim surprised how good its.\nyou can take some help from llms to optimize llma parameters and your specific hardware.",
"sig": "909e497e33fb37f676ae904b4b021ce1a8fb77794d5f866964302d8ad8bb0016989a004cc426945c14b2c6e79f3beb2a5786827c4f1b07a63e769c00d359547c"
}
