Join Nostr
2026-09-20 17:36:45 UTC
in reply to

The Beave on Nostr: Not enough VRAM to get a model running that can do real work. The minimum is 32gb ...

Not enough VRAM to get a model running that can do real work. The minimum is 32gb currently to run qwen3.8:27b with about a 96k contact window.

Anything smaller than that is not going to be particularly useful, in my experience.