Join Nostr
2026-10-23 21:29:47 UTC
in reply to

ly on Nostr: Qwen/Qwen3.8-27B, maybe some 4-bit quantization. Alternative backends to ollama ...

Qwen/Qwen3.8-27B, maybe some 4-bit quantization. Alternative backends to ollama include llama.cpp, frontends include pi.dev...