rich1.0neigsendoig wroteneigsendoig (npub1mx…xhs3q)https://nostr.now/npub1mx3jntatkf363tepdquwk30p7pxvxqq8q3ryj37yhyr7r0h4srts5xhs3qnjumphttps://nostr.nowllama.cpp, customized build, CUDA with your GPU.
Model is HauhauCS Qwen 3.5 4B Uncensored Aggressive on HuggingFace for basic chat capabilities. You need to upgrade your compute hardware in order to run good models.