d on Nostr: nprofile1q…8al6u the current high end models have a realistic floor of about 400 GB ...

nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqd5f8rsy5wxf8vass4zcxfl3f7azuel0gyfmh6a4v3qycdqarudysg8al6u (nprofile…al6u) the current high end models have a realistic floor of about 400 GB of vram to be usable. that's with heavy quantization and a small context window