Yes. I have 121 set aside for the GPU.
Token rate is pretty good around 43/s. Where it lacks is on the memory bandwidth so prompt processing is a bit slow and image/video generation isn’t great. But with today’s prices, it’s a nice starter box for someone serious about doing it (lists at $4K). And if nothing else, it would be a killer desktop box if you don’t like the AI.
They sell a 192GB model but it’s more like $7K and for that you could probably get something with cuda.
What is really nice is the sw that comes loaded with it. I got mine with Linux but you can get Windows if you are so inclined. But it sets you up with playbooks, ready to run stuff, and a reset button if you just screw it up.
Overall I like it. I think it’s a good value in a market which is just stupid right now. Serious enough to get things done but not a total bank breaker.
