mos_8502 :verified: on Nostr: DeepSeek is like a terabyte in size at full bit depth. Quantized models derived from ...

DeepSeek is like a terabyte in size at full bit depth. Quantized models derived from the big ones can cut that down to something that fits in 24-32GB with some loss in model quality.