Quantized inference: around 200B parameters
Quantization makes model weights more compact, but runtime space is also needed for the context cache, framework and system. A model-size estimate does not guarantee support for any context length or concurrency level.
Before deployment, note the quantization format, context length, target concurrency and dependency versions. Then test memory use and response behavior with the actual workload.