๐ฅ๏ธ
VRAM Calculator
Calculate GPU memory needed for different model sizes and quantization levels.
VRAM Calculator
Estimated VRAM Required
126.0 GB
GPU Compatibility
RTX 4090
24 GB VRAM
A100
80 GB VRAM
H100
80 GB VRAM
Calculate GPU memory needed for different model sizes and quantization levels.
Estimated VRAM Required
126.0 GB
RTX 4090
24 GB VRAM
A100
80 GB VRAM
H100
80 GB VRAM