Quantization

Run 70B LLM on 4GB GPU: AirLLM's Real Tradeoff

Run 70B LLM on 4GB GPU hardware with AirLLM's layer-by-layer inference. The VRAM math is real — you just pay for it in disk bandwidth. The honest tradeoff.