KronQ pushes usable 2-bit quantization of LLaMA-3-70B where GPTQ falls apart.

KronQ folds gradient covariance into the pipeline, using bidirectional incoherence processing and a Hessian-trace sensitivity metric for mixed-precision allocation (arXiv:2607.07964, COLM 2026). At aggressive 2-bit weight-only quantization it reaches 7.93 WikiText-2 perplexity while GPTQ and GPTAQ diverge into degenerate output past 2000 perplexity. For anyone fitting a 70B onto constrained local hardware, this is real evidence that usable 2-bit is getting close. The difference between 7.93 and "degenerate garbage" is the difference between local inference being viable and not.