Compute and optimization

AirLLM lowers peak accelerator memory by loading model layers sequentially instead of keeping the full checkpoint resident during inference.

KV Cache Transform Coding applies learned decorrelation, adaptive quantization, and entropy coding to reduce storage and transfer costs for reusable language-model KV caches.