GPU Utilization Is the Wrong Metric for AI, New Scorecard Argues
NAND Research and WEKA's Inference Economics Scorecard says GPU utilization hides costly context rebuilding; an eight-hour benchmark shows 3.7x more tokens per GPU-hour with shared NVMe cache.