#CPUInference (2)

Hunch: A Fast CPU Reflex Layer for Repeated LLM Judgments

Hunch caches exact answers, uses per-question EmbeddingGemma 2 students for familiar states, and routes uncertain or unfamiliar judgments to a teacher while auditing local answers in the background.