Hypura – A Storage-Tier-Aware LLM Inference Scheduler for Apple Silicon
Hypura revolutionizes local LLM inference on Apple Silicon by intelligently using RAM and SSD as a two-tier cache, cutting follow-up response times from minutes to seconds.
KV cache