Semantic cache
A semantic cache returns a stored answer for a new question whose embedding is near a previous question.
Tiny example
Section titled “Tiny example”“How do I install the VPN?” may reuse a validated answer for “Steps to set up the company VPN.”
Main risk
Section titled “Main risk”Similar questions are not always answer-equivalent. Scope by tenant, permission, locale, model, prompt, and knowledge version; expire stale entries; exclude side effects; and measure false-hit and stale-hit rates.