How semantic caching reduces LLM API calls
Bill Doerrfeld | May 5, 2025
My latest for The New Stack explores semantic caching, an emerging strategy to optimize agentic AI.
Semantic caching is like typical caching, but for AI. It could eliminate a lot of redundant API calls to LLMs, reducing costs and improving performance.
My latest for The New Stack explores semantic caching — what it is, how it works, and what the benefits are. According to the sources, semantic caching is poised to become more of a standard practice for optimizing how applications behave with AI, reducing latency and lowering the bar as costs increase.
Featured image credit: Donald Wu
Other Blog Posts
My latest InfoWorld feature explores what makes an enterprise MCP registry effective, from semantic discovery to governance and security for AI agents.
My first-ever contribution to CSO Online looks at the shifting landscape, from perimeter-based security to API security, and how CISOs are responding.
My latest feature for The New Stack looks into solutions being proposed to fix open source Slopmageddon.
My latest DirectorPlus looks at how agentic AI is reshaping platform engineering at Squarespace: less shared code and more developer experience focus.
Usage-based pricing is reshaping the API economy. Discover 5 API monetization success stories, including OpenAI, Plaid, and AssemblyAI.
Why event-driven APIs matter for AI workflows, enabling real-time data, scalable systems, and responsive agent behavior.
While hardware usually gets the spotlight in physical AI, the real differentiator won't be hardware. It'll be the models.
In the latest DirectorPlus, Workato's CTO explains how MCP-enabled integration catalyzed internal AI usage and ROI.
My latest on InfoWorld reviews MCP servers from 5 major cloud providers
How are organizations actually using agentic knowledge bases in practice? My article for The New Stack looks at six emerging patterns.
