How semantic caching reduces LLM API calls
Bill Doerrfeld | May 5, 2025
My latest for The New Stack explores semantic caching, an emerging strategy to optimize agentic AI.
Semantic caching is like typical caching, but for AI. It could eliminate a lot of redundant API calls to LLMs, reducing costs and improving performance.
My latest for The New Stack explores semantic caching — what it is, how it works, and what the benefits are. According to the sources, semantic caching is poised to become more of a standard practice for optimizing how applications behave with AI, reducing latency and lowering the bar as costs increase.
Featured image credit: Donald Wu
Other Blog Posts
My latest InfoWorld feature explores how Model Context Protocol (MCP) supports context engineering for AI-assisted coding.
My latest for Nordic APIs explores 10 API key security risks and what to use alongside keys for stronger API security.
The yearly API conference, apidays New York, is a hotbed for solid discussion on what's top of mind in the API space, and as MC I had a front row seat.
My latest for CIO Online features real results form CIOs actively deploying AI agents to empower sales and revenue teams.
Reports say consumers are souring on AI everywhere, all the time. So, at the risk of losing trust, or even potential business, is adding AI to an existing product really worth it?
Cloudflare rebuilt Next.js over a weekend using agentic coding.
My InfoWorld feature reviews the key building blocks in agentic systems and with real-world examples from Shopify, Block, and others.
My latest InfoWorld feature explores what makes an enterprise MCP registry effective, from semantic discovery to governance and security for AI agents.
My first-ever contribution to CSO Online looks at the shifting landscape, from perimeter-based security to API security, and how CISOs are responding.
My latest feature for The New Stack looks into solutions being proposed to fix open source Slopmageddon.
