How semantic caching reduces LLM API calls
Bill Doerrfeld | May 5, 2025
My latest for The New Stack explores semantic caching, an emerging strategy to optimize agentic AI.
Semantic caching is like typical caching, but for AI. It could eliminate a lot of redundant API calls to LLMs, reducing costs and improving performance.
My latest for The New Stack explores semantic caching — what it is, how it works, and what the benefits are. According to the sources, semantic caching is poised to become more of a standard practice for optimizing how applications behave with AI, reducing latency and lowering the bar as costs increase.
Featured image credit: Donald Wu
Facing an existential crisis, Stack Overflow has had to pivot quickly. I synced with a director to discover what team strategies are helping them adapt.
System Initiative aims to replace the toil of maintaining config files with a data-based digital twin and visual modeling engine. An engine for DevOps, if you will.
My latest feature on CIO.com explores why CIOs view APIs as a critical linchpin to realize success with agentic AI. Learn what it'll all take.
A year into the DirectorPlus newsletter, I check back in with past guests on how their organizations are approaching AI tooling strategies.
How do you make an API ready for AI agents to use? I posed this question to a handful of API experts and put together a comprehensive guide for The New Stack — published today.
86% of developers are embarrassed by their tech stack. And, it's causing them to quit. I look at the implications of a report from Storyblok.
The majority of enterprises are now multicloud. I compared six of the leading multicloud management solutions for InfoWorld.
AI researchers are calling the next class of models large action models (LAMs). For The New Stack, I explored what LAMs are, what examples are emerging in the market, and what experts think.
My article for LeadDev explores specific prompting techniques proven to sharpen your AI-assisted software development.
Nordic APIs, the API-specific blog I edit, was recently ranked the top API blog online by FeedSpot. After ten years managing this presence, I reflect a bit on the journey thus far.
