How semantic caching reduces LLM API calls
Bill Doerrfeld | May 5, 2025
My latest for The New Stack explores semantic caching, an emerging strategy to optimize agentic AI.
Semantic caching is like typical caching, but for AI. It could eliminate a lot of redundant API calls to LLMs, reducing costs and improving performance.
My latest for The New Stack explores semantic caching — what it is, how it works, and what the benefits are. According to the sources, semantic caching is poised to become more of a standard practice for optimizing how applications behave with AI, reducing latency and lowering the bar as costs increase.
Featured image credit: Donald Wu
For CIO.com, leading executives shared with me how they're actively utilizing agentic AI to enhance core business workflows.
Developer productivity metrics are useless if they're just sitting in dashboards. So, how can we use them to direct positive, real-world action?
What leads to a higher revenue per engineer? New benchmarking from DX reveals how areas like R&D spend, org size, and growth rate move the needle.
My latest post on The New Stack reveals how researchers pinpoint the exact sources behind chatbot responses.
The Kubernetes ecosystem has exploded with managed platforms tailored to multi-cloud, edge, on-prem, and regional deployments.
Some internal projects are too good to stay hidden. For DirectorPlus, Spotify's Pia Nilsson shares how to identify and externalize internal platforms — like they did with Backstage.
My latest feature for InfoWorld looks into the gaps surrounding AI-generated code and what leaders believe we need to improve the status quo.
New research shows LLMs outperform humans in software requirements engineering, reducing weeks of work to seconds while improving completeness by 10.2%.
Containers are designed to be isolated—that's great for security but tricky for networking. My feature with InfoWorld explores how eBPF is evolving container networking.
I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, to see how software engineers are implementing agentic AI in practice.
