Putting agentic AI to the test

Bill Doerrfeld | February 28, 2025

The latest edition of DirectorPlus explores how New Relic is utilizing agentic AI and what the results have been.


A lot is being said about agentic AI right now. But is it all hype?


I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, on this loaded topic for LeadDev — we dove into the details to explore how New Relic developers are actually putting it to the test and seeing real-world results.


This one is loaded with on-the-ground insights. For instance, I never dreamed image-to-text models would outperform raw text for things like navigating a database schema!


Success with agentic AI involves tracking the right metrics, bridging deterministic and probabilistic AI, getting input from various domain experts, and discovering new optimizations, says Camden.


Finding success with AI is a moving target, especially with mounting quality concerns. So, it's fascinating to see how agentic AI is being approached in real-world settings.


Check out the full story on LeadDev! And be sure to subscribe to DirectorPlus if you'd like this monthly column in your inbox. 


Featured image credit: Cash Macanaya on Unsplash.


Read: AI agents and the missing link in DevOps

Sign up to the DirectorPlus newsletter for a new story in your inbox each month featuring on-the-ground insights from some of the industry's top engineering leaders. Or, if you would like to be featured in the series, please read this.

By Bill Doerrfeld January 27, 2026
I recently moderated a webinar that brought together three luminaries in the API community to discuss the importance of API standards in agentic AI development.
By Bill Doerrfeld January 26, 2026
The more folks use MCP servers in development, the more they’re realizing it can lead to runaway token usage, unpredictable response sizes, and flooded context windows.
By Bill Doerrfeld January 20, 2026
Who really benefits from AI coding tools? New research suggests AI amplifies existing top performers more than average developers. Read my post on LeadDev.
By Bill Doerrfeld January 19, 2026
Many say edge computing will enable the future of AI inference. For InfoWorld, I looked at the tech required, and the roadblocks to overcome to get us there.
By Bill Doerrfeld January 15, 2026
Survey data from Zuplo finds rising MCP adoption, security concerns, and shows how developers are using MCP servers to connect AI with APIs in 2026.
By Bill Doerrfeld January 5, 2026
Blockchain for everything, metaverse, big data, NFTs... In hindsight, what were we thinking? Today, I call out some of tech's biggest overhyped trends on InfoWorld.
By Bill Doerrfeld January 5, 2026
Like any production software application, AI agents are producing a spectrum of metadata behind the scenes. Some are calling agentic metadata a “gold mine” to direct continual improvements.
By Bill Doerrfeld December 19, 2025
My latest DirectorPlus column with LeadDev interviews Bedrock Robotics' CTO, Kevin Peterson, on what it takes to develop highly adaptable and safe autonomous machines.
By Bill Doerrfeld December 17, 2025
I explore some tips to help speakers craft solid pitches. The Nordic APIs speaker selection committee looks for these sorts of things, but the tips could apply to any tech event.
By Bill Doerrfeld December 11, 2025
I made 10 predictions on how AI and APIs will converge in 2026. Signs point to AI agents being the next big API consumer.