Putting agentic AI to the test

Bill Doerrfeld | February 28, 2025

The latest edition of DirectorPlus explores how New Relic is utilizing agentic AI and what the results have been.


A lot is being said about agentic AI right now. But is it all hype?


I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, on this loaded topic for LeadDev — we dove into the details to explore how New Relic developers are actually putting it to the test and seeing real-world results.


This one is loaded with on-the-ground insights. For instance, I never dreamed image-to-text models would outperform raw text for things like navigating a database schema!


Success with agentic AI involves tracking the right metrics, bridging deterministic and probabilistic AI, getting input from various domain experts, and discovering new optimizations, says Camden.


Finding success with AI is a moving target, especially with mounting quality concerns. So, it's fascinating to see how agentic AI is being approached in real-world settings.


Check out the full story on LeadDev! And be sure to subscribe to DirectorPlus if you'd like this monthly column in your inbox. 


Featured image credit: Cash Macanaya on Unsplash.


Read: AI agents and the missing link in DevOps

Sign up to the DirectorPlus newsletter for a new story in your inbox each month featuring on-the-ground insights from some of the industry's top engineering leaders. Or, if you would like to be featured in the series, please read this.

Other Blog Posts

By Bill Doerrfeld June 10, 2026
I'm working with Zuplo on some new content around their MCP Gateway release. First up: a deep comparison of MCP gateways on the market!
By Bill Doerrfeld June 10, 2026
The constant barrage of AI layoffs is overshadowing the economic reasons behind these cuts, as well as the net-positive talent redistribution happening at large.
By Bill Doerrfeld June 8, 2026
My latest for InfoWorld reviews MCP servers and agent-ready tools for connecting AI agents with popular database styles.
By Bill Doerrfeld May 29, 2026
For my latest DirectorPlus edition, Joel Carusone from NinjaOne shares how engineering leaders can build the muscle for making tough calls.
Close-up of a glowing laptop keyboard in blue light, viewed at an angle with the screen above
By Bill Doerrfeld May 25, 2026
My latest InfoWorld feature explores how Model Context Protocol (MCP) supports context engineering for AI-assisted coding.
A set of metal keys on a keyring resting on a wooden surface.
By Bill Doerrfeld May 22, 2026
My latest for Nordic APIs explores 10 API key security risks and what to use alongside keys for stronger API security.
By Bill Doerrfeld May 18, 2026
The yearly API conference, apidays New York, is a hotbed for solid discussion on what's top of mind in the API space, and as MC I had a front row seat.
By Bill Doerrfeld May 13, 2026
My latest for CIO Online features real results form CIOs actively deploying AI agents to empower sales and revenue teams.
By Bill Doerrfeld May 12, 2026
Reports say consumers are souring on AI everywhere, all the time. So, at the risk of losing trust, or even potential business, is adding AI to an existing product really worth it?
By Bill Doerrfeld May 1, 2026
Cloudflare rebuilt Next.js over a weekend using agentic coding.