Putting agentic AI to the test

Bill Doerrfeld | February 28, 2025

The latest edition of DirectorPlus explores how New Relic is utilizing agentic AI and what the results have been.


A lot is being said about agentic AI right now. But is it all hype?


I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, on this loaded topic for LeadDev — we dove into the details to explore how New Relic developers are actually putting it to the test and seeing real-world results.


This one is loaded with on-the-ground insights. For instance, I never dreamed image-to-text models would outperform raw text for things like navigating a database schema!


Success with agentic AI involves tracking the right metrics, bridging deterministic and probabilistic AI, getting input from various domain experts, and discovering new optimizations, says Camden.


Finding success with AI is a moving target, especially with mounting quality concerns. So, it's fascinating to see how agentic AI is being approached in real-world settings.


Check out the full story on LeadDev! And be sure to subscribe to DirectorPlus if you'd like this monthly column in your inbox. 


Featured image credit: Cash Macanaya on Unsplash.


Read: AI agents and the missing link in DevOps

Sign up to the DirectorPlus newsletter for a new story in your inbox each month featuring on-the-ground insights from some of the industry's top engineering leaders. Or, if you would like to be featured in the series, please read this.

Using agentic AI for business workflows
By Bill Doerrfeld April 30, 2025
For CIO.com, leading executives shared with me how they're actively utilizing agentic AI to enhance core business workflows.
Making developer productivity metrics actionable LeadDev DirectorPlus
By Bill Doerrfeld April 25, 2025
Developer productivity metrics are useless if they're just sitting in dashboards. So, how can we use them to direct positive, real-world action?
New study reveals what really drives revenue per engineer
By Bill Doerrfeld April 10, 2025
What leads to a higher revenue per engineer? New benchmarking from DX reveals how areas like R&D spend, org size, and growth rate move the needle.
LLMs can now cite their sources
By Bill Doerrfeld April 9, 2025
My latest post on The New Stack reveals how researchers pinpoint the exact sources behind chatbot responses.
Exploring alternative managed Kubernetes platforms
By Bill Doerrfeld March 31, 2025
The Kubernetes ecosystem has exploded with managed platforms tailored to multi-cloud, edge, on-prem, and regional deployments.
Bringing internal engineering gems into the light
By Bill Doerrfeld March 28, 2025
Some internal projects are too good to stay hidden. For DirectorPlus, Spotify's Pia Nilsson shares how to identify and externalize internal platforms — like they did with Backstage.
Why AI-generated code is not enough
By Bill Doerrfeld March 17, 2025
My latest feature for InfoWorld looks into the gaps surrounding AI-generated code and what leaders believe we need to improve the status quo.
Can LLMs accelerate requirements engineering?
By Bill Doerrfeld March 6, 2025
New research shows LLMs outperform humans in software requirements engineering, reducing weeks of work to seconds while improving completeness by 10.2%.
Infoworld feature on ebpf and container networking
By Bill Doerrfeld March 3, 2025
Containers are designed to be isolated—that's great for security but tricky for networking. My feature with InfoWorld explores how eBPF is evolving container networking.
Study reveals growing technical debt in AI age
By Bill Doerrfeld February 19, 2025
The 2nd annual code quality report from GitClear found 10x more duplicated code than two years ago and fewer signs of code reuse than ever before.
More Posts