Putting agentic AI to the test

Bill Doerrfeld | February 28, 2025

The latest edition of DirectorPlus explores how New Relic is utilizing agentic AI and what the results have been.


A lot is being said about agentic AI right now. But is it all hype?


I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, on this loaded topic for LeadDev — we dove into the details to explore how New Relic developers are actually putting it to the test and seeing real-world results.


This one is loaded with on-the-ground insights. For instance, I never dreamed image-to-text models would outperform raw text for things like navigating a database schema!


Success with agentic AI involves tracking the right metrics, bridging deterministic and probabilistic AI, getting input from various domain experts, and discovering new optimizations, says Camden.


Finding success with AI is a moving target, especially with mounting quality concerns. So, it's fascinating to see how agentic AI is being approached in real-world settings.


Check out the full story on LeadDev! And be sure to subscribe to DirectorPlus if you'd like this monthly column in your inbox. 


Featured image credit: Cash Macanaya on Unsplash.


Read: AI agents and the missing link in DevOps

Sign up to the DirectorPlus newsletter for a new story in your inbox each month featuring on-the-ground insights from some of the industry's top engineering leaders. Or, if you would like to be featured in the series, please read this.

Brain in a gravitational well, surrounded by concentric circles, with blue lines extending from the brain.
By Bill Doerrfeld December 8, 2025
My latest for InfoWorld breaks down 10 MCP servers powering next-gen devops workflows, from GitHub and Atlassian to AWS and Pulumi.
Man speaking at
By Bill Doerrfeld December 2, 2025
Excited to share my talk from Nordic APIs' Platform Summit 2025. As the opening talk of the event, I wanted to address the elephant in the room head-on: MCP.
Panel discussion on stage with five speakers and audience in front of a blue screen with speaker names.
By Bill Doerrfeld December 1, 2025
Watch all the great API talks, keynotes, and panel discussions from this year's Nordic APIs Platform Summit, now available on YouTube.
Open source flag leaddev directorplus doerrfeld Block
By Bill Doerrfeld November 28, 2025
Block's open source initiative is helping to build brand reputation, attract talent, boost partnerships, guide internal open source best practices, and aid long-term system reliability.
How CIOs are getting a return from AI
By Bill Doerrfeld November 26, 2025
Achieving ROI with AI requires a mix of strong leadership stewardship upfront, shifting the talent framework, and embedding proper monitoring and governance throughout the lifecycle.
Knowledge base for AI agents
By Bill Doerrfeld November 24, 2025
I recently explored what goes into creating a solid AI agent knowledge base — from the types of data it should contain to the retrieval mechanisms and architecture patterns that support reliable agentic behavior.
linkedin ai assistant hiring agent
By Bill Doerrfeld October 31, 2025
I recently spoke with LinkedIn VP of Engineering Prashanthi Padmanabhan about the making of their Hiring Assistant, an agent recruiters are using to optimize the applicant selection process.
How to fail at platfom engineering
By Bill Doerrfeld October 22, 2025
How do you fail at platform engineering? Make it 100% UI-first. Don't market it. Survey no one. Measure success by who's onboarded. And just copy what others are doing.
Platform summit conference nordic apis stockholm bill doerrfeld
By Bill Doerrfeld October 21, 2025
This year's Platform Summit felt reinvigorated, with many new motivations and areas to discuss. Of course, AI agents and MCP stole the show.
Colorful hot air balloons against a bright blue sky.
By Bill Doerrfeld September 26, 2025
For my latest DirectorPlus edition, I interviewed Thomas Johnson, co-founder and CTO of Multiplayer, about lessons learned releasing their MCP server.