How do you craft a great AI knowledge base?

Bill Doerrfeld | November 24, 2025

How do you build a knowledge base for AI agents?

Excited to share my latest for InfoWorld, which explores what goes into creating a solid AI agent knowledge base — from the types of data it should contain to the retrieval mechanisms and architecture patterns that support reliable agentic behavior.


Shared context becomes especially important once you introduce multiple agents into a workflow. So this piece digs into structured, semi-structured, and unstructured data sources, how vector search, graph traversal, and RAG-style retrieval fit in, and why designing the right knowledge graph or abstraction layer matters.


The biggest hurdle? Keeping the knowledge fresh. "Freshness, or lack thereof, is the silent killer of AI knowledge systems," says AJ Sunder.


This is a fascinating and fast-emerging area of agentic AI, and it’s interesting to see early patterns — especially around design and architecture — begin to take shape.


Check it out and, as always, feel free to let me know what you think. Also, if you would like to be featured in one of my articles, I'm always looking for new voices to connect with! Consider signing up to my newsletter, Under The Byline for feature opportunities.


As we fall deeper into the agentic AI rabbit hole, what should I explore next?

Read: Anatomy of an AI agent knowledge base

Other Blog Posts

By Bill Doerrfeld March 31, 2026
My latest InfoWorld feature explores what makes an enterprise MCP registry effective, from semantic discovery to governance and security for AI agents.
By Bill Doerrfeld March 30, 2026
My first-ever contribution to CSO Online looks at the shifting landscape, from perimeter-based security to API security, and how CISOs are responding.
By Bill Doerrfeld March 29, 2026
My latest feature for The New Stack looks into solutions being proposed to fix open source Slopmageddon.
A digital pattern of rounded rectangular blocks in shades of blue and purple, arranged in an interlocking layout.
By Bill Doerrfeld March 27, 2026
My latest DirectorPlus looks at how agentic AI is reshaping platform engineering at Squarespace: less shared code and more developer experience focus.
By Bill Doerrfeld March 19, 2026
Usage-based pricing is reshaping the API economy. Discover 5 API monetization success stories, including OpenAI, Plaid, and AssemblyAI.
A lightbulb against a purple background, containing a human brain with an
By Bill Doerrfeld March 18, 2026
Why event-driven APIs matter for AI workflows, enabling real-time data, scalable systems, and responsive agent behavior.
By Bill Doerrfeld February 28, 2026
While hardware usually gets the spotlight in physical AI, the real differentiator won't be hardware. It'll be the models.
By Bill Doerrfeld February 27, 2026
In the latest DirectorPlus, Workato's CTO explains how MCP-enabled integration catalyzed internal AI usage and ROI.
By Bill Doerrfeld February 18, 2026
My latest on InfoWorld reviews MCP servers from 5 major cloud providers
By Bill Doerrfeld February 18, 2026
How are organizations actually using agentic knowledge bases in practice? My article for The New Stack looks at six emerging patterns.