How do you craft a great AI knowledge base?

Bill Doerrfeld | November 24, 2025

How do you build a knowledge base for AI agents?

Excited to share my latest for InfoWorld, which explores what goes into creating a solid AI agent knowledge base — from the types of data it should contain to the retrieval mechanisms and architecture patterns that support reliable agentic behavior.


Shared context becomes especially important once you introduce multiple agents into a workflow. So this piece digs into structured, semi-structured, and unstructured data sources, how vector search, graph traversal, and RAG-style retrieval fit in, and why designing the right knowledge graph or abstraction layer matters.


The biggest hurdle? Keeping the knowledge fresh. "Freshness, or lack thereof, is the silent killer of AI knowledge systems," says AJ Sunder.


This is a fascinating and fast-emerging area of agentic AI, and it’s interesting to see early patterns — especially around design and architecture — begin to take shape.


Check it out and, as always, feel free to let me know what you think. Also, if you would like to be featured in one of my articles, I'm always looking for new voices to connect with! Consider signing up to my newsletter, Under The Byline for feature opportunities.


As we fall deeper into the agentic AI rabbit hole, what should I explore next?

Read: Anatomy of an AI agent knowledge base

Other Blog Posts

By Bill Doerrfeld • October 5, 2026
My latest for LeadDev interviews a Meta engineer who built an agentic system to optimize their capacity planning, leading to real power use savings.
By Bill Doerrfeld • September 30, 2026
I set out expecting to write an article about how every enterprise was jumping on trendy alternative or "neo" clouds. That ended up not being the case.
By Bill Doerrfeld • September 28, 2026
Join the virtual AI Pen-Testing Conference to explore how AI is changing penetration testing, red teaming, and the security testing of AI systems.
By Bill Doerrfeld • September 28, 2026
Counting down to Nordic APIs Summit 2026 in Stockholm, featuring 60+ speakers exploring agentic AI, APIs, MCP, and security.
By Bill Doerrfeld • September 28, 2026
I covered a Yale and GitHub report on LeadDev that explores developer attitudes on climate change and curbing IT waste.
By Bill Doerrfeld • September 15, 2026
Does your agent really need access to every tool call under the sun?
By Bill Doerrfeld • September 8, 2026
I'll be writing a weekly series for The New Stack this fall covering Kubernetes, cloud native, and everything happening on the road to KubeCon in November.
By Bill Doerrfeld • September 1, 2026
I'm teaming up with Dan Barahona and AI Security University to put together the MCP Security Conference, a free half-day virtual event dedicated to MCP security .
By Bill Doerrfeld • August 27, 2026
My latest DirectorPlus edition interviews Shopify's head of engineering, Farhan Thawar, on their unique internal engineering culture.
By Bill Doerrfeld • August 24, 2026
Neoclouds promise cheaper GPUs and AI-optimized infrastructure, but can they really challenge hyperscalers? My feature on InfoWorld explores their advantages, risks, and likely role in AI compute.