Create a Knowledge Base
A knowledge base orchestrates agentic retrieval by connecting to an LLM for query planning and one or more knowledge sources for data retrieval.Prerequisites
- Azure AI Search service
- Azure OpenAI resource with gpt-4o, gpt-4.1, or gpt-5 deployment
- At least one knowledge source
- Semantic ranker enabled
Knowledge Base Structure
Configuration Options
LLM Connection
Specify Azure OpenAI resource for query planning:Retrieval Reasoning Effort
Control LLM processing level:- minimal: No LLM, direct search only
- low: Basic query planning
- medium: Full query planning and expansion
Knowledge Sources
Reference one or more knowledge sources by name:Create Using REST API
Query the Knowledge Base
Response Structure
Best Practices
Clear Descriptions
Provide descriptive names and descriptions for LLM context
Start with Low Effort
Begin with low reasoning effort, increase only if needed
Monitor Costs
Track token usage and optimize reasoning effort
Test Thoroughly
Validate with representative queries before production
Next Steps
Query API Reference
Explore the full API
Foundry Integration
Connect to Foundry Agent Service