Skip to main content

Azure AI Services Overview

Azure AI provides a comprehensive suite of cloud-based artificial intelligence services designed to help developers and organizations build intelligent applications without requiring deep AI or data science expertise. From agent development to machine learning operations, Azure AI covers the full spectrum of AI capabilities.

Core Services

Azure AI is built around four core services that work together to provide a complete AI platform:

Microsoft Foundry

Unified AI PlatformBuild AI agents and generative AI applications on an enterprise-grade platform with cutting-edge models and tools.
  • Multi-agent orchestration
  • 1,400+ tool integrations
  • Memory and knowledge capabilities
  • Real-time observability

Azure Machine Learning

ML Lifecycle ManagementAccelerate the complete machine learning project lifecycle from training to deployment with enterprise MLOps.
  • Automated ML
  • Distributed training
  • Model catalog with LLMs
  • Managed endpoints

Azure AI Search

Intelligent RetrievalAI-powered information retrieval for rich search experiences and RAG applications with enterprise data.
  • Classic and agentic search
  • Vector and hybrid search
  • AI enrichment pipeline
  • Knowledge bases

Azure Open Datasets

Curated Public DataPre-processed public datasets for enriching machine learning models with weather, census, and location data.
  • Transportation datasets
  • Economic indicators
  • Weather and climate data
  • Labor force statistics

Foundry Tools (Cognitive Services)

Azure AI includes a comprehensive set of pre-built AI services called Foundry Tools, formerly known as Azure Cognitive Services:

Vision Services

Analyze content in images and videos with computer vision capabilities.Features:
  • Image analysis and tagging
  • Object detection
  • Facial recognition
  • OCR (Optical Character Recognition)
  • Spatial analysis
  • Multimodal embeddings
Use Cases: Content moderation, document processing, retail analytics, security systems
Customize image recognition for your specific business needs.Features:
  • Custom image classification
  • Object detection models
  • Transfer learning
  • Easy deployment
Use Cases: Quality control, product identification, specialized image classification

Language Services

Build apps with industry-leading natural language understanding.Features:
  • Named entity recognition
  • Sentiment analysis with opinion mining
  • Key phrase extraction
  • Language detection
  • Question answering
  • Conversational language understanding
Use Cases: Chatbots, content analysis, document understanding, customer feedback analysis
AI-powered translation for 100+ languages and dialects.Features:
  • Real-time translation
  • Document translation
  • Custom translation models
  • Transliteration
  • Dictionary lookup
Use Cases: Global applications, content localization, multilingual support

Speech Services

Speech to text, text to speech, translation, and speaker recognition.Features:
  • Speech-to-text transcription
  • Text-to-speech synthesis
  • Speech translation
  • Speaker identification
  • Custom voice models
  • Pronunciation assessment
Use Cases: Voice assistants, transcription services, accessibility features, call center analytics

Document & Content Services

Turn documents into intelligent data-driven solutions.Features:
  • Pre-built document models (invoices, receipts, IDs)
  • Custom document models
  • Layout analysis
  • Table extraction
  • Form field extraction
Use Cases: Document processing automation, invoice processing, form digitization
Analyze and comprehend various media content types.Features:
  • Multi-modal content analysis
  • Content classification
  • Scene detection
  • Audio analysis
Use Cases: Media management, content curation, digital asset management
Detect unwanted content with AI-powered moderation.Features:
  • Text moderation
  • Image moderation
  • Harmful content detection
  • Custom blocklists
  • Severity scoring
Use Cases: Social platforms, user-generated content, chat moderation

Reading & Accessibility

Help users read and comprehend text with inclusive design.Features:
  • Text-to-speech
  • Translation
  • Grammar highlighting
  • Reading comprehension tools
  • Focus mode
Use Cases: Educational apps, accessibility features, language learning

Service Comparison

When to Use Each Service

ServiceBest ForKey Strength
Microsoft FoundryBuilding agents, generative AI appsUnified platform with agent orchestration
Azure Machine LearningCustom ML models, MLOpsComplete ML lifecycle management
Azure AI SearchSearch functionality, RAG appsInformation retrieval with AI enrichment
Foundry ToolsPre-built AI capabilitiesReady-to-use APIs for common tasks
Open DatasetsData enrichmentPre-processed public datasets

Integration Patterns

Cross-Service Workflows

Azure AI services are designed to work together seamlessly:
1

Data Preparation

Use Open Datasets to enrich your training data with external signals like weather, location, or economic indicators.
2

Model Development

Build custom models with Azure Machine Learning or use pre-built models from Microsoft Foundry.
3

Content Processing

Apply Foundry Tools (Vision, Language, Document Intelligence) to extract and structure information from raw content.
4

Information Retrieval

Index processed content in Azure AI Search for fast retrieval and RAG applications.
5

Agent Integration

Connect everything through Microsoft Foundry agents that orchestrate tools and knowledge sources.

Common Use Cases

Intelligent Document Processing

Combine Document Intelligence to extract structure, AI Search to index content, and Foundry agents to answer questions.

Customer Service Automation

Use Speech/Language services for input, Foundry agents for orchestration, and AI Search for knowledge retrieval.

Predictive Analytics

Enrich data with Open Datasets, train models in Azure ML, and deploy for real-time predictions.

Regional Availability

Azure AI services are available in most Azure regions worldwide:
Important: Not all features are available in all regions. Some advanced capabilities like agentic retrieval in AI Search or specific model deployments in Foundry have regional restrictions.Check the region support documentation for your specific services.
  • North America: East US, West US 2, Canada Central
  • Europe: West Europe, North Europe, UK South
  • Asia Pacific: Southeast Asia, East Asia, Australia East

Pricing Overview

Azure AI services use different pricing models:
Most Foundry Tools use transaction-based pricing:
  • Charged per API call or transaction
  • No upfront commitment
  • Scales with usage
  • Free tiers available for testing
Cost Optimization: Use the free tier for development and testing. Enable auto-shutdown for compute instances. Monitor usage with Azure Cost Management.

Security & Compliance

All Azure AI services include enterprise-grade security:
  • Authentication: Microsoft Entra ID, managed identities, API keys
  • Network Security: Virtual networks, private endpoints, firewalls
  • Data Protection: Encryption at rest and in transit
  • Compliance: HIPAA, ISO, SOC, GDPR, FedRAMP
  • Access Control: Role-based access (RBAC), resource-level policies
  • Audit Logging: Azure Monitor, diagnostic logs

Development Tools

Azure AI services support multiple development approaches:

SDKs Available

  • Python: Most comprehensive SDK support
  • C# / .NET: Full-featured enterprise SDKs
  • JavaScript/TypeScript: Node.js and browser support
  • Java: Enterprise application integration
  • REST APIs: Language-agnostic HTTP APIs

Development Environments

  • Azure Portal: Web-based resource management
  • Azure CLI: Command-line automation
  • VS Code Extensions: Local development experience
  • Jupyter Notebooks: Interactive data science
  • Azure Machine Learning Studio: Visual ML development
  • Microsoft Foundry Portal: Agent and model development

Getting Started

Ready to start building with Azure AI?

Quickstart Guide

Create your first AI project in minutes

Service Details

Explore individual service capabilities

Code Samples

Browse working examples and templates

Architecture Patterns

Learn best practices and design patterns

Additional Resources

Build docs developers (and LLMs) love