Designing and Implementing a Microsoft Azure AI Solution

Outline

• Prepare to develop AI solutions on Azure
  • Define artificial intelligence
  • Understand AI-related terms
  • Understand considerations for AI Engineers
  • Understand considerations for responsible AI
  • Understand capabilities of Azure Machine Learning
  • Understand capabilities of Azure AI Services
  • Understand capabilities of the Azure OpenAI Service
  • Understand capabilities of Azure AI Search
  • Knowledge check
• Create and consume Azure AI services
  • Provision an Azure AI services resource
  • Identify endpoints and keys
  • Use a REST API
  • Use an SDK
  • Exercise - Use Azure AI services
  • Knowledge check
• Secure Azure AI services
  • Consider authentication
  • Implement network security
  • Exercise - Manage Azure AI Services Security
  • Knowledge check
• Monitor Azure AI services
  • Monitor cost
  • Create alerts
  • View metrics
  • Manage diagnostic logging
  • Exercise - Monitor Azure AI services
  • Knowledge check
• Deploy Azure AI services in containers
  • Understand containers
  • Use Azure AI services containers
  • Exercise - Use a container
  • Knowledge check
• Use AI responsibly with Azure AI Content Safety
  • What is Content Safety
  • How does Azure AI Content Safety work?
  • When to use Azure AI Content Safety
  • Exercise - Implementing Azure AI Content Safety
  • Knowledge check
• Analyze images
  • Provision an Azure AI Vision resource
  • Analyze an image
  • Generate a smart-cropped thumbnail and remove background
  • Exercise - Analyze images with Azure AI Vision
  • Knowledge check
• Image classification with custom Azure AI Vision models
  • Understand custom model types
  • Create a custom project
  • Label and train a custom model
  • Exercise - Classify images with an Azure AI Vision custom model
  • Knowledge check
• Classify images
  • Provision Azure resources for Azure AI Custom Vision
  • Understand image classification
  • Train an image classifier
  • Exercise - Classify images with Azure AI Custom Vision
  • Knowledge check
• Detect objects in images
  • Understand object detection
  • Train an object detector
  • Consider options for labeling images
  • Exercise - Detect objects in images with Azure AI Custom Vision
  • Knowledge check
• Detect, analyze, and recognize faces
  • Identify options for face detection analysis and identification
  • Understand considerations for face analysis
  • Detect faces with the Azure AI Vision service
  • Understand capabilities of the face service
  • Compare and match detected faces
  • Implement facial recognition
  • Exercise - Detect, analyze, and identify faces
  • Knowledge check
• Read Text in images and documents with the Azure AI Vision Service
  • Explore Azure AI Vision options for reading text
  • Use the Read API
  • Exercise - Read text in images
• Analyze video
  • Understand Azure Video Indexer capabilities
  • Extract custom insights
  • Use Video Analyzer widgets and APIs
  • Exercise - Analyze video
  • Knowledge check
• Analyze text with Azure AI Language
  • Provision an Azure AI Language resource
  • Detect language
  • Extract key phrases
  • Analyze sentiment
  • Extract entities
  • Extract linked entities
  • Exercise - Analyze text
  • Knowledge check
• Create question answering solutions with Azure AI Language
  • Understand question answering
  • Compare question answering to Azure AI Language understanding
  • Create a knowledge base
  • Implement multi-turn conversation
  • Test and publish a knowledge base
  • Use a knowledge base
  • Improve question answering performance
  • Exercise - Create a question answering solution
  • Knowledge check
• Build a conversational language understanding model
  • Understand prebuilt capabilities of the Azure AI Language service
  • Understand resources for building a conversational language understanding model
  • Define intents, utterances, and entities
  • Use patterns to differentiate similar utterances
  • Use pre-built entity components
  • Train, test, publish, and review a conversational language understanding model
  • Exercise - Build an Azure AI services conversational language understanding model
  • Knowledge check
• Create a custom text classification solution
  • Understand types of classification projects
  • Understand how to build text classification projects
  • Exercise - Classify text
  • Knowledge check
• Custom named entity recognition
  • Understand custom named entity recognition
  • Label your data
  • Train and evaluate your model
  • Exercise - Extract custom entities
  • Knowledge check
• Translate text with Azure AI Translator service
  • Provision an Azure AI Translator resource
  • Understand language detection, translation, and transliteration
  • Specify translation options
  • Define custom translations
  • Exercise - Translate text with the Azure AI Translator service
  • Knowledge check
• Create speech-enabled apps with Azure AI services
  • Provision an Azure resource for speech
  • Use the Azure AI Speech to Text API
  • Use the text to speech API
  • Configure audio format and voices
  • Use Speech Synthesis Markup Language
  • Exercise - Create a speech-enabled app
  • Knowledge check
• Translate speech with the Azure AI Speech service
  • Provision an Azure resource for speech translation
  • Translate speech to text
  • Synthesize translations
  • Exercise - Translate speech
  • Knowledge check
• Create an Azure AI Search solution
  • Manage capacity
  • Understand search components
  • Understand the indexing process
  • Search an index
  • Apply filtering and sorting
  • Enhance the index
  • Exercise - Create a search solution
  • Knowledge check
• Create a custom skill for Azure AI Search
  • Define the custom skill schema
  • Add a custom skill
  • Custom text classification skill
  • Machine learning custom skill
  • Exercise - Create a Custom Skill for Azure AI Search
  • Knowledge check
• Create a knowledge store with Azure AI Search
  • Define projections
  • Define a knowledge store
  • Exercise - Create a knowledge store
  • Knowledge check
• Implement advanced search features in Azure AI Search
  • Improve the ranking of a document with term boosting
  • Improve the relevance of results by adding scoring profiles
  • Improve an index with analyzers and tokenized terms
  • Enhance an index to include multiple languages
  • Improve search experience by ordering results by distance from a given reference point
  • Exercise: Implement enhancements to search results
  • Knowledge check
• Search data outside the Azure platform in Azure AI Search using Azure Data Factory
  • Index data from external data sources using Azure Data Factory
  • Index any data using the Azure AI Search push API
  • Exercise: Add to an index using the push API
  • Knowledge check
• Maintain an Azure AI Search solution
  • Manage security of an Azure AI Search solution
  • Optimize performance of an Azure AI Search solution
  • Manage costs of an Azure AI Search solution
  • Improve reliability of an Azure AI Search solution
  • Monitor an Azure AI Search solution
  • Debug search issues using the Azure portal
  • Exercise - Debug search issues
  • Knowledge check
• Perform search reranking with semantic ranking in Azure AI Search
  • What is semantic ranking?
  • Set up semantic ranking
  • Exercise - Use semantic ranking on an index
  • Knowledge check
• Perform vector search and retrieval in Azure AI Search
  • What is vector search?
  • Prepare your search
  • Understand embedding
  • Exercise - Use the REST API to run vector search queries
  • Knowledge check
• Plan an Azure AI Document Intelligence solution
  • Understand AI Document Intelligence
  • Plan Azure AI Document Intelligence resources
  • Choose a model type
  • Knowledge check
• Use prebuilt Document intelligence models
  • Understand prebuilt models
  • Use the General Document, Read, and Layout models
  • Use financial, ID, and tax models
  • Exercise - Analyze a document using Azure AI Document Intelligence
  • Knowledge check
• Extract data from forms with Azure Document intelligence
  • What is Azure Document Intelligence?
  • Get started with Azure Document Intelligence
  • Train custom models
  • Use Azure Document Intelligence models
  • Use the Azure Document Intelligence Studio
  • Exercise - Extract data from custom forms
  • Knowledge check
• Create a composed Document intelligence model
  • Understand composed models
  • Assemble composed models
  • Exercise: Create a composed model
  • Knowledge check
• Get started with Azure OpenAI Service
  • Access Azure OpenAI Service
  • Use Azure AI Studio
  • Explore types of generative AI models
  • Deploy generative AI models
  • Use prompts to get completions from models
  • Test models in Azure AI Studio's playground
  • Exercise - Get started with Azure OpenAI Service
  • Knowledge check
• Build natural language solutions with Azure OpenAI Service
  • Integrate Azure OpenAI into your app
  • Use Azure OpenAI REST API
  • Use Azure OpenAI SDK
  • Exercise - Integrate Azure OpenAI into your app
  • Knowledge check
• Apply prompt engineering with Azure OpenAI Service
  • Understand prompt engineering
  • Write more effective prompts
  • Provide context to improve accuracy
  • Exercise - Utilize prompt engineering in your application
  • Knowledge check
• Generate code with Azure OpenAI Service
  • Construct code from natural language
  • Complete code and assist the development process
  • Fix bugs and improve your code
  • Exercise - Generate and improve code with Azure OpenAI Service
  • Knowledge check
• Generate images with Azure OpenAI Service
  • What is DALL-E?
  • Explore DALL-E in Azure AI Studio
  • Use the Azure OpenAI REST API to consume DALL-E models
  • Exercise - Generate images with a DALL-E model
  • Knowledge check
• Implement Retrieval Augmented Generation (RAG) with Azure OpenAI Service
  • Understand Retrieval Augmented Generation (RAG) with Azure OpenAI Service
  • Add your own data source
  • Chat with your model using your own data
  • Exercise - Add your data for RAG with Azure OpenAI Service
  • Knowledge check