
Review the dp-100 exam requirements for Azure Machine Learning, including costs, languages, scheduling, and the study guide, with emphasis on explore data and train models and deploy workflows.
Create an Azure machine learning workspace in the Azure portal by configuring subscription, resource group, storage, key vault, and application insights, then choose region and endpoint options.
Launch and navigate azure machine learning studio to manage notebooks, datasets, compute, data labeling, and models, exploring automated ml and designer workflows and deployments.
Create an experiment compute instance to establish a CPU-based development environment for machine learning, configure storage options, SSH access, and regional settings.
Manage multiple compute instances and clusters to control costs by stopping unused resources, while configuring dev environments with preinstalled tools like Python, PyTorch, Jupyter, and VS Code integration without SSH.
Create your first ml pipeline in Azure Machine Learning designer, attach a compute target, clean data, split 70/30, train a linear regression model, and evaluate with scoring.
Submit your pipeline as an experiment on azure machine learning, then track progress from a 70/30 data split to training, scoring, and evaluation, including mean absolute error.
Build a pipeline with custom code using Python scripts and pandas to perform binary classification on the German credit dataset, evaluating four models with two algorithms and submitting the run.
Create and run an Azure machine learning designer pipeline using pre-built modules, add a preprocess step, apply a custom regex, and use a Python script to replace NaN with zero.
Set up your local machine to run Python and install the Azure SDK with Miniconda, create a conda environment, install Azure ML Core, and prepare a dot Azure ML directory.
Create an Azure ML workspace via the sdk by writing Python code, configuring subscription, resource group, and location, and authenticating to deploy storage, key vault, and application insights.
Set up an Azure ML workspace from a config.json, provision a CPU cluster as a compute target with the Azure ML SDK, and run a simple Python program.
Train a neural network in Python using SDK with Torch and torchvision on CIFAR-10, run locally for testing, then package and push the model to Azure machine learning environment.
Shows deploying a trained PyTorch model to Azure Machine Learning via the SDK, switching conda environments, running on cloud, and replicating local outputs with CIFAR-10 pipelines and workspaces.
Build and run an Azure machine learning pipeline with SDK in Python, use Azure ML Core, data stores and datasets, and score with a TensorFlow model on a GPU-enabled environment.
Explore AutoML with the SDK by cloning a regression notebook, configuring AutoML settings, and submitting an experiment to Azure ML from a Jupyter notebook.
Explore hyperdrive for hyperparameter tuning in Azure ML, using the train hyperdrive module to run multiple configurations, apply early termination with a bandit policy, and identify the best model.
Register and deploy a winning trained model in Azure Machine Learning by selecting the best model from an end-to-end workflow, examining artifacts and scripts like score.py to ensure production readiness.
Use the compute tab to create an inference cluster with a Kubernetes service and a public Rest API for deploying models, choosing region, vm type, and real-time or batch deployment.
Deploy the best AutoML model to an Azure inference cluster via no-code deployment, configure web service access, and manage authentication and autoscaling for scalable AI deployments.
Deploy an AutoML endpoint and access its REST endpoint to score models using the sample code in Python, C#, or R, with deployment logs and authentication details available.
Register the trained model, download the conda yaml and score.py, then deploy the real-time ml designer pipeline on Azure Kubernetes Service with three replicas.
Register your model, configure an inference setup, and deploy sdk models using a custom entry script with init and run; provision the environment and deploy via model.deploy.
The lecture demonstrates deploying a batch inference pipeline, submitting the job, publishing the pipeline, and obtaining the rest endpoint URL for the deployed Azure ML pipeline.
Conclude course by reinforcing the DP-100 certification focus and guiding hands-on Azure practice with lifetime video access, plus creating an Azure account, ML workspace, and experiments before scheduling the exam.
Gain a foundational overview of Azure AI fundamentals, covering AI workloads, machine learning on Azure, computer vision, and natural language processing with cognitive services.
Define artificial intelligence, distinguish narrow AI from general AI, and explore machine learning, natural language processing, and perception with examples like self-driving cars and real-time transcriptions.
Discover the AI-900 exam requirements for Microsoft Azure AI Fundamentals, covering AI workloads like anomaly detection, computer vision, NLP, with a 700 passing score.
Explore common AI workloads in Azure, including prediction and demand forecasting, supervised learning, anomaly detection, computer vision, natural language processing, knowledge mining, and conversational AI.
Promote fairness by examining AI decisions that affect groups, ensure reliability and safety in cases, and safeguard privacy and security in scenarios like emergency rooms, bank loans, and Tesla Autopilot.
Discover common machine learning types on Azure, including regression, binary and multi-class classification, and clustering, with examples like movie recommendations, car image recognition, happiness scoring, and spam detection.
Learn core machine learning concepts by defining features as input variables and labels as the target, and explore the Goldilocks effect to find right features with a life expectancy example.
Prepare large datasets and randomly split them into training and validation sets. Evaluate regression and classification models in Azure Machine Learning using metrics like mean squared error and confusion concepts.
Explore no-code machine learning with Azure Machine Learning by using AutoML and the machine learning designer to prepare data, select features, train models, and evaluate results for production-ready predictions.
Create and configure an Azure machine learning workspace, set up storage, keys, and compute resources, access ml.azure.com designer, and explore automated ML to build no-code models.
Create a dataset from the web and use Azure AutoML to build a no-code model, configure regression with rmse, and deploy the trained model to a web service.
Explore Azure ML designer for no-code model building: drag data onto canvas, view histograms of columns, normalize features, exclude rows or columns, and train a linear regression model with evaluation.
Build a no-code ml model with ml designer, select and clean dataset columns, normalize features, split data into training and testing sets, and train and score a linear regression model.
Azure cognitive services umbrella, with a single endpoint and key, covering computer vision, custom vision, face service, and form recognizer for object detection, captions, text recognition, and content moderation.
Create and configure an Azure cognitive service, obtain the key and endpoint, and run a pre-built computer vision model in Python to describe images and identify objects and faces.
Create a custom vision resource and project, configure a classification task, upload images, tag negative samples, train the model, and evaluate predictions.
Discover natural language processing workloads in Azure and how they enable conversational AI with Azure Bot services. Explore key phrase extraction, entity recognition, sentiment analysis, speech-to-text, text-to-speech, and translation.
Explore Azure cognitive services for language processing, including text analytics (key phrases, entities, sentiment, language detection) and language understanding (utterances, entities, intents), plus speech and translation features for conversational ai.
Explore how conversational AI uses natural language understanding to respond via web chat, voice, and assistants, with Azure bot tools like Q&A Maker and Bot Framework.
Conclude the Azure fundamentals course by preparing to schedule your exam on the Microsoft site, and enjoy lifetime access while studying a little more and revisiting videos.
Explore dp-900, Microsoft Azure data fundamentals, a low cost certification. Learn data concepts, relational and non-relational data, and analytics as a stepping stone to data engineer or database administrator roles.
Describe core data concepts by comparing structured, unstructured, and semi-structured data, with examples from relational databases, Excel, storage blob containers, and xml, json, and yaml formats.
Identify the best data storage options by data type and business needs. Use relational databases for structured data, blob storage for unstructured files, and Cosmos DB for semi-structured workloads.
Learn the features of relational databases, including tables with rows and columns, schemas, primary keys, and indexes, and how views create virtual tables for secure joins.
Describe normalization in relational databases to reduce data redundancy and improve data integrity by using primary keys, referential integrity, and compact data designs.
Learn how normalization structures database design to improve integrity and reduce redundancy. Explore the first, second, and third normal forms, including primary keys, atomic columns, and compound keys.
Connect to an Azure SQL Server, explore sample tables in SQL Server Management Studio, and run select, where, and update queries on a cloud database.
Explore creating and using views in SQL Server Management Studio, turning a query into a five-column view called customer limited, and granting view permissions for security.
Learn how database indexes speed searches by sorting data and targeting columns like customer id, email, and first name, and how to create non-clustered indexes for efficient queries.
Explore non-relational databases and NoSQL, explain how they differ from table-based relational databases, and why they optimize for diverse sources and massive web-scale data such as JSON and XML.
Explore Azure relational database options across IaaS, PaaS, and SaaS models. Review SQL Server on a VM, Azure SQL Database, elastic databases with resource pools, Synapse Analytics, and managed instances.
Learn how to provision and deploy an Azure SQL database in the portal, including selecting a server, configuring pricing, networking, and connecting via SQL Server Management Studio.
Explore how ARM templates and Azure Resource Manager translate portal actions into JSON templates deployed via REST API, enabling parameterized deployments and scalable SQL servers and databases.
Discover how Azure SQL Database enforces security with firewall rules, public network access control, IP whitelisting, TLS version settings, and virtual networks.
Explore relational query tools in Azure, including the built-in query editor, Azure Data Studio, and SQL Server Management Studio, plus the cross-platform SQL command line.
Explore Azure relational database options—SQL on a VM, SQL managed instance, Azure SQL database, and Azure databases for MySQL, PostgreSQL, and MariaDB—covering compatibility and deployment choices.
Explore Azure non-relational databases led by Cosmos DB with graph, document, and table models, MongoDB API compatibility, configurable consistency, and global scale with a fast single-digit millisecond service level agreement.
Create an Azure Cosmos DB in the Azure portal, configure settings such as geo-redundancy, public endpoint, virtual network, backup policy, and encryption, and compare it with relational databases.
Learn to deploy and manage Cosmos DB with arm templates, modify resources in a template, and use Azure CLI or PowerShell to implement infrastructure as code.
Explore cosmos db security by configuring networking to restrict public access, enabling selected networks or private access, managing read-write and read-only keys, and regenerating keys to revoke compromised access.
Learn how Cosmos DB enables geo-replication across global regions, creating read-only copies in East US and Northern Europe, and weighing the cost of multi-region replication and read-write setups.
Explore the modern data warehouse architecture, linking data sources, data factory, data lake, Databricks, Synapse Analytics, Analysis Services, and Power BI.
Leverage Azure Data Factory to orchestrate data ingestion and transformation for batch and streaming data, linking external sources to destinations with pipelines, activities, and triggers.
Schedule your exam on the Microsoft website and review your notes before test day. Finish the course with best wishes for your exam and take care.
Explore the DP-300 exam requirements for Azure SQL solutions, covering plan and implement data platform resources, secure environments, monitor and automate, and plan high availability and disaster recovery.
Explore Azure relational databases, including Azure SQL Database, SQL Server on a VM, and managed instance, plus open source options like MySQL, PostgreSQL, and MariaDB.
Create an Azure virtual machine with Windows Server 2019, enable RDP, and install SQL Server 2019 evaluation on the VM.
Enable tcp/ip and open port 1433 in Azure and Windows firewall, restart SQL Server, then connect with SQL Server Management Studio to create a dummy database on a 2019 VM.
Deploy SQL server 2019 on Windows Server 2019 via Azure Marketplace, with automatic installation, then connect via SQL Server Management Studio to create a database such as edu cpa db.
Configure automated patching for a SQL server running on an Azure virtual machine, and set a maintenance window of 60 minutes to apply patches automatically.
Create an Azure SQL single database, configure a new server with strong credentials, choose the sample AdventureWorks, and connect via SQL Server Management Studio while adjusting firewall rules.
Learn how to connect to the Azure SQL server, run queries in the query editor or SQL management studio, and view or edit results.
Choose the right Azure relational database by evaluating open source migrations, cloud-native Azure SQL Database, managed instance, or SQL Server on VM, based on your requirements.
Evaluate scaling requirements for cloud databases by understanding scaling up and down, scale out, read scale out, and global scale out in Azure SQL and SQL Server on VM.
Explore Azure SQL elastic pools that share resources across databases, create pools, move databases into the pool, and scale with core-based or DTU-based pricing and maintenance windows.
Scale a SQL server on a virtual machine by resizing the VM; this is disruptive and causes downtime, though data remains safe on the same disk. Optimize storage and configuration.
Explore Azure SQL replicas, offering read-only and read-write copies across regions, improving performance by distributing reads, and learn about sharding across servers, noting Azure SQL lacks multi-master like Cosmos DB.
Plan an upgrade strategy to migrate older on-prem SQL Server to Azure with the data migration assistant, including 32-bit to 64-bit upgrade and lock shipping.
Migrate SQL server data to Azure SQL database using the data migration assistant and Azure Migrate; create a migration project, run an assessment, and review results.
Explain security and identity management in cloud services and how Azure protects access. Describe SaaS, PaaS, and IaaS with examples from Office 365, Salesforce CRM, Google, and Rackspace.
Explore cloud computing basics, virtualization, and software as a service, including how hypervisors enable multiple virtual machines on shared hardware and abstract infrastructure.
Explore cloud computing drawbacks like low internet speed and latency. Learn mitigations such as redundant internet, express route, offline desktop/mobile apps with synchronization, and StorSimple on-prem storage with data centers.
Explore Azure app services and virtual machines, selecting free, basic, standard, or premium tiers to host web applications, with consumption-based bandwidth charges and scalable infrastructure options.
Explore Azure mobile services and the differences between virtual machines, application services, and cloud services, including data management, connectivity options (virtual network, endpoint, express route), and trade-offs like scalability.
Explore the Azure portal to access pricing, documentation, and core services. Create, deploy, and monitor web apps with IaaS compute and app services, configure endpoints, default documents, and web jobs.
Learn to monitor and scale a web application in Azure, configure backups and linked resources, publish via file transfer protocol, and explore app service plans, pricing, and the marketplace.
Discover azure virtual network and hybrid cloud concepts with on premise and cloud resources. Experience high availability, auto scaling, and load balancing with CapEx and OpEx considerations.
Configure an Azure cloud network by selecting a dns server and establishing a site-to-site vpn to an on-premise network, while defining address spaces and department subnets.
Learn to create and connect an IBM Cloud virtual network to on-premises networks using gateways, VPN, and dynamic routing, while configuring DNS and local area networks.
Create a virtual machine in cloud app dot net, set a dns name, choose an operating system image and hardware, select data center, attach a disk, and access from anywhere.
Create and manage virtual machine images from ready-made or custom disks to deploy machines efficiently. Monitor CPU, disk I/O, and network traffic while configuring autoscaling and availability sets.
Connect to a Windows Server VM via an RDP file, then attach a storage account to persist data and learn local vs geo redundant options.
Add a 500 GB disk to an Azure virtual machine, initialize and format it as the 500 GB F drive with NTFS, and compare cloud storage with physical disks.
Configure virtual networks and local area networks in Azure by defining private IP ranges, creating gateways, and establishing site-to-site VPN connections to link on-premises networks.
Create and configure a cloud virtual network, assign IP ranges and subnets, set optional DNS servers for on-premises resolution, and enable point-to-site or site-to-site connectivity.
Explore subnetting to create private network subnets for office locations like Bangalore, Ahmedabad, Chennai, and Noida, with defined IP ranges and gateways for cloud and on-premise connectivity.
Explore how a gateway assigns the router’s IP, configure subnets in a virtual Azure network, and allocate IP ranges for departments like HR and production.
Explore how to scale machines in a virtual network by managing IP address ranges, avoiding overlaps, and configuring local area networks, gateways, and corporate bridge settings.
Learn to create a SharePoint server in Azure by selecting an image, configuring authentication, cloud services, storage, and availability sets.
Explore how public and private ports enable external access to Azure virtual machines through endpoints, load balancing, and standard versus basic configurations for scalable, high-availability deployments.
Explore deploying and managing Azure web apps and web jobs via the portal, linking storage and databases, configuring scaling and backups, and monitoring traffic with traffic manager.
Learn to create and deploy a web app in Azure, choose hosting plans from free to standard, and configure autoscale and scaling by CPU for high availability.
Set up and scale a web site by configuring runtimes, 32/64 bit options, domain binding, authentication, deployment slots, and web jobs, with debugging and monitoring capabilities.
Deploy and manage Azure web apps and web jobs, configure scaling, link resources like SQL databases and storage, enable backups, monitoring, and Azure Traffic Manager.
Configure automated backup and export for your SQL database, set seven-day backups with 30-day retention, enable auditing, dynamic data masking, and geo-replication for secure, scalable web apps and web jobs.
Connect Azure to on-site networks by converting physical machines to virtual machines, configuring storage and internal networking, and deploying mobile and web apps via Azure mobile services and SQL databases.
Explore storage networking concepts, including local and geo redundant storage, raid levels, blob storage, and monitoring of read and write requests.
Learn how to configure and scale web jobs and web applications, back up data, manage application service plans, and monitoring of virtual machines and cloud services.
Learn provisioning a virtual machine and the difference between infrastructure as a service and platform as a service, with web, mobile services, and SQL database storage.
Learn to monitor a physical box in azure, tracking cpu, disk, and network metrics, review endpoints, ports, and load balancing, and compare basic and standard virtual machine sizes.
Create and connect virtual machines to a network; capture snapshots and images; manage Windows and Linux VMs with PowerShell cmdlets for Azure virtual machines.
Explore Azure Active Directory, its differences from on-premises Active Directory, and how to use directory sync, single sign-on, and custom domains to manage identities across cloud and on-premises.
Learn to use Azure AD reports for auditing sign-ins, license usage, anomalous activity, and external provisioning, and explore premium reports with mobility tools such as Intune and Azure Rights Management.
Discover StorSimple, an on-prem storage device that backs up unused data to cloud for availability, and learn to manage Azure blob storage with StorSimple manager and media services.
Assess on-premises readiness for migration to Azure by evaluating VM capacity, storage, and network usage; map toolkit discovery guides desktop and Office 365 readiness for cloud migration.
Explore Azure machine learning workflows with HDInsight clusters to perform sensor data and log analysis, build movie recommendations with Mahout, and manage data in Azure blob storage via studio.
Learn Azure content delivery network endpoints and propagation, with https and custom domains, then explore BizTalk services for cloud to on-premise enterprise integration with SAP, Oracle, and SQL Server.
Traffic Manager routes user traffic to similar cloud services across data centers using an intelligent DNS policy, while Azure automation uses runbooks and assets to automate backups, patches, and checks.
Create and run Azure automation runbooks to stop virtual machines on a schedule, manage jobs and backups, and explore HDInsight clusters for big data processing with Hive queries.
Explore Azure Cognitive Services and learn to provision, deploy, and use vision, speech, search, language, and knowledge features to build smart applications.
Create an Azure free account, verify email and phone, and access 12-month services such as virtual machines, sql database, blob storage, cosmos db, app service, anomaly detector, and custom vision.
Explore the vision API within Azure Cognitive Services, enabling computer vision analysis of images and videos with tags, descriptions, confidence scores, object detection, color metrics, and OCR-based data extraction.
Learn to create your first Azure cognitive service for computer vision, study REST APIs with Postman, and explore documentation, sample apps, and SDKs for C, Node.js, Python, Java, and Go.
Explore Microsoft Azure face API capabilities, including face detection, age, gender, emotions, and landmarks, then use face verification, grouping, identification, and similarity tools to manage and search image sets.
Explore Azure Custom Vision to train a tailored image classifier for your unique use cases, using your own images from different categories, training, testing, and deploying through Azure REST APIs.
Explore Azure cognitive service video indexing to extract metadata from audio and video for tagging and search, including spoken words and written text, plus video form recognizer and ink recognizer.
Perform a hands-on exercise with the Vision Indexer and Azure Video Indexer to upload media, index videos, and view insights like labels, scenes, captions, and searchable queries.
Launch the form recognizer in the Azure portal and create a free-trial service in East US. Use the 2.1 api with postman to analyze documents and extract text.
Explore how the speech to text service converts audio into transcripts for downstream processing. Leverage use cases like powering voice assistants, translation, and storing call center conversations for future investigation.
Learn to set up an Azure speech service and perform speech-to-text via rest api and Postman, authenticating with a key, sending wav audio, and extracting transcription.
Explore text to speech in Azure by converting text into lifelike voice files with dozens of voices and accents, and customize via xml in speech studio.
Access the Azure speech service in the portal, fetch authentication tokens, list voices in East US, and perform text-to-speech with an XML request for a 16kHz audio output.
Learn how azure speech translation converts speech to multiple languages using generic and custom translators, via sdks, with no rest api, and prepare for hands-on implementation.
Explore the speech recognition service to identify speakers and enable speaker ID with custom voices. Learn how REST API access requires Azure approvals and fill requests for educational use.
Explore Azure cognitive service language APIs to analyze sentiment, translate languages, understand natural language, recognize entities, and create efficient question-and-answer makers for apps.
Explore sentiment analysis using azure language services to extract sentiment, key phrases, language, and named entities, with hands-on practice in the language studio and REST APIs.
Discover the understanding service (also called Louis) that extracts content from text, trains customizable models, and deploys them via Luis portals to power voice assistants.
Define ml entities and phrase lists for a pizza order, assemble model objects and labeled examples, then train and publish the model for testing with a prediction.
Learn how to create and train a Luis application for a pizza ordering bot, configure keys and endpoints in West US, run a Python app, and publish via REST APIs.
Discover Azure cognitive service's entity recognition in the language service, identifying and categorizing entities in unstructured text such as people, places, organizations, quantities, date ranges, and events.
Develop a Java Spring Boot app that performs entity recognition using Azure AI Text Analytics, authenticates with key and endpoint, and prints entity details like category, subcategory, score, and offsets.
Create and deploy an Azure language service for entity recognition, retrieve keys and endpoints, and validate results from a Spring Boot application using Azure Cognitive Service.
Learn how to create and deploy a custom question answering service in the Azure portal, build a knowledge base from text, extract endpoints and keys, and test QnA responses.
Explore cognitive decision service and how it helps applications make quick decisions, focusing on content moderator, anomaly detector, and Personalizer.
Create an Azure cognitive moderator image moderation app in a spring boot project, configure JSON and Jackson dependencies, and implement evaluation data for image moderation, OCR, and face detection.
Learn to run an Azure cognitive service moderation pipeline, performing image and text moderation with ocr and face detection, and review stored outputs like emails and numbers.
Learn how anomaly detector monitors time series data to identify abnormalities, using stream mode for live data and batch mode for full datasets, with Azure-based security examples.
Build the first anomaly detector app in Python using a Jupyter notebook, import Azure AI anomaly detector, set up dependencies and subscription keys, and plot time series data with Bokeh.
Plot a time series graph with lower bounds, boundary colors, and labeled boundaries using a JSON data source to visualize anomalies against expected values. Future sessions cover normality detection.
Create an anomaly detection function for a time series using sample data, defining sensitivity, skip points, granularity, upper and lower margins to identify negative and positive anomalies.
Trigger the anomaly application to plot graphs from daily data, adjust skip points and sensitivity, and observe how anomalies are detected in the series.
Create a Python-based Azure Cognitive Services Personalizer app that suggests meals using ranked actions like pizza, pasta, ice cream, and salad, driven by time of day and nutrition.
In the azure mastery course, this lecture builds a decision personalizer application that collects user meal preferences, handles input errors, generates an event id, and ranks actions with context.
See how the Azure Personalizer service uses user inputs and nutrition facts to generate tailored recommendations, such as a salad based on meal choices, and guide advertisement and article suggestions.
Explore cognitive web search services in Azure by leveraging Bing through a RESTful API to bring the power of the search engine into your applications.
Discover cognitive web search services, such as web search, spell check, auto suggestion, image and video search, entity and visual search, with market, region, safe search, and data freshness controls.
Continue building a cognitive websearch app by creating a search results class, parsing and pretty-printing JSON responses, cleaning code, handling exceptions, and iterating headers to display results.
Resolve application issues by building a rest template to call a q&a service, manage Maven dependencies and Spring Boot setup, and test with Postman on localhost 8080.
Develop and test a Java chat bot by training QnA models from a knowledge base, publishing services, and validating responses with Spring Boot and Postman.
Learn to clean up your Azure setup by deleting knowledge bases, resource groups, and services to avoid charges, and verify the application status with no services running.
Explore cloud computing fundamentals and Microsoft Azure, learn cloud types, access options, and an overview of Azure services. It prepares you for more advanced certification topics.
Trace the history of cloud computing from its AWS origins to Azure's beta and general availability, highlighting milestones like S3, EC2, and Google App Engine.
Explain the three cloud service models—IaaS, PaaS, and SaaS—along with on-premises versus cloud deployment and the shift from capital expenditure to operational expenditure, with examples like Office 365 and Gmail.
Understand why Microsoft Azure stands out among public clouds by comparing Gartner magic quadrants, Azure's enterprise focus, and AWS leadership in cloud computing.
Explore the evolution from Azure service management (ASM) to Azure Resource Manager (ARM), and learn how resource groups, JSON templates, tags, REST API, and RBAC simplify deployments.
Register for a free Azure account to access $200 in credits, verify your Microsoft account, phone, and credit card, and practice Azure demos hands-on.
Log in to the Azure portal, explore the ARM and ASM portals, navigate the dashboard, services, subscriptions, and billing, and learn quick access with favorites and Cloud Shell.
Explore the classic ASM portal, compare it with the ARM portal, manage subscriptions and credits, and grasp RBAC changes and the move to ARM architecture.
Install the Azure CLI on Windows using the web-based platform installer after Azure PowerShell, and explore the cross-platform command line tools available via the web platform installer.
Learn to use the Azure CLI from command prompt or PowerShell, prefixing commands with Azure, log in, manage subscriptions, and switch the current subscription before deployment.
Explore Azure PowerShell, navigate ASM and ARM modules, log in and manage subscriptions, and run account and subscription commands to switch default subscriptions.
Learn to use Azure PowerShell with the ARM module, including logging in with Add Azure account, logging in to the ARM module, and running Get Azure ARM subscription.
Discover Azure virtual machines as an infrastructure as a service offering, configure Windows and Linux VMs, and use Azure CLI and PowerShell to manage subscriptions, connect, and attach disks.
Azure virtual machines provide infrastructure as a service, with Microsoft managing the underlying infrastructure, offering Linux, Windows, Oracle, IBM, and SAP options, scalable across data centers, pay as you go.
Learn Azure virtual machines and their three states—running, stopped, and stopped and deallocated—and how each state influences compute and storage billing.
Azure virtual machines are billed per minute, including the operating system, while you pay licensing for any third-party software you install; Windows VMs tend to cost more.
Explain azure vm deployment options by contrasting arm (resource manager) and asm (classic), and show how portal.azure.com supports both as Microsoft shifts to resource manager.
Examine Azure VM pricing tiers, compare basic and standard sizes across D series and DS series, and learn data disks, IOPs, load balancing, auto scaling, and premium SSD options.
Connect to a Linux virtual machine via SSH from Windows using PuTTY, log in as the user, and inspect the Ubuntu 16.04 LTS server disks with fdisk.
Attach a data disk to a Linux VM, verify disks via SSH, identify /dev/sda1 and /dev/sdc, create a 10 GB primary partition with fdisk, and detach when finished.
Discover how to achieve 24/7 Azure VM availability by using availability sets across fault and update domains, with two or more instances and a 99.95% sla for internet facing roles.
Learn how availability sets provide fault and update domain separation for web and SQL servers, ensuring uptime with load balancers and traffic manager across single and multi-region deployments.
Choose a non overlapping private IP prefix for your Azure virtual network. Assign the first VM the next available address after reserving five for network, DNS, and DHCP.
Master network security groups to segment networks, enforce inbound and outbound rules by allow or deny, and associate with subnets or virtual machines within a virtual network.
Learn how Azure load balancers distribute internet traffic across web servers, application servers, and SQL servers, using internet facing and internal types to support scalable, multi-tier architectures and availability sets.
Plan and implement multi-tier Azure architectures using Traffic Manager for cross-region routing, internet facing and internal load balancers, and Application Gateway for URL based routing to web and database servers.
Create a virtual network with the resource manager, set the address space, East US region, resource group, and DNS service, then add subnets 10.1.0.0/24 and 10.2.0.0/24.
Create a VNet and subnet, configure a network security group with inbound RDP and HTTP rules, then deploy a Windows VM and install IIS.
Explore how Azure Table Storage provides a scalable NoSQL key-value store for semi-structured data with a flexible schema. Access is fast and consistent across updates, supporting enterprise-scale applications.
Azure queue storage provides a simple, cost-effective queuing service that buffers and stores messages between applications until the receiver is ready, enabling resilience and elastic scaling under heavy load.
Create a general-purpose storage account and use blobs and containers, with files, tables, and queues; follow naming conventions and choose replication options like LRS, ZRS, GRS, or RA-GRS.
Azure Data Lake combines data lake store and data lake analytics, offering U-SQL, Spark, and Hive analytics, and stores unstructured, semi-structured, and structured data.
Log in to portal.azure.com, create a resource group for this project, and set up a data lake analytics account linked to a data lake store in East US 2.
Navigate Azure data lake services by accessing the Data Lake Analytics and Data Lake Store, explore data with Data Explorer, and use the u-sql catalog to manage databases, tables, and views.
Upload a sample space-separated file to the data lake store, place it in a vendor folder, and skip header rows marked with hash while mapping date, vendor, customer, and amount.
Explore the four stages of a u-sql job in azure data lake analytics: preparing, queuing, running, and done, including compilation, resource-based queuing, and possible failures at each stage.
Apply schema on read to map a space-separated row into date, salesman, customer, and amount using dotnet data types, contrasting with schema on write in data lake workflows.
Create and manage a database in the u-sql catalog inside azure data lake analytics, transforming data with tables, views, and stored procedures for better performance in data lake store.
Explore data distribution strategies—range, hash, direct hash, and round robin—and learn how to apply hash-based distribution on a column, and manage tables and schemas in the Azure data lake catalog.
Learn to insert data into the sales by month table in a data lake, compare data lake querying with SQL, and run an insert into select workflow from text files.
Name and manage data jobs, create tables, and implement a two-step process to query data and export to CSV in outputs folder, linking data lake store with the SQL catalog.
Explore creating and querying a table valued function (tvf) with parameters year and day set to 2010 and 01, using a view as data source and debugging common errors.
Create a store procedure to extract date, salesman, customer, and amount from a file and insert the data into the sales by month table; then debug common syntax errors.
Run a stored procedure to append data from the data lake into a sql table, resolving caps lock and semicolon errors, and verify results by querying sales by month table.
Learn to use inline C# functions in U-SQL scripts, filtering with string contains in the where clause, and exporting results to CSV.
Move from the Azure portal to Visual Studio to submit, track, and monitor jobs using the Azure .NET SDK and Azure Data Lake and Stream Analytics tools.
Install Visual Studio, the .NET SDK, and Azure Data Lake tools to create a U-SQL project and work entirely within Visual Studio, exploring Solution Explorer and Cloud Explorer.
Navigate and manage data lake store and data lake analytics in your Azure account, preview files, explore databases and jobs, and review resources and diagnostics to optimize data processing.
Submit a u sql job from Visual Studio, implement a code-behind function to apply a 15% discount, and output two columns to csv while monitoring the job in Azure portal.
Create a separate U-sql class library project to host a custom function, deploy it to Azure, and reuse it across multiple jobs via the deployed assembly.
Use the Azure Data Lake job comparison tool to compare similar jobs with different analytic units, assess time and cost differences, and filter by author or name for optimization.
Uncover how an SQL engine builds a job graph by breaking a job into vertices and stages, then executes parallel vertices as super vertices to optimize extraction, aggregation, and output.
Explore how a job is partitioned into stages and vertices, enabling parallel reading and processing with analytic units, while advancing through stages via a critical path.
Learn how a submitted job is executed by a SQL engine that breaks tasks into stages and vertices, with input and output data, read/write counts, and status colors illustrating progress.
Use a heat map to identify bottlenecks across stages by color-coded read, write, and compute time, highlighting slow stages. Visual Studio provides richer legends and throughput metrics beyond Azure portal.
Explore the concept of job efficiency, examining degree of parallelism and analytic units to identify under allocation, over allocation, and how iterative graphs guide optimal resource use.
Compare Azure Data Lake, Data Lake Store, and data lake analytics access methods beyond the portal and Visual Studio using Azure PowerShell and Azure CLI, highlighting cross-platform capabilities and trade-offs.
Create a root directory and a sales folder in the Azure Data Lake Store, verify via Data Explorer and PowerShell by listing child items at the root.
Learn to use azure cli 2.0 to manage data lake store and data lake analytics, log in with az and device login, and create a resource group.
Create and organize an Azure Data Lake Store account using az data lake store commands, set the resource group, ensure lowercase naming, and build a folder structure for data uploads.
Learn how data lake store and analytics work with U-sql to run jobs, build a data lake catalog of databases and tables, and monitor with Azure CLI and Visual Studio.
Create a copy wizard in Azure Data Factory to move data from blob storage to Azure SQL database, setting up source and destination and deploying an ADF instance.
Create and manage a free subscription by building a new resource group, deploying storage accounts, and using automation templates to replicate environments, while exploring Azure Storage Explorer for local access.
Create a blob service in an Azure storage account and learn replication options, including read access geo redundant storage, and container access levels: private, blob, or container.
Explore Azure blob storage properties, including block blob, append blob, and page blob, their sizes and use cases, plus the entity tag (eTag) caching mechanism for web resources.
Learn how to create an Azure Data Factory in Microsoft Azure, upload a sample csv to blob storage, and navigate the deployment and basic setup steps.
Create a copy data activity in Azure Data Factory to move data from blob storage to SQL Server Testdb using a copy pipeline with source, destination, and scheduling options.
Learn to configure an Azure Data Factory copy activity moving data from blob storage to a SQL Azure table, with schema mapping, upsert, and fault-tolerant settings.
learn how to author and deploy azure data factory pipelines, moving data from blob storage to azure sql database using data sets, linked services, and pipelines.
Create and deploy azure data factory datasets for blob storage and azure sql, linking them to the services, then build a copy pipeline to move data from source to target.
Identify and fix a failed pipeline by examining the error, adjusting the source dataset and blob path, redeploying, and re-running to confirm the pipeline succeeds.
Learn to schedule data ingestion with Azure Data Factory by scanning daily folders in a year-month-day hierarchy and moving data to a destination using pipelines.
Azure Data Factory scheduling monitors daily blob storage groceries files and loads them into a SQL table, capturing name, category, and price with an identity column.
Understand the scheduling architecture for daily data slices in blob storage processed by ADF. Learn how oldest first versus newest first and retrospective processing handle validation and data availability.
Pause or stop a failing Azure Data Factory pipeline, fix issues in the underlying data source, and resume execution using the monitoring and manage tools.
Create Azure data lake analytics and data lake store, linking to blob storage and SQL Azure, while configuring pay as you go pricing and encryption.
Upload a grocery sales data set to blob storage, extract with a space-delimited sql script, aggregate by date, and output a summary csv for the target sql table.
Define and reuse three data sets to move data from Azure blob storage through Azure Data Lake Store to SQL Azure, via Azure Data Factory transformations and a SQL job.
Diagnose a missing input error in a data pipeline, fix the json by adding the name, deploy, and verify the groceries pipeline runs green after removing the small data validation.
Welcome to the Microsoft Azure Mastery Course, a comprehensive learning journey designed to equip you with the knowledge and skills needed to excel in the rapidly evolving field of cloud computing and data science. This course covers a wide array of topics, from foundational principles to advanced applications, ensuring a well-rounded understanding of Microsoft Azure's extensive capabilities.
Microsoft Azure is one of the leading cloud platforms, offering a vast range of services that support various business needs, including data storage, machine learning, AI, and database management. With the increasing demand for cloud-based solutions, proficiency in Azure has become a valuable asset for IT professionals, data scientists, and developers.
Our course is structured into distinct sections, each focusing on a specific aspect of Azure. You will start with an introduction to Azure's data science capabilities and progress through foundational AI concepts, data fundamentals, and relational database management. Practical sections on cognitive services and AI-based chatbot creation will enhance your hands-on experience, while sections on Azure essentials and data lake management will solidify your foundational knowledge.
Whether you are preparing for Microsoft certification exams or seeking to expand your practical skills, this course offers a blend of theoretical knowledge and practical application. You will engage with interactive lessons, real-world scenarios, and step-by-step guides, ensuring a robust learning experience.
By the end of this course, you will be well-prepared to leverage Microsoft Azure's powerful tools and services, ready to tackle complex challenges and drive innovation in your organization. Welcome to your journey towards Azure mastery!
Section 1: DP-100 Microsoft Azure Data Science Exam
In this section, you will gain comprehensive knowledge and hands-on experience with Microsoft Azure's data science capabilities. Starting with an introduction to the course and exam requirements, you will learn how to create and manage an Azure Machine Learning workspace, including its settings through the portal and Azure ML Studio. The section covers the creation and management of datasets, compute instances, and clusters, and takes you through building and submitting machine learning pipelines. You'll delve into custom code, error handling, and understanding complex pipelines, ensuring a thorough grasp of Azure ML Designer and SDK setup. The section also introduces AutoML, model registration, deployment strategies, and production compute targets, preparing you for real-world applications of Azure's machine learning tools.
Section 2: AI-900 MS Azure AI Fundamentals
This section is designed to provide a foundational understanding of artificial intelligence (AI) and its applications within Microsoft Azure. Beginning with an introduction to AI and the AI-900 exam requirements, you will explore common AI workloads, responsible AI principles, and privacy and security considerations. The section covers various machine learning types, dataset features, and the training and validation process. You'll gain practical experience with AutoML, machine learning designer tools, and common computer vision and natural language processing (NLP) workloads, using Azure's services to build and deploy models without extensive coding. This section is perfect for those new to AI and seeking to understand its fundamentals and applications.
Section 3: DP-900 Azure Data Fundamentals
Section 3 focuses on the basics of data representation, storage options, and data workloads within Azure. You'll start with an introduction to the DP-900 exam requirements, followed by an exploration of relational and non-relational databases, including normalization, SQL, and NoSQL databases. Practical demos will guide you through creating databases, views, stored procedures, and indexes, as well as deploying and managing Azure SQL and Cosmos DB. This section also covers modern data warehousing, Azure Data Factory, and data visualization tools like Power BI, providing a comprehensive overview of Azure's data services and their practical applications.
Section 4: DP-300 Azure Relational DBA
This section prepares you for managing relational databases in Azure. After an introduction and overview of the DP-300 exam requirements, you'll learn about Azure's SQL database options, creating and managing Azure VMs, and deploying SQL servers. Topics include functional and scaling requirements, availability and backup strategies, and security measures for SQL databases. You will explore scaling techniques, SQL database replicas, sharding, and data synchronization. The section also covers migration and upgrade strategies, ensuring you are well-equipped to handle Azure SQL database management and optimization.
Section 5: Microsoft Azure - Basics
In Section 5, you will explore the fundamentals of Microsoft Azure and cloud computing. Starting with an overview of cloud computing principles and the history of Azure, you'll learn about key cloud services, deployment models, and the architecture of Microsoft Azure. The section covers account registration, the Azure portal, and various tools for managing Azure services, including PowerShell and CLI. You will gain practical knowledge of Azure virtual machines, storage options, and networking configurations, preparing you to leverage Azure's capabilities for various cloud-based applications and services.
Section 6: Azure Practical - Cognitive Services
Section 6 provides an in-depth look at Azure's cognitive services, focusing on practical applications. You'll begin with an introduction to Azure Cognitive Services and the creation of a free tier account. The section covers vision APIs, computer vision, face API, custom vision, form recognizer, and video indexer, with hands-on exercises for each service. You'll also explore speech APIs, including speech-to-text, text-to-speech, and translation services. Additionally, the section covers language services, sentiment analysis, entity recognition, and the QnA Maker, providing a comprehensive understanding of how to implement cognitive services in real-world scenarios.
Section 7: Azure Cognitive Services - Creating an AI-Based Chatbot
In this section, you will learn how to create an AI-based chatbot using Azure Cognitive Services. Starting with an introduction to the course, you'll explore the QnA service, Java application creation, and resolving issues within the application. The section provides practical steps for running and deploying the chatbot application, ensuring you have the skills to develop and manage AI-based chatbots effectively.
Section 8: Microsoft Azure - Essentials
Section 8 covers the essential principles and services of Microsoft Azure. Beginning with an introduction to Azure essentials, you will learn about the five principles of cloud computing, the history of cloud computing, and key types of cloud services. The section also covers cloud deployment models, Azure's architecture, and account registration. Practical demos will guide you through the Azure Resource Manager (ARM) and Azure Service Manager (ASM) portals, subscription management, and the installation and usage of Azure PowerShell and CLI. This section provides a solid foundation for understanding and utilizing Microsoft Azure's core services.
Section 9: Microsoft Azure - Data Lake
The final section focuses on Azure Data Lake, offering an introduction and overview of its components and services. You will learn how to create analytics accounts, process data within the Data Lake Store, and use the USQL language for data manipulation. The section covers defining analytics units, job stages, data ingestion, and processing multiple files. You'll also explore Azure Data Lake's integration with Visual Studio, monitoring and analyzing jobs, and using PowerShell and CLI for data management. The section concludes with a summary of Azure Data Lake's pricing and capabilities, equipping you with the knowledge to leverage this powerful data storage and processing solution.
Conclusion
By the end of this comprehensive course, you will have a deep understanding of Microsoft Azure's data science, AI, data fundamentals, relational database management, cognitive services, and cloud computing basics. Each section provides practical knowledge and hands-on experience, preparing you for various Azure certification exams and real-world applications of Azure's services. Whether you are a beginner or an experienced professional, this course will enhance your skills and help you leverage Azure's capabilities to their fullest potential.