
Explore the architecture of Azure Data Factory, linking data sources via linked services, and orchestrate pipelines of activities with datasets to enable data movement and migration.
Create a free subscription and a resource group, learn automation templates to deploy Azure resources across environments, and explore storage accounts with blobs, files, queues, and tables using Storage Explorer.
Create a sql azure schema that mirrors a csv file by using a create table statement or the online query editor, then deploy via Visual Studio with sql server authentication.
Learn to create a copy activity in Azure Data Factory to copy data from blob storage to SQL, configuring source and destination, linked services, and schema preview.
Create a blob storage and Azure SQL data sets linked to their services. Build a copy pipeline that uses source and destination datasets to move data.
Explore scheduling daily data ingestion with Azure Data Factory, handling year-month-day folders, and setting up linked services, datasets, and pipelines for repeatable ETL through copy activities.
Upload groceries data to Azure blob via a linked service, then set up source and destination data sets in Azure Data Factory and validate the upload in the portal.
Monitor and manage Azure Data Factory pipelines by inspecting consumed and produced datasets, slices, and validation states to ensure data readiness and troubleshoot missing blobs.
Explore the architecture of scheduling in Azure Data Factory, including slices, data sets, and blob storage, and how execution policies like oldest first or newest first govern retrospective processing.
See how Azure Data Factory pipelines use partition by and the slice start runtime to build dynamic folder paths from year, month, and day.
Explore how to analyze an Azure Data Factory pipeline using the diagram view to visualize activities, inputs, and outputs, and learn to use show lineage for focused data flow.
Learn to recover a failed data slice by manually uploading the relevant files to Azure blob storage, triggering a re-run, and verifying results via SQL counts, addressing browser cache issues.
Create and configure Azure Data Lake Analytics and Data Lake Store. Use U-sql, Yarn, and Hiveql to run big data jobs with encryption and pay-as-you-go pricing.
Explore data lake analytics and data lake store, focusing on the new job option and data explorer, writing SQL code to Azure Data Factory, and preparing for blob storage uploads.
Shows creating grocery sales data set, uploading to blob storage, using a u sql script to parse space-delimited records, aggregate by date, and store summary in sql and data lake.
Explore web app attributes in Azure App Service, including overview, resource group, url, pricing tier, activity log, access control, and tags, then configure scaling and deployment sources.
Validate the IDE–Azure connection, publish the mobile app service, and verify backend running; explore creating a storage account, connecting to Azure storage and SQL, and replication options.
Learn how to provision an Azure SQL database as a service, creating a server and database within Azure, and configure credentials, firewall settings, and the Adventureworks sample.
Build a dotnet core web app with a SQL database using entity framework core code-first, then deploy both to Azure as app service and SQL server using Git deployment.
Create and configure an Azure resource group with location metadata, then provision a SQL server under that group, set admin credentials, and note the master database that comes with it.
Configure and deploy a dotnet core app to azure by setting ASP.NET Core environment to production, using SQL Server connection strings in Azure, and running database.migrate to create tables.
Push changes to the Azure remote to deploy the app on an Azure web app, and connect to the database via SQL Server Management Studio or Azure Portal.
Clone a dotnet core rest API from GitHub, enable CORS in Azure App Service, deploy with local git, and verify Swagger UI is accessible.
Enable frontend to backend data flow by replacing in-memory data with remote API calls, then configure App Service authentication and Azure Active Directory to issue access tokens for authorized requests.
Create and run a logic app that checks an rss feed on a minute schedule, uses dynamic content like title, date, and link in the body, and emails new items.
Learn to create and manage Azure virtual machines via portal, PowerShell, or Azure CLI, configure Windows Server 2016, use RDP to install IIS, compare resource manager and classic deployment models.
Compare memory optimized, compute optimized, general purpose, storage optimized, and GPU optimized VMs, then consider availability zones and choosing the cheapest option where available.
Deploy a single Azure virtual machine, set up an availability set and managed disks for high availability, and review networking, extensions, and storage options.
Deploy an Azure VM, connect via RDP, install the IIS web server with PowerShell, and open port 80 in the network security group to access the web page.
Create a blob-triggered function in a function app (C#, function.json) that runs on blob add or update, connecting to storage via Azure Storage Explorer and noting latency differences.
Discover how to create a generic webhook to trigger an Azure function via http post, configure an activity log alert, and test by creating a resource group.
Learn to publish messages to an Azure storage queue using an http-triggered Azure function with an output binding, sending query string data to the out queue.
Create and route custom events using Azure Event Grid by setting up a custom topic, subscribing to it with an Azure function endpoint, and triggering events to log data.
Learn to create and route a custom event to an Azure Event Grid topic with PowerShell, building the event body and validating data reaches subscribers and the event handler.
Learn to configure Azure AD authentication for web apps, register apps, manage permissions and keys, enable organizational accounts, and integrate OpenID Connect and multi-factor authentication.
Configure Azure web jobs by updating web.config with local db and storage connection strings, create a storage account, and copy its keys and connection string into the app.
Explore programmatic access to Azure storage blobs from your application using REST APIs and the Storage Client Library, including container setup and blob operations in a console app.
Learn to program against Azure Table NoSQL storage using cloud table client and table entity, with partition key and row key, including insert and batch operations.
Explore Azure storage concepts, including tables, queues, and blobs, learn to handle conflicts and exceptions in batch operations, and map web apps, webjobs, and Azure SQL for cloud deployment.
Learn to migrate a local web app from IIS and ASP.NET to Azure App Service using the migration assistant, including publishing settings, publish profiles, and site mapping.
Learn to migrate a local MySQL database to Azure SQL Database using Data Migration Assistant, performing compatibility assessment, generating migration scripts, and completing the PaaS deployment via the Azure portal.
Learn to migrate dotnet web forms and mvc apps from on-premises to Azure PaaS, moving data to Azure SQL and deploying app service plans for scalable web apps.
Leverage the migration readiness report and readiness assessment to validate checks for migrating the employee query form, including port bindings and app service deployment steps with publish settings.
Migrate an MVC application to Azure web app by moving the database to Azure SQL with the Data Migration Assistant, deploy to an app service tier, and validate the configuration.
Migrate content and database for an mvc app from local to azure app service using app migration assistant and publish settings, updating the original site name and deploying to azurewebsites.net.
Course Introduction
Welcome to "Azure Advanced: Data Factory | PAAS | App Services | Application Migration." This comprehensive course is designed to equip you with advanced knowledge and practical skills to effectively utilize Microsoft Azure. Whether you're looking to deepen your understanding of Azure Data Factory, explore Platform as a Service (PAAS), manage Azure App Services, or master the nuances of migrating applications to Azure, this course covers it all. Through a blend of theoretical insights and hands-on exercises, you'll gain the expertise needed to excel in the dynamic field of cloud computing.
Section 1: Microsoft Azure - Data Factory
In this section, we delve into the essentials of Azure Data Factory. You'll start with an introduction to its capabilities and practical applications. From creating a Blob and setting up ADF in Microsoft Azure to managing pipelines and handling errors, you'll gain a comprehensive understanding of the data integration process. Key topics include creating schemas in SQL Azure, copy activities, and monitoring pipelines. By the end of this section, you’ll be proficient in setting up and managing data workflows in Azure.
Section 2: Microsoft Azure - PAAS Overview
This section offers a detailed overview of Platform as a Service (PAAS) in Microsoft Azure. You’ll learn about various Azure services, including Web Apps, mobile app deployment, Azure Storage, and SQL Databases. The section focuses on deploying web applications through Visual Studio, provisioning mobile apps, and managing Azure SQL databases. By understanding these core services, you'll be able to leverage PAAS for building and deploying scalable applications.
Section 3: Azure Practical - App Services
Here, we focus on the practical aspects of Azure App Services. Starting with an introduction to Azure App Service, you'll learn how to deploy websites, make changes, and redeploy them. The section covers key services such as Dot Net Core Web Apps, resource group creation, and database migration functions. You’ll also explore enabling CORS, deploying REST APIs, and implementing Azure CDN. This section equips you with the skills to manage and optimize Azure App Services effectively.
Section 4: Azure Practical - Developing Your Applications
This section is dedicated to developing applications on Azure. It begins with an introduction to Azure application development, including web app components and FTP deployment. You’ll learn about using Azure Active Directory, creating web jobs, and managing databases for applications. Practical examples and step-by-step guidance help you understand how to develop, deploy, and manage applications in Azure, ensuring you can handle real-world scenarios with confidence.
Section 5: Azure Practical - Website and Database Migration to Azure Platform
In this section, you’ll learn about migrating websites and databases to the Azure platform. Topics include moving local web apps, using migration tools, and configuring Azure SQL databases. The section guides you through connecting to Azure SQL servers and optimizing performance. By the end, you'll have a solid understanding of the migration process, from initial setup to final implementation, ensuring a smooth transition of your applications to the cloud.
Section 6: Azure Practical - Migrating .NET-based Web Applications to Azure PAAS
The final section focuses on migrating .NET-based web applications to Azure PAAS. You’ll explore the steps involved in migrating web applications, connecting to Azure databases, and generating SQL scripts for migration. Detailed tutorials on MVC application migration, content and database transfer, and testing configurations provide a complete guide to the migration process. This section ensures you can seamlessly migrate and manage .NET applications in the Azure environment.
Conclusion
"Azure Advanced: Data Factory | PAAS | App Services | Application Migration" is designed to provide you with in-depth knowledge and hands-on experience in using Microsoft Azure. Each section builds on the previous one, ensuring a comprehensive learning experience. By the end of this course, you’ll have the skills and confidence to manage complex Azure environments, develop robust applications, and execute seamless migrations, positioning you for success in the ever-evolving world of cloud computing.