Azure Stream Analytics - End-to-End Analytics Solutions!
3.0 (7 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
55 students enrolled

Azure Stream Analytics - End-to-End Analytics Solutions!

Understand the development aspects of Azure Stream analytics to build end-to-end, real-time event processing solutions!
3.0 (7 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
55 students enrolled
Created by Packt Publishing
Last updated 11/2018
English
English [Auto-generated]
Current price: $139.99 Original price: $199.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 6.5 hours on-demand video
  • 1 downloadable resource
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • Develop real-time event processing with Azure streaming.
  • Integrate BI and enhance features in Azure Stream Analytics.
  • Design and manage Stream Analytics jobs.
  • Build end to end social media analytics solutions with Azure Stream Analytics.
  • Build end-to-end real-time IoT solutions using Azure Stream Analytics.
  • Implement real-time fraud detection using Azure Stream Analytics with Cortana
Course content
Expand all 39 lectures 06:31:25
+ Real-time Data Processing with Azure Stream Analytics
19 lectures 03:04:11

This video provides an overview of the entire course. 

Preview 05:17

This video gives us introductory analysis to real-time event processing with Azure data platform.

  • Step by step guidance on traditional Analytics 

  • Shifting to a Streaming data solution

  • Complement existing analytics with streaming and description of scenarios of real-time analytics

 

Real-time Data Processing with Azure
08:36

In this video, we will be introduced to Azure Stream Analytics.

  • Understand Microsoft Azure real-time Analytics solution layers

  • Explore the benefits and learn from the demo on provisioning Streaming Analytics with Azure portal

  • Understand development tools analysis for Stream Analytics jobs

Introduction to Azure Stream Analytics
13:16

In this video, we will discuss integration of big data Lambda pattern with Azure Streaming.

  • Learn the basics of data analytics pipelines on Azure

  • Explore the Lambda architecture and Microsoft Azure

  • Understand the analysis of Lambda-batch processing vs interactive data processing

Integration of Big Data Lambda Architecture with Interactive Data Analysis
08:37

The aim of this video is to discuss the technical comparison between Apache Storm and Azure Streaming.

  • Explore Storm with Azure Streaming and learn the  differences of each platform

  • Know the data sources and outputs and authoring for each platform

  • Understand the advanced management and ops features

Exploring Apache Storm and Azure Streaming Analysis
07:09

In this video, we will discuss what are the tools required for Visual Studio for the creation of Azure Stream Analytics job.

  • Explore the steps involved in implementing Stream Analytics jobs using Tools for Visual Studio

  • Configure and deploy Stream Analytics job

  • Test Stream Analytics locally and test Stream Analytics job

Tools for Visual Studio for Creation of Azure Stream Analytics job
15:05

The aim of this video is to explain how to create stream analytics job using Azure portal.

  • Explore Microsoft data platform architecture

  • Understand the Benefits and watch the demo on  provisioning Streaming Analytics with Azure portal

  • Study the development structure of a Stream Analytics  job

Creating Azure Stream Analytics Job Using Azure Portal
07:38

In this video, we will learn the development steps of Azure Stream Analytics using resource manager.

  • Learn about the Azure Quickstart templates

  • Provision of Stream Analytics using ARM templates

  • Monitor Stream Analytics job using resource manager

Developing Azure Stream Analytics Job Using Azure Resource Manager Template
11:19

The aim of this video is to explain how to implement streaming job with various data input and output.

  • Explore various Stream Analytics data input types –  data stream and reference data

  • Configure various data input and output for Stream  Analytics job

  • Configure output data sinks with Azure Stream Analytics  job

Development of Streaming Job with Various Data Input and Output
09:46

This video discusses the lap around Stream Analytics – TSQL language reference.

  • Understand the TSQL built-in functions in brief

  • Explore data types in Azure Stream Analytics Query language

  • Learn the Query language elements in stream analytics  and event delivery guarantees

Lap Around Stream Analytics – TSQL Language Reference
12:26

This video gives us an idea about the common Query patterns in Streaming Analytics-TSQL.

  • Explore the Query examples for common stream analytics usage patterns

  • Understand the data type conversions

  • Learn various Query examples on ASA-SQL Query patterns

Learning Common Query Patterns in Streaming Analytics-TSQL
08:31

In this video, we will see how to build visual dashboard using Power BI as output data sink of streaming job.

  • Configure the Power BI output properties

  • Explore data type conversion from ASA to Power BI

  • Learn from the real life demo on implementation of real time analytics using Azure Streaming and Power BI

Process Streaming Data Through Azure Stream Analytics with Power BI
11:26

In this video, we will discuss what the Azure Stream Analytics Query language windowing functions are.

  • Get a basic understanding of window functions

  • Explore different types of Window functions such as Tumbling window, Hopping window and Sliding window

  • Learn from the Demo on each and every window functions

Application of Windowing Functions with Streaming Solution in Azure
11:07

In this video, we will explore reference data stream in Stream Analytics.

  • Explore how reference data stream is used as input to Stream Analytics

  • Configure reference data with Azure Streaming

  • Watch the demo on Azure blob storage and explore Stream Analytics job with reference data

Utilizing Reference Data with Streaming Analytics
07:16

In this video, we will implement output of stream analytics to Azure Data Lake Store.

  • Overview on Azure Data Lake Store output of Stream Analytics 

  • Authorize Azure Data Lake Store account and configure it

  • Configure ASA with Azure Data Lake Store

Implementing Output of Stream Analytics to Azure Data Lake Store
08:20

This video will help you to get Azure Stream Analytics job output with Azure function.

  • Overview of Azure architecture and explore Azure function using Redis cache

  • Explore the Azure functions

  • Watch and learn from a real life fraud detection demo on  implementation of Stream Analytics output with Azure function using  Redis cache

Connecting Output of Stream Analytics with Azure Functions
10:48

In this video, we will integrate JavaScript UDF with Stream Analytics.

  • Explore Stream Analytics and JavaScript type conversion

  • Add JavaScript UDF with Stream Analytics

  • Learn to call JavaScript UDF from Stream Analytics TSQL Query

JavaScript UDF Integration with Azure Stream Analytics -TSQL
06:14

This video will help you integrate Azure Machine Learning with Stream Analytics.

  • Overview on Azure Machine Learning concepts

  • Configure Stream Analytics job with Azure ML

  • Integrate Azure ML UDF with Stream Analytics integration

Utilizing Azure Machine Learning Integrated with Stream Analytics
08:11

In this video, we will explore .NET management SDK.

  • Learn to manage namespaces of setup and running Stream Analytics jobs using API

  • Explore setup project and  create Stream Analytics management client using API

  • Learn to create input and output transformation of jobs using REST API

Application of .NET Management SDK with Streaming Solution in Azure
13:09
+ Managing and Monitoring Streaming Solutions in Azure
20 lectures 03:27:14

This video provides an overview of the entire course. 

Preview 06:28

What is Job reliability of stream analytics job?           

  • Introduce job reliability model in stream analytics

  • Explore how do Azure Paired regions address job delivery

  • Learn about business continuity and disaster recovery with example of Azure paired regions

Stream Analytics Jobs Reliability
08:24

What is management and monitoring of stream analytics job?           

  • Monitor streaming job using C# program

  • Monitor stream analytics job using Azure PowerShell cmdlets

  • Watch a Demo on managing and monitoring stream analytics job using PowerShell commands automatically.

Monitoring Jobs Programmatically
19:21

What is managing scalability of stream analytics job for incrementing job throughput?           

  • Explore partitioning in stream analytics job input, output, and Streaming Units(SU)

  • Calculate and configure maximum Streaming unit of a streaming job

  • Measure throughput of stream analytics streaming units.

Scaling a Stream Analytics Job to Increase Throughput
13:26

In this video, will learn about troubleshooting of ASA jobs 

  • Introducing of stream analytics troubleshooting references

  • Explore atream analytics resource health blade

  • Learn about data-driven debugging using job diagram

Troubleshooting ASA Jobs
10:15

This video aims at exploring the basics of stream analytics monitoring           

  • Explore metrics for monitoring available for stream analytics

  • Customize monitoring in the Azure portal

  • Watch the demo on monitoring of stream analytics jobs.

Monitor ASA Jobs Through Azure Portal
10:18

This video will help you get acquainted with testing queries in Azure stream analytics jobs

  • Overview on stream analytics query testing analytics in Azure portal

  • Explore job input and query testing

  • Learn from the demo – Query testing with input and query

Testing Queries in Azure Streaming Analytics
11:36

In this video, we will learn the basics of usage of ‘SELECT INTO’ to check the data stream

  • Overview on reusing queries to use ‘SELECT INTO’ clause for debugging

  • Demo – Monitoring and use SELECT INTO clause in the query.

Debugging of Jobs Using 'SELECT INTO' Clause
10:13

This video aims at exploring the basics of Azure stream analytics event order handling

  • Late event arrival tolerance

  • Out of order tolerance

  • Demo on  event order handling

Azure Service Bus Event Order Handling
10:15

In this video, we will optimize Streaming Units

  • Overview on Azure Stream Analytics Unit(SU)

  • Choose number of SU required for ASA job

  • Explore high-memory causes for high SU usage for running jobs

Optimizing Streaming Units
11:15

Explore the stream analytics log types

  • Learn about diagnostics logs categories

  • Explore various diagnostic Log schema

  • Watch and learn from the Demo- Turn on diagnostic logs

Operationalize Stream Analytics Job Diagnostic Logs
13:39

In this video, we will study a scenario: Social media sentiment analysis in real-time solution architecture

  • Introduction to real-time Twitter sentiment analysis in Azure stream analytics

  • Explore the basics of social media analysis

  • Learn about the social architecture of social media Twitter sentiment analysis in real-time

Social Media Sentiment Analysis in Real-Time with Solution Architecture
05:54

This video will help you learn about the configuration of stream analytics job

  • Prerequisites for Twitter sentiment analysis

  • Demo- Configuration of stream analytics jobs

  • Demo- Configure and start the Twitter client app

Configuration of Stream Analytics Jobs
09:04

In this video, Visualize output for social media sentiment analysis           

  • Watch and learn from the Demo – Creation of sentiment analysis stream analytics job

  • Watch the Demo – Inspect real-time social sentiment analysis visualization with PowerBI

  • Learn about the social media sentiment analysis in detail

Visualize Output for Social Media Sentiment Analysis
09:26

In this video, we will learn about real-time traffic analysis  using Azure streaming analytics in IoT scenario: Toll booth with  solution architecture           

  • Explore the basics of real-time traffic analysis 

  • Get in-depth understanding of real-time traffic analysis with the help of toll booth scenario 

  • Explore solution architecture for the implementation of IoT  streaming with tollbooth  data using Azure Stream Analytics, Event Hub,  Azure SQL Database/Cosmos Db and so on

Real-Time Traffic Analysis in IoT Scenario with Solution Architecture
07:58

This video explores the basics Azure stream analytics event order handling

  • Explore prerequisites for the tollbooth IoT streaming data solution 

  • Watch the Demo – Define the environment set up for Azure stream analytics

  • Watch and learn from the Demo – Event generator app: TollData C# simulator project

Setting up Environment for Real-Time IoT Solution
08:17

The aim of this video is to learn about testing of Streaming  analytics queries to analyze vehicle traffic management and visualize  results

  • Watch and learn from the Demo – ASA job configuration with input, output, and analytical queries

  • Watch the demo on visualization 

  • Get in-depth understanding of visualization of results using RDBMS- Azure SQL Database/ NoSQL(Azure Cosmos Db)

Testing of Streaming Analytics Queries for Real-Time IoT Solution
12:39

Real-world fraud detection analytics using Cortana Intelligence Gallery Scenario

  • Learn the basics of telecommunication and SIM fraud detection in real time

  • Explore the solution architecture

  • Learn about the architecture for implementation of real-time fraud detection analytics

Real-World Fraud Detection Analytics with Azure Streaming Analytics
08:03

Implement real-time fraud detection using Azure stream analytics with Cortana Intelligence Gallery

  • Prerequisites for development of the fraud detection predictive analytics

  • Demo -Azure stream analytics job input – Event Hubs for ingestion of events

  • Demo – Configure and start of call Detail Records(CDR) using C# event generator simulator app

Provision of Azure Stream Analytics Job and its Input Connector
08:19

Start of ASA job for real-time event processing and view fraud detection analysis output

  • Demo – Configure and start of Call Detail Records(CDR) using C# event generator simulator app

  • Demo – Configuration of ASA query, output with real-time visualization using PowerBI

  • Demo – Configuration of ASA output sink using Blob storage, Azure functions and so on

Start of ASA job for Real-Time Event Processing and View Output
12:24
Test Your Knowledge
3 questions
Requirements
  • Some understanding of basic Machine Learning concepts will be helpful
Description

Microsoft Azure is a very popular cloud computing service used by many organizations around the world. Its latest analytics offering: Stream Analytics - allows you to process and acquire actionable insights from different kinds of data in real-time. If you are an analytics professional looking to get familiar with Microsoft’s Azure stream analytics, then this Course is perfect for you!

This comprehensive 2-in-1 course is concise and appropriate for evaluating deep aspects of building real-world data-centric and data processing with the Azure Data Platform! You’ll begin with implementing Azure's simple, declarative model to build real-time data transformations for processing IoT streams, real-time data analysis, and more! Understand the development aspects of Azure Stream analytics to build real-time event processing solutions. Finally, you’ll build end-to-end analytics solutions with Azure Stream Analysis!

By the end of the course, you’ll understand the development aspects of Azure Stream analytics to build end-to-end, real-time event processing solutions!

Contents and Overview

This training program includes 2 complete courses, carefully chosen to give you the most comprehensive training possible.

The first course, Real-time Data Processing with Azure Stream Analytics, covers real-time data processing with Azure Stream Analytics. This video is your guide to understanding the basics of how Azure Stream Analytics works, and then building your own analytics solution using its capabilities. You will start by learning what stream analytics is, and why it is a popular choice for acquiring real-time insights from data. Then you will be introduced to Azure Stream Analytics, and learn how you can use the tools and functions in Azure to develop your own Streaming Analytics. During the course of the video, you will build streaming solutions for the IoT, fraud detection, real-time event processing, and more. The video also shows you how you can manage, monitor, and scale your solution for optimal performance. By the end of this tutorial, you will have mastered using Azure Stream Analytics to develop an efficient analytics solution that can work with any type of data.

The second course, Managing and Monitoring Streaming Solutions in Azure, covers the development aspects of Azure Stream analytics to build real-time event processing solutions. This course will give you a good understanding of the development aspects of Azure Stream analytics to build real-time event processing solutions. The course mainly focuses on monitoring scaling aspects to increase throughput in your streaming jobs and supplies a varied troubleshooting guide for big data developers/architects. The course provides end-to-end demonstrations for solutions to real-world business problems related to Internet of Things and fraud detection scenarios with the help of Microsoft Cortana Intelligence Gallery.

By the end of the course, you’ll understand the development aspects of Azure Stream analytics to build end-to-end, real-time event processing solutions!

About the Authors

●  Anindita Basak is working as Big Data & Cloud Architect for one of Computer Software giant & working with Microsoft Azure for last 8+ years. She has worked with various teams of Microsoft as FTE in the role of Azure Development Support Engineer, Pro-Direct Delivery Manager, and Partner Technical Consultant. She has been technical reviewer for five books from Packt Publisher on Azure HDInsight, SQL Server Business Intelligence, and Hadoop Development & Smart Learning with Internet of Things & Decision Science. Recently, she authored two video courses on Azure Stream Analytics from Packt Publishing.

Who this course is for:
  • Big data developers, data analysts, data scientists, and Azure developers who are looking to get familiar with Microsoft’s Azure Stream Analytics and want to develop a real-time event processing solutions!