
An overview of our course
Something about us … the BIG DATA TRUNK
How we use to work with big Data before the introduction of Spark
How the Big data world drastically changed after the introduction of Spark
An Introduction to APACHE SPARK
Introduction to Spark RDD
Brief Discussion about Spark Architecture
Types of Operations done on Spark RDD. We will mainly discuss about Transformation and actions. We will also discuss few sample codes to illustrate in a better way.
An introduction to Azure Databricks
Here in video we will briefly discuss why we need Azure Databricks even if we have Apache Spark
We will provision Azure Databricks cluster and also we will learn to create a cluster in Azure Databricks
We will learn how we can use notebook in databricks and how it can be associated to any Cluster in Databricks
We will use Jupiter notebook to run queries on set of external data. Also we will learn to use SQL & Panda queries in notebook.
After that we will learn to plot different types of charts
We will Develop a word count program. Also we will run this program on set of external data by removing special characters from the dataset.
In this video we will cover Databricks runtime Machine learning. We will use Binay Composition and decision tree model to train our Model
We will work on Streaming data from the twitter. We will use Azure eventHub for reading the Twits from Twitter.
How the Spark can be optimized to perform more efficiently and effectively.
In this course you will learn the basics of creating Spark jobs, loading data, and working with data. You’ll also get an introduction to running machine learning algorithms and working with streaming data. Databricks lets you start writing Spark queries instantly so you can focus on your data problems.
Azure Databricks accelerate big data analytics and artificial intelligence (AI) solutions, a fast, easy and collaborative Apache Spark–based analytics service.
Why Azure Databricks?
Productive : Launch your new Apache Spark environment in minutes.
Scalable : Globally scale your analytics and machine learning projects.
Trusted : Help protect your data and business with Azure AD integration, role-based controls and enterprise-grade SLAs.
Flexible : Build machine learning and AI solutions with your choice of language and deep learning frameworks.
We believe that when you learn something, you should be able to apply it somewhere. So, in this course, we are also providing you with some of the important spark interview questions , which will help you to crack the interview with flying colors.
We believe that when you learn something, you should be able to apply it somewhere. So, in this course, we are also providing you with some of the important spark interview questions , which will help you to crack the interview with flying colors.