
This video will give you an overview about the course.
You will be able to learn about Flink architecture and its components.
• Define Apache Flink
• Explore Flink architecture
• Learn about the components of the Flink framework
The aim of this video is to help you understand Big Data conceptually and also the importance of Big Data Analytics.
• Learn what Big Data is
• Explore the seven Vs of Big Data
• Explore Big Data Analytics
In this video, you will learn how to install Flink in your local system.
• Download and Install Flink
• Start a cluster and shell
• Open cluster UI
In this video, you will learn how to setup Flink in AWS.
• Create EC2 instance running Linux
• Download Flink
• Install Flink and start the cluster
This video will give you a brief overview of the Cluster UI.
• Launch the UI
• Navigate the UI
• Explore the job status
This video will introduce the various concepts behind the Flink programming model.
• Explore the Flink programming model
• Learn the different levels of abstraction
• Explore various programs and dataflows
The aim of this video is to help you understand the inner working of datasets.
• Explore a dataset
• See the inner working of a dataset
• Explore the features of datasets
The aim of this video is to help you understand the inner working of data streams.
• Learn what a data stream is
• See the inner working of a data stream
• Explore the features of data streams
This video will give you an overview of loading and saving datasets.
• Learn about loading data into a dataset
• See the basic operations on datasets
• Save the dataset to disk
This video covers the basic transformations on datasets.
• Explore Count, First, and Map features
• See FlatMap, MapPartition, and Filter
The aim of this video is to help you understand dataset transformations.
• Explore distinct, minBy, maxBy
• Learn about Union and Rebalance
In this video, you will learn the different partitioning strategies.
• Explore Hash partitioning
• Explore Range and Sort partitioning
• Learn about Custom partitioning
This video will give hands on knowledge of aggregations.
• Explore GroupBy, Aggregation
• Explore Reduce, ReduceGroup
• Learn about CoGroup
You will be able to learn about different types of Joins.
• Learn about Inner Joins
• Explore Outer Joins
• Go through Anti Join, Semi Join, and Cross Join
This video will give you an understanding of how to bring in data into the data streams.
• Explore Socket based streaming
• Explore File based streaming
• Explore Kafka based streaming
You will be able to learn about Data Stream transformations.
• Explore Filter, Map, and Flatmap
• Explore Aggregations
• Learn about partitioning, rescale, and rebalance features
The aim of this video is to help you understand window operations on data streams.
• Explore Tumbling windows
• Explore Sliding windows
• Learn about Session windows
This video will give you an understanding of watermarks and time characteristics.
• Explore watermarks
• Get to know Event time, Ingestion time, and Processing time
You will be able to learn about state management and checkpointing.
• Explore state
• Explore checkpointing
The aim of this video is to help you understand sinks and joins of data streams.
• Explore sinks
• Learn about the Tumbling window join
• Explore Sliding window join and Session window join
Have you heard of Apache Flink, but don't know how to use it to get on top of big data? Have you used Flink, but want to learn how to set it up and use it properly? Either way, this course is for you.
This course first introduces Flink concepts and terminology, and then moves on to building a Flink instance, collecting data, and using that data to generate output that can be used as processed data input into other systems. You will also use the Flink APIs to process data in batch and streaming modes.
By the end of the course, you will be capable of using the Apache Flink ecosystem to achieve complex tasks such as event processing and machine learning.
About the Author
Sridhar Alla is the co-founder and CTO of Blue Whale Consulting and is expert at helping companies (big and small) define their vision for systems and capabilities that will allow them to establish a strategic execution plan to deal with the ever-growing data collected to support analytics and product teams. He has very experienced at dealing with all aspects of data collection, security, governance, and processing as part of end-to-end big data analytics and machine learning initiatives (including predictive modeling, deep learning, and ML automation).
Sridhar is a published book author and an avid presenter at numerous conferences, including Strata, Hadoop World, and Spark Summit. He also has several patents filed with the US PTO on large-scale computing and distributed systems.
He has over 18 years' experience writing code in Scala, Java, C, C++, Python, R, and Go, and has extensive hands-on knowledge of Spark, Flink, TensorFlow, Keras, Hadoop, Cassandra, HBase, MongoDB, Riak, Redis, Zeppelin, Mesos, Docker, Kafka, ElasticSearch, Solr, H2O, machine learning, text analytics, distributed computing, and high-performance computing.
Sridhar lives with his wife and daughter in New Jersey and in his spare time loves blogging and coaching organizations on next-generation advancements in technology and their alignment with business goals.