Introduction to Apache NiFi | Cloudera DataFlow - HDF 2.0
What you'll learn
- Install and configure Apache NiFi
- Design Apache NiFi Architecture
- Master core functionalities like FlowFile, FlowFile Processor, Connection, Flow Controller, Process Groups, etc.
- Use NiFi to stream Data between different systems at scale
- Monitor Apache NiFi
- Integrate NiFi with Apache Kafka
- Integration NiFi with MongoDB
Requirements
- Understand the basic concepts of big data and fast data technology to take this course
- Good to have knowledge about Linux command line
- Installing Java 8 for the Hands-On
Description
Apache NiFi (Cloudera DataFlows - ex Hortonworks DataFlow) is an innovative technology to build data flows and solve your streaming challenges?
In today's big data world, fast data is becoming increasingly important. Streaming data at scale and rapidly between all your systems should be centralised, automated and resilient to failure to ensure good delivery to your downstream systems.
With NiFi, you can build all your flows directly from a UI, no coding required, and at scale!
Apache NiFi initially used by the NSA so they could move data at scale and was then open sourced. Being such a hot technology, Onyara (the company behind it) was then acquired by Hortonworks, one of the main backers of the big data project Hadoop and then Hadoop Data Platform.
Apache NiFi is now used in many top organisations that want to harness the power of their fast data by sourcing and transferring information from and to their database and big data lakes. It is a key tool to learn for the analyst and data scientists alike. Its simplicity and drag and drop interface make it a breeze to use!
You can build streaming pipelines between Kafka and ElasticSearch, an FTP and MongoDB, and so much more! Your imagination is the limit
==============================
Quick Overview Of Course Content
This course will take you through an introduction of the Apache NiFi technology.
With a mix of theory lessons and hands-on labs, you'll get started and build your first data flows.
You will learn how to set up your connectors, processors, and how to read your FlowFiles to make most of what NiFi offer.
The most important configuration options will be demonstrated so you will be able to get started in no time.
We will also analyse a template picked from the web and understand how to debug your flows as well as route your data to different processors based on outcomes through relationships.
We will finally learn about the integrations between NiFi and Apache Kafka or MongoDB. Lots of learning ahead!
==============================
Why I should take this course?
With over 1.5 hours of videos and over 15 classes, you will get a great understand of Apache NiFi in no time!
You will learn how to install and configure Apache NiFi to get started
You will learn Apache NiFI Architecture and Core Concepts
The core concepts like FlowFile, FlowFile Processor, Connection, Flow Controller, Process Groups etc.
You will learn how to use Apache NiFi Efficiently to Stream Data using NiFi between different systems at scale
You will also understand how to monitor Apache NiFi
Integrations between Apache Kafka and Apache NiFi!
Questions can also be asked on the forum and instructor is keen to answer those in timely manner
==============================
Students Loved this course
Ashish Ranjan says “Great Course to get started with Nifi. Also, the instructor is very helpful and answers all your questions. I would highly recommend it. Great Job.” (Rated with 5 star)
Luca Costa says “It was very interesting and now I have an Idea how to start my project :) Thank you” (Rated with 5 star)
Aaron Gong says “Very clear and well instructed, first section is the most important, why use Nifi and for what purpose it is better suited for…” (Rated with 5 star)
I am sure that you will walk away with a great enterprise skill and start solving your streaming challenges!
===============================
Instructor
My name is Stephane Maarek, and I'll be your instructor in this course. I teach about Data Engineering and API, and throughout my career in designing and delivering these certifications and courses, I have already taught 1,000,000+ students and gotten 350,000+ reviews!
With NiFi becoming much more than a buzzword out there, I've decided it's time for students to properly learn about Apache NiFi - Cloudera DataFlow - HDF 2.0. So, let’s kick start the course! You are in good hands!
===============================
This Course Also Comes With:
Lifetime Access to All Future Updates
A responsive instructor in the Q&A Section
Links to interesting articles, and lots of good code to base your next template onto
Udemy Certificate of Completion Ready for Download
A 30 Day "No Questions Asked" Money Back Guarantee!
I hope to see you inside the course!
Who this course is for:
- Beginners who want to get started on learning Apache NiFi
- Architects who want to get an overview of Apache NiFi
Instructor
- 4.7 Instructor Rating
- 930,113 Reviews
- 3,012,993 Students
- 70 Courses
Stephane is a solutions architect, consultant and software developer that has a particular interest in all things related to Cloud & Big Data. He's also a many-times best seller instructor on Udemy for his courses in AWS and Apache Kafka.
[See FAQ below to see in which order you can take my courses]
Stéphane is recognized as an AWS Hero and is an AWS Certified Solutions Architect Professional & AWS Certified DevOps Professional. He loves to teach people how to use the AWS properly, to get them ready for their AWS certifications, and most importantly for the real world.
He also loves Apache Kafka. He used on the Program Committee organizing the Kafka Summit in New York, London and San Francisco. He also was an active member of the Apache Kafka community, and has authored blogs on Medium and the guest blog for Confluent. He also has co-founded Conduktor, a prominent company in the Kafka ecosystem.
During his spare time he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!
FAQ: In which order should you learn?...
AWS Cloud: Start with AWS Certified Cloud Practitioner or AWS Certified Solutions Architect Associate, then move on to AWS Certified Developer Associate and then AWS Certified SysOps Administrator. Afterwards you can either do AWS Certified Solutions Architect Professional or AWS Certified DevOps Professional, or a specialty certification of your choosing. You can also learn about AI with the AWS Certified AI Practitioner course!
Apache Kafka: Start with Apache Kafka for Beginners, then you can learn Connect, Streams and Schema Registry if you're a developer, and Setup and Monitoring courses if you're an admin. Both tracks are needed to pass the Confluent Kafka certification.