Apache NiFi Complete Master Course - HDP - Automation ETL
What you'll learn
- Apache Nifi (Niagara Files) basics to advanced concepts
- Flowfile, Processor, Connections, Controller, ProcessGroup, Input - output ports, Funnel etc.,
- Installation, Security, Customization, Scalability of Apache Nifi
- Develop simple to complex Dataflow and take it to production
- Nifi Registry - Dataflow registry
- Hortonworks DataFlow HDF
- Integreate with Kafka, NoSQL Database, RDBMS, File System, etc
- Porcess different types of files like CSV, JSON, Text file, etc.,
Requirements
- Basic understanding on Data movement and ETL
- Interest to learn more and upgrade to latest technology
Description
Apache Nifi is next generation framework to create data pipeline and integrate with almost all popular systems in the enterprise. It has more than 250 processors and more than 70 controllers.
This course covers all all basic to advanced concepts available in Apache Nifi like
Flowfile
Controllers
Processors
Connections
Process Group
Funnel
Data Provenance
Processor relationships
Input and Output Ports
This course also covers on the Apache Nifi Subprojects like
Nifi Registry
As part of production maintenance, user may have to take cautious decision to improve the performance and handle the errors efficiently. To facilitate the same, Demo also covers on
Handling Throughput and Latency
Handling Back Pressure and Yield
Error handling
Failure Retry
Monitoring Bulletin
Data Provenance
To have seamless experience with data, handling of data latency and throughput and prioritizing the data is important. Its controlled with relationship, yield and back pressure.
Various processors and controllers to process various type of data is demonstrated.
Processors which are used in production scenarios like HTTP, RDBMS, NoSQL S3, CSV, JSON, Hive, etc., are covered in detail along with controllers like SSL, ConnectionPool, etc., with demo.
All these concepts are covered with demo and real time implementation is provided.
For easy practical purpose, all the demonstrated flowfile template is uploaded as part of the course.
Demo on creating and using KeyStore, Trust Store for SSL communication.
Using Maven and Eclipse EE for custom processor and deploying nar file to Nifi libraries.
Who this course is for:
- Developers, Architects, Beginners who wants to learn Apache NiFi
- ETL team who wants to move to latest technology
Course content
- Preview01:28
- 03:41Apache Nifi Introduction
- 06:34Dataflow Introduction - Key Features
- Preview03:57
- 08:12Terminology Introduction
- 07:08UI Introduction - Play with Apache Nifi User Interface
Instructor
![MUTHUKUMAR Subramanian](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
- 4.2 Instructor Rating
- 1,850 Reviews
- 9,777 Students
- 17 Courses
A SMAC technologist passionate about creating solutions that will yield better results. New technology adviser and a startup incubator implementing innovative approaches, products and solutions by embracing latest technology. Worked on various technologies includingSpring Framework, Apache Spark, Apache Flink, Mllib, Graph Processing, AWS, Medium to Large Hadoop Clusters, Cluster administration and setup. Having more than 19 years of industrial experience in various domains like Banking, Finance, Insurance, Staffing, etc.,