
Explore Apache NiFi as a powerful, scalable ETL tool that extracts, transforms, and loads data via directed graphs of processors and a drag-and-drop, no-code UI for easy data routing.
NiFi enables secure, reliable data transfer and preparation through format conversion, parsing, extraction, routing with processor-driven decisions. It reads CSV and writes to Mongo, with Kafka and Elasticsearch without coding.
Explore NiFi basic terms—processors that perform tasks, flow files carrying data and metadata, and connections that link processors as queues enabling rate management and back pressure.
Install Apache NiFi on a Windows local machine by downloading and unzipping the binary, running the batch file, and logging in with credentials from the log file.
Create your first NiFi flow to move files from a source folder to a target folder, configuring get file and put file processors and establishing input directories and relationships.
Explore NiFi user interface to manage a data flow with processors, ports, and process groups, using the statistics bar to monitor active threads, total queue data, and running components.
Create a second NiFi flow that uses get sftp to fetch files from the server source folder and place them into the local target folder.
Learn how the flow controller manages processor connections and thread allocation in Apache NiFi, and how process groups organize processors for modular flows with input and output ports.
Learn how relationships define a NiFi processor’s outputs, routing success, failure, original, response, and retry to subsequent components.
This session explains about all the 3 Repositories,
Flow File Repository
Content Repository
Provence Repository
It also explains lifecycle of a flow file and its interactions with all the repositories.
Export flows in NiFi by creating an XML template that captures the entire flow, including processors, connections, and property values, then download and import it into another environment.
Learn how to import flows and templates in Apache NiFi, create a process group, upload an XML template, and recreate a flow using the SFTP files template.
Explore NiFi template resources from Apache Unify, Hortonworks, and GitHub, download five templates, and preview flows for Elasticsearch, retry loops, HTTP, CSV to JSON, logs, and edge base.
Deploy Apache NiFi on an Ubuntu server via SSH, download and unzip the binary, update the NiFi host in its properties, start NiFi, and retrieve initial credentials from the log.
Learn how to deploy Apache NiFi using Docker by pulling the image, creating and running a container with port mapping, checking logs, and accessing the login page to verify deployment.
learn to install HBase using Docker by pulling the image, running a container with a data directory, verifying containers, accessing master via host file, and validating data persistence after restarts.
Learn to install Cassandra with Docker by pulling the image, running a container, and using the Cassandra shell to create a keyspace, a table, and insert data.
Learn to install a MySQL server with Docker, pull the image, run a container with a data directory, create a contacts table, insert a record, and verify persistence after restart.
One stop solution for Nifi is here. This course focus on the following areas,
Introduction and working with Nifi
Introduction
Basic Concepts
Creating Flows
All different processors
All different services
Deployment
Deployment on local system
Deployment on server
Deploy Nifi using docker
Deploy Nifi Cluster
Develop Components
Extend Nifi Code
Create processors
Create services
This course is the one stop solution for you for Nifi. It can make you an expert in Nifi starting from basics.
This course is good for people for all the levels (freshers OR experienced). It can take your career to the next level.
Lecture structure is as follows,
Introduction
What is Nifi ? - Session explains what Nifi is.
Why chose Nifi ? - Session provides uses cases of Nifi.
Nifi basic terms - Session defines basic terms like processor, connection and Flow file.
Getting Started
Install Nifi on local (windows system) - Session defines how to install Nifi instance on local system. Have used windows system for this.
Create first flow (Move files from one directory to another)
Working with Nifi
Nifi UI - Session explains user interface of Nifi
create second flow (sftp files from one directory and keep it on local system)
Flow controller and process groups
Import & Export Flows
Export flow in Nifi - Session explains how we can export flows in Nifi and use if templates.
Import flow in Nifi - Session explains how we can import flows in Nifi
Deployment
Deploy Nifi on ubuntu
Depkoy Nifi using docker