Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Apache NiFi - Admin Guide - Clustering and Management 2020
Rating: 4.0 out of 5(65 ratings)
7,627 students

Apache NiFi - Admin Guide - Clustering and Management 2020

Become an Apache NiFi Pro - Real world Production Cluster Setup Example and Troubleshooting Scenarios
Created byVikas Kumar Jha, Poonam Jha
Last updated 5/2020
English
English

What you'll learn

  • Hands-on approach to production like scenarios
  • Intermediate to Advance NiFi Concepts
  • Understanding NiFi Clustering in Detail
  • Installing NiFi Cluster in Demo Environment or Single Server/System
  • Installing NIFi Cluster in Production on 3 Servers
  • Offloading one server work to other nodes during Server Down or Maintenance Window
  • Understanding Running a data flows in Cluster
  • Running NiFi on HTTPS by configuring SSL using NiFi Toolkit
  • NiFi Load Balancing

Course content

3 sections • 10 lectures • 3h 58m total length

  • Understanding NiFi Cluster in detail29:35

    Explore Apache NiFi clustering concepts, comparing cluster and non-cluster setups, understanding nodes, cluster coordinator, heartbeats, and primary and isolated processors for scalable, fault-tolerant data flows.

  • Installing NiFi Cluster on Windows for Demo or Development Purpose48:20

    Install a NiFi cluster on Windows with three NiFi instances on one server, mapping Node 1–3 to localhost. Configure zookeeper, myid, and NiFi.properties, then start and verify cluster UI.

  • Installing 3 Servers NiFi Cluster on Linux Prod Environment55:02

    Learn to install and configure a three-server NiFi cluster on Linux, including host file updates, Java and ZooKeeper setup, and verifying the cluster via the UI.

  • Getting Started with running a flow in cluster7:01

    Demonstrates running a simple flow in a 3-node NiFi cluster, generating flowfiles on all nodes versus an isolated processor on the primary node with host name execution and content verification.

  • Node Offloading during Maintenance. Rejoining Node to Cluster23:02

    Offload a disconnected NiFi cluster node's work to remaining nodes, the UI becomes read-only, and when rejoining, copy the latest flow.xml.gz from a healthy node via scp and start NiFi.

  • Troubleshooting NiFi Cluster When one node crashes11:25

    Troubleshoot a NiFi cluster when a node crashes by assessing cluster status, handling read-only mode, and restarting services on the remaining nodes to rejoin the cluster.

  • Monitoring Logs using NiFi TailFile processor5:43

    Monitor logs across a NiFi cluster with the TailFile processor, tailing a log file and streaming new lines to monitoring tools such as Kibana, Influx, or Grafana.

Requirements

  • Basic understanding of NiFi
  • Apache NiFi (Cloudera Dataflow) Beginners to Advance Part-1

Description

This course is created to provide a deep dive into NiFi clustering and Troubleshooting in production Environment. After this course students should be able to setup and manage NiFi cluster environment.


In This course we're going to learn step by step on below topics:

  • NiFi Cluster Overview

  • Why NiFi Clustering is required?

  • NiFi Cluster Setup in Production Like environment with three Servers.

  • NiFi Cluster setup in demo or development environment on single Server or System.

  • Understanding working of data flow execution in cluster environment.

  • Disconnecting a NiFi cluster node during maintenance activity.

  • Offloading Maintenance node's work to other available nodes.

  • Rejoining Nodes back to cluster.

  • Managing NiFi cluster when one of the Server Crashes and Shuts down.

  • Load Balancing

  • NiFi Toolkit

  • Running NiFi on HTTPS

  • Using NiFi Toolkit to Automate Admin Tasks

Who this course is for:

  • Apache NiFi Developers or Administrators
  • Cloudera Data Flow Managers
  • Technical Enthusiasts

Report abuse