Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Elasticsearch 6 and Elastic Stack - In Depth and Hands On!
Rating: 4.0 out of 5(45 ratings)
351 students

Elasticsearch 6 and Elastic Stack - In Depth and Hands On!

Use data from any source, in any format, and search, analyze, and visualize it in real time with reliability & security
Last updated 9/2018
English

What you'll learn

  • Install and configure Elasticsearch on a cluster
  • Develop an understanding of Elasticsearch dichotomy, Elasticsearch APIs, and how to interact with a cluster via API
  • Dive deeper into Elasticsearch interactions with filers, ranges, matches along with aggregations
  • Probe Elastic Stack and use Kibana, Logstash and filebeats, to develop a pipeline to get data from an external source into Elasticsearch
  • Build an Elasticsearch application
  • Learn how to use Kibana to visualize data and tell data stories in real-time
  • Learn the skills required to instantly search petabytes of data and provide amazing customer interactions
  • Leverage HTTP-based APIs for ElasticSearch insert, query, and configure operations

Course content

3 sections100 lectures11h 55m total length
  • The Course Overview5:49

    This video will give you an overview about the course. 

  • What is Elasticsearch?2:57

    The purpose of this video is to better understand Elasticsearch as a technology.

    • Define Elasticsearch

    • Identify key features of Elasticsearch

    • Give examples of how Elasticsearch is being used in industry

  • Goals of Elasticsearch3:36

    In this video, we will develop a general understanding of how Elasticsearch works.

    • Define Elasticsearch as a search and analytics engine

    • Gain understanding of how Elasticsearch delivers near real-time results

    • Take a quick look at DSL

  • Installing Elasticsearch9:01

    In this video, we will take a detailed look at how to install Elasticsearch core technologies: Elasticsearch and Kibana.

    • Learn how to install Elasticsearch

    • Learn how to install Kibana

    • Live walkthrough for installing Elasticsearch and Kibana

  • What is an Index?5:20

    In this video, we will understand indices in Elasticsearch.

    • Define Elasticsearch index

    • Compare Elasticsearch to relational DBs

    • Demonstrate how to add and delete an index

  • Docs in Elasticsearch6:05

    In this video, we will look at documents in Elasticsearch.

    • Define documents in Elasticsearch

    • Define field and type

    • Live demonstration of adding and deleting documents

  • What is a Cluster?3:44

    In this video, we will learn about clusters in Elasticsearch.

    • Define a cluster

    • Define a node/instance

    • Demonstrate how to start an Elasticsearch instance

  • Shards and Replicas9:22

    In this video, we will understand shards and replicas.

    • Detailed explanation of shards and how they work

    • Detailed explanation of replicas and how they work

    • Demonstrate how to set shards and replicas in Elasticsearch

  • Bulk API2:33

    In this video, we will develop an understanding of Bulk API in Elasticsearch.

    • Define Bulk API

    • Show example of Bulk API

    • Demonstrate how to use the Bulk API in Elasticsearch

  • Introduction to RESTful API3:57

    In this video, we will develop a general understanding of RESTful API.

    • Define RESTful API

    • Look at HTTP verbs used in RESTful API

    • Breakdown the dichotomy of a request string

  • Searching with RESTful API5:25

    In this video, we will learn how to run search queries with RESTful API.

    • Quickly look at the sample movie index and use _count to get number of documents

    • Run term query across movie index

    • Run match query across movie index

  • Updating with RESTful API5:29
  • Introduction to DSL4:43

    In this video, we will understand Domain Specific Language in Elasticsearch.

    • Understand leaf and compound queries

    • Look at different types of queries

    • Demonstrate queries using DSL

  • DSL — Context, Relevancy, and Score5:28

    In this video, we will understand how context, relevancy and score work in Elasticsearch.

    • Understand query clauses

    • Understand relevancy in Elasticsearch

    • Learn about the _score in Elasticsearch

  • Exists Query1:12

    In this video, we will learn about exists queries in Elasticsearch.

    • Define exists query

    • View example of an exists query

    • Demonstrate how to run exists queries in Elasticsearch

  • Introduction to Elastic Stack1:52

    In this video, we will develop a general understanding of RESTful API.

    • Define elastic stack

    • Detailed breakdown of the elastic stack makeup

    • Look at why using the elastic stack is beneficial

  • Kibana4:41

    In this video, we will understand Kibana.

    • Define Kibana

    • Look at how Kibana fits into the Elastic Stack

    • Go through detailed walk through of Kibana installation and setup

  • Logstash3:55

    In this video, we will understand Logstash.

    • Look at a Logstash pipeline

    • Learn how to configure Logstash

    • Demonstrate installation and configuration of Logstash

  • X-Pack7:23

    In this video, we will understand X-Pack.

    • Define X-Pack

    • Look at how to install and configure X-Pack on services

    • Demonstration of installing and configuring X-Pack

  • Beats1:06

    In this video, we will understand light-weight data shippers in Elasticsearch.

    • Define beats

    • Look at the different beats shippers

    • Take a quick look at how to setup/configure Filebeat

  • Prep for Log Analysis7:19

    In this video, we will learn all the steps to preparing for secure log analysis.

    • Get a walkthrough of installing X-Pack and setting passwords

    • Understand how to configure Logstash and kibana yml files

    • Learn how to configure .conf and filebeat.yml

  • Securing Elasticsearch with X-Pack6:27

    In this video, we will learn how to secure Elasticsearch by example.

    • Get a walkthrough installing X-Pack on Elasticsearch, Kibana, and Logstash

    • Setup password for all services using interactive or auto

    • Demonstrate configuring kibana.yml and logstash.yml with password information 

  • Building the Pipeline7:06

    In this video, we will learn how to configure .conf and filebeat.yml by example.

    • Get a walkthrough confirming log data

    • Learn how to configure filebeat.yml

    • Learn how to configure .conf logstash pipeline file by example

  • Running the Pipeline4:02

    In this video, we will learn how to run a secure pipeline for log analysis by example.

    • Start up the necessary services: Elasticsearch and Kibana

    • Learn and use command to start Filebeat

    • Test and then start pipeline by executing required Logstash command

  • Term, Range, and Boosting6:21

    In this video, we will learn how term, range and boosting queries add power to Elasticsearch.

    • Define term, range and boosting queries

    • View examples of term, range and boosting queries

    • Demonstrate how to perform term, range, and boosting queries in Elasticsearch

  • Aggregation Based Analytics4:54

    In this video, we will learn how aggregations in Elasticsearch provide turnkey analytics.

    • Look at metrics and bucket aggregations

    • Show detailed examples of metrics aggregations

    • Demonstrate how to do average and extended stats aggregations in Elasticsearch

  • Aggregation Based Analytics (Continued)2:19

    In this video, we will learn how geo aggregations work in Elasticsearch.

    • Define geo searching

    • Look at the different types of geo searches: distance, distance range and sorting

    • Get detailed explanations for distance, distance range and sorting in Elasticsearch

  • Geo Query by Example7:38

    In this video, we will learn how to run geo queries by example.

    • Setup index template to facilitate IP searches after log analysis run

    • Run example of geo distance query

    • Run example of geo sorting query

  • Sorting in Elasticsearch4:12

    In this video, we will learn about sorting in Elasticsearch and why it’s useful.

    • Look at the importance of sorting in Elasticsearch

    • Learn about basic sorting and the use of sort mode

    • Demonstrate sorting in Elasticsearch

  • Synonyms in Elasticsearch5:00

    In this video, we will learn about the power of synonyms in Elasticsearch.

    • Define synonyms

    • Look at simple expansions versus simple contractions

    • Understand how the process of analysis effects synonym

  • Intro to Machine Learning5:13

    In this video, we will get an overview of machine learning.

    • Define machine learning

    • Learn some use cases for machine learning

    • Understand how machine learning works

  • Elasticsearch and Machine Learning5:16

    In this video, we will learn how Elasticsearch interfaces with machine learning.

    • Learn how to get data into an Elasticsearch cluster for ML

    • Understand the different types of machine learning jobs

    • Learn to train machine learning models with Elasticsearch

  • Machine Learning Walkthrough11:14

    In this video, we will perform a step-by-step walkthrough of machine learning in Elasticsearch.

    • Simulate data to perform machine learning jobs

    • Learn to do single metric machine learning job

    • Evaluate and understand results

  • Supplemental — Getting Data11:47

    In this video, we will look at how to get the data that we use throughout this course.

    • Learn how to restore snapshot

    • Simulate log data

    • Include access.log file

  • Learning Elasticsearch 6

Requirements

  • No prior knowledge of Elasticsearch or Elastic Stack required, however fundamental knowledge of JSON would be helpful.

Description

Elasticsearch is a powerful tool not only for powering search on big websites, but also for analyzing big data sets in a matter of milliseconds! It's an increasingly popular technology, and a valuable skill to have in today's job market. If you’re a technologist who wants to add Elasticsearch to their tool chest for searching and analyzing big data sets, then go for this Learning Path.

This  comprehensive 3-in-1 course is a hands-on guide to using Elasticsearch in conjunction with Elastic Stack, to search, analyze, and visualize data with Elasticsearch, Logstash, Beats, Kibana, and more. You will gain a firm understanding of all the fundamentals of Elasticsearch 6 to build efficient search and analytics applications using Elasticsearch 6. You will also learn what Elastic stack is all about, and how to use it efficiently to build powerful real-time data processing applications. This course covers each and every concept of ElasticSearch and Elastic Stack with the help of practical examples making it easy for you to understand and implement in your own applications.

This training program includes 3 complete courses, carefully chosen to give you the most comprehensive training possible.

The first course, Learning Elasticsearch 6, begins with explaining you what is Elasticsearch, what is it used for, and why is it important. You will then be introduced to the new features of Elasticsearch 6 and its fundamental components such as indices, documents, nodes and clusters, all which form the dichotomy of Elasticsearch. You will also learn how to add more power to your searches using filters, ranges, and more. Next, you will explore how Elasticsearch can be used with the other components of the Elastic Stack such as LogStash, Kibana, and Beats, to get data into an Elasticsearch cluster. Finally, you will develop a Elasticsearch application.

In the second course, Learning Elastic Stack 6.0, after a quick overview of the newly introduced features in Elastic Stack 6, you'll learn how to set up the stack by installing the tools, and explore their basic configurations. You will then demonstrate the creation of custom plugins using Kibana. You will also get some useful tips on how to use the Elastic Cloud and deploy the Elastic Stack in production environments.

The third course, Mastering ElasticSearch 6.x and the Elastic Stack, focuses on two major use cases with Elasticsearch. The first use case is on leveraging the powerful full-text search engine ElasticSearch is built on, allowing developers to add blazingly fast search features to applications. The second use case is on leveraging different components of the Elastic Stack to continuously monitor applications, infrastructure, or even customer transactions.

By the end of this Learning Path, you will be well-versed with the concepts of Elasticsearch and Elastic Stack to build complete, open source solutions for storing, managing, analyzing, and visualizing structured and unstructured data.

Meet Your Expert(s):

We have the best work of the following esteemed author(s) to ensure that your learning journey is smooth:

  • Ethan Anthony is a San Francisco based Data Scientist who specializes in distributed data-centric technologies. He is also the Founder of XResults, where the vision is to harness the power of big data to deliver intuitive customer-facing solutions, largely to non-technical professionals. Ethan is Harvard-educated in the areas of data science and software engineering. He began using Elasticsearch in 2012 and delivered solutions based on the Elastic Stack to a broad range of clientele. Ethan has also consulted globally with firms in a cross-section of industry verticals, from the U.S. to the Far East.


  • Pranav Shukla is the founder and CEO of Valens DataLabs, a technologist, husband, and father of two. He is a big data architect and software craftsman who uses JVM-based languages. Pranav has diverse experience of over 14 years in architecting enterprise applications for Fortune 500 companies and startups. His core expertise lies in building JVM-based, scalable, reactive, and data-driven applications using Java/Scala, the Hadoop ecosystem, Apache Spark, and NoSQL databases. He is a big data engineering, analytics, and machine learning enthusiast. Pranav founded Valens DataLabs with a vision to help companies leverage data to their competitive advantage. Valens DataLabs specializes in developing next-generation, cloud-based, reactive, and data-intensive applications using big data and web technologies. The company believes in agile practices, lean principles, test-driven and behavior-driven development, continuous integration, and continuous delivery for sustainable software systems.


  • Sharath Kumar M N has done his masters in Computer Science at The University of Texas, Dallas, USA. He has been in the IT industry for more than ten years now and is the Elasticsearch Solutions Architect at Oracle. He is an Elastic Stack advocate, and being an avid speaker he has also given several tech talks in conferences such as the Oracle Code Event. Sharath is a certified trainer—Elastic Certified Instructor—one of the few technology experts in the world who has been certified by Elastic Inc to deliver their official from the creators of Elastic training. He is also a data science and machine learning enthusiast. In his free time, he enjoys trekking, listening to music, playing with his lovely pets Guddu and Milo and the geek in him loves exploring his Python skills for stock market analysis.


  • Chris Fauerbach is an active technical expert in the area of cybersecurity and the Elastic Stack. As a seasoned software engineer, he's built multiple commercial products on the Elastic Stack and has a passion for teaching. Chris continues to research new technologies and explore new ways to solve problems. As he has become an expert in his field, he has been focusing primarily on writing and teaching.

Who this course is for:

  • This learning path is for developers, architects, data professionals, and system administrators who want to add Elasticsearch to their toolchest for searching, analyzing, and visualizing data sets.