
Learn to set up an Elasticsearch cluster in Docker and Linux and monitor environments with Elasticsearch, Kibana, and Beats, including metricbeat, filebeat, and heartbeat, plus application performance monitoring basics.
Explore tooling for this course, including the Windows Terminal with auto-completion, Docker Desktop for Windows, and the Linux subsystem for Windows with an editor that has a common prompt integrated.
Decide between Elastic Cloud and on-premises deployments, compare license tiers (standard, gold, platinum, enterprise), and explore pricing, machine learning, anomaly detection, alerting, and security features.
Explore Elastic Cloud Enterprise as a management UI that brings cloud-like deployment and licensing to on-premises or hybrid networks, enabling enterprise Elasticsearch deployment with familiar licenses.
Plan your Elasticsearch cluster by defining nodes, indices, and primary and replica shards. Apply production guidelines by using three nodes and hot, warm, and cold nodes for data balance.
Create a docker-compose based elasticsearch deployment using preconfigured files and environment variables to start a secure three-node cluster with kibana and certificates.
Discover how to troubleshoot Elasticsearch memory limits in Docker, resolving bootstrap checks failed caused by too low max virtual memory areas and adjusting Linux or Windows Docker settings.
Start Elasticsearch 8 cluster for the first time with docker-compose up, wait for Elasticsearch and Kibana to load, log in as elastic with elastic, and verify health is green.
Remove the setup service from the Docker compose YAML after the cluster starts, keeping the three Elasticsearch services and Kibana, updating S01, and restart the cluster.
download virtualbox from the official site, install on Windows hosts, and confirm defaults; Mac and Linux users follow respective options, then proceed to the next chapter.
Create and configure an ubuntu virtual machine in VirtualBox, including memory and disk settings, ISO boot, and initial setup. Then install Elasticsearch on the VM.
Speed up vm provisioning with OSBoxes ubuntu images for VirtualBox or VMware; download the ubuntu vdi, extract with seven zip, and boot a ready-made VM with 4 GB RAM.
Reusing OS Boxes virtual disks for multiple vms may trigger this id conflict; fix by running VBoxManage to change the virtual hard disk UUID and launch three Ubuntu Elasticsearch nodes.
Install elasticsearch on ubuntu with the debian package, import the gpg key, start and enable the service, and verify the cluster at localhost:9200; then install Kebano for the UI.
Install Kibwana on Ubuntu using the Debian package, add the GPG key, configure apt with https, enroll Kibwana to Elasticsearch with an enrollment token, start Cabana, and open localhost:5601.
Edit Kibana's configuration to set server.host from localhost to 0.0.0.0, restart the Kibana service, and verify access from other hosts on the local network.
Prepare a second VirtualBox node for elasticsearch by naming the VM, allocating memory, using an existing drive, and enabling NAT networking for inter-node communication.
Demonstrates adding a second Elasticsearch node by configuring its yaml, generating enrollment tokens, sshing between nodes, restarting services, and verifying the two-node cluster in Cabana.
Install Elasticsearch on node three, configure discovery seed hosts and master nodes with the other two, restart services, and verify a three-node cluster in Kibana dev tools.
Configure a three-node Elasticsearch cluster using full node-specific YAML configs, update IPs or server names, and copy the prepared files to enable the master nodes.
Explore how Elasticsearch creates config directories and the Debian package layout, including elasticsearch.yml and seed host settings. Compare Docker paths and configuration via environment variables or mounted config files.
Configure Elasticsearch with yaml files in docker deployments, copying each node's settings into volumes. Start a three-node cluster by applying yaml configurations and bringing up with docker compose.
Modify Elasticsearch settings by editing the config file to set http host and network.host for remote access, then change the default port from 9200 to 9201, restart, and verify.
Configure Elasticsearch SSL by securing transport between nodes and HTTP connections to outside components like Kibana and Beats, replacing certificates with trusted or self-signed options, and verify.
Configure a warm data node in an Elasticsearch cluster by editing the Elasticsearch YAML to set data warm, restart Elasticsearch, and verify with Kibana DevTools by running get /_nodes.
Discover Kibana config paths on Debian/Ubuntu and in Docker, review the Kibana default directory, the config directory with the keystore and kibana.yml, and compare with Elasticsearch.
Change Kibana host to 0.0.0.0 and update the port from 5601 to 5602 by editing the Kibana config, restart, and verify access from other machines.
Enable ssl in kibana by configuring server.ssl.enabled to true, generating self-signed certificates with openssl, adjusting file permissions, restarting kibana, and verifying https on localhost.
Explore Elastic Beats, including metric beat, file beat, and heartbeat, to collect metrics, logs, and uptime checks from sources, and send data to Elasticsearch for visualization in Kibana with alerting.
Learn the general setup and folder structure for all beats, including metric, file, and heartbeat. Configure modules in modules.d, YAML files, outputs to Elasticsearch, Kibana dashboards, and optional docker metadata.
Set up Metricbeat to collect system metrics and data from Docker, MongoDB, and Kubernetes, ship to Elasticsearch, and visualize data streams and data views in Kibana.
Set up metricbeat in docker by installing docker and docker compose, configuring the metricbeat docker yaml with the docker module and elasticsearch output, and visualizing container metrics in kibana.
Install and configure filebeat, enable log sources, connect to Elasticsearch with HTTPS and credentials, and use modules to ingest Elasticsearch logs, then verify in Kibana.
Deploy filebeat in Docker to collect container logs via the Docker module and socket, enrich with Docker metadata, and ship them to Elasticsearch, with Kibana for live log exploration.
Set up heartbeat for uptime monitoring and observability with Elasticsearch and Kibana, configure monitors for HTTP checks, and view data streams, uptime, and results.
Set up Docker using Docker Compose to run Heartbeat 8.x, configure monitors including a browser test with Playwright, enable reload period, and verify results in Elasticsearch and Kibana.
Configure index lifecycle management for beats data streams in Elasticsearch, linking templates and policies to transition data from hot to warm or cold storage and delete after retention.
Configure metric, file, and heartbeat dashboards in Kibana by updating beat YAML outputs (Elasticsearch output, https and port 5601) and authentication settings, then run setup dashboards to visualize host data.
Discover Elastic APM, instrument both front-end and back-end apps across languages, send data to Elasticsearch, and visualize latency, transactions, dependencies, and alerts in Kibana.
Configure the elastic APM server on docker with docker-compose and a mounted APM server YAML, set host and port 8200 and the Elasticsearch output, then verify readiness at localhost:8200.
Build and run the Options Java spring boot app, connect to Elastic APM with docker compose, and view production environment metrics, including latency, throughput, transactions, and JVM activity in Kibana.
Learn how to use Kibana's home page to monitor with observability and analytics, navigate the dashboard via the burger menu, and check your Elasticsearch cluster version.
Explore the Discover tab to search your data across Beats in Elasticsearch, using time ranges, field filters, and saved searches to view documents.
Explore visualizations and dashboards in Elasticsearch and Kibana, using aggregation-based visuals and Lens to monitor CPU usage and file system metrics from metric beat data.
Create and customize dashboards by adding visualizations, applying host filters, and saving your work. Use charts, lens, markdown headings, and timestamped counts to monitor data.
Explore the observability overview, review logs, metrics, APM, and uptime, and check hosts and services like lk01 and Java; note that user experience monitoring and alerts are not yet activated.
Explore how the logs tab streams live Elasticsearch logs, like a tail, highlights keywords with a highlighter, and lets you customize indices and columns while filtering by host name.
View and group multiple hosts by metric types, monitor memory and CPU usage, and switch between Kubernetes ports and Docker containers to observe pods, group by host name, and manage indices.
Explore Elastic 8 APM: monitor latency and throughput, drill into transactions, view dependencies and database statements, inspect errors, and analyze service maps, logs, and configurations across environments.
Explore the uptime tab to review heartbeat pings to Microsoft.com, filter by up, down, or all, and watch red charts indicate down pings, while noting indices and upcoming alerts.
Explore the management tab to configure settings with def tools for Elasticsearch, review integrations and fleet status, and begin stack management configurations for Cabana and Elasticsearch.
Discover how to create users and roles in elasticsearch and kibana, assign fine-grained index privileges, and tailor a non-admin test user for secure access and dashboards.
Define and manage Cabana spaces to isolate dashboards, visualizations, charts, and settings with space-specific permissions and roles, including per-space data views and index patterns.
[DISCLAIMER: This course requires you to download Docker from docker(dot)com. If you are a Udemy Business User, please check with your employer before downloading]
Elastic 8 is finally released. And so admins fear the breaking changes and new functionalities.
But no worries! - This course will help you getting started with Elastic 8.x.
This course will teach you on how to setup your elastic cluster by yourself to ingest monitoring data to it.
Also you learn on how to upgrade your cluster to a new version.
I will give you a brief overview on how to design a cluster as well as hands on examples on creating a cluster and ingesting data into it.
I will give you examples on how to create a cluster in Elastic using docker and Ubuntu.
Also I will show you on how to ingest data with elastic beats and how to create retention policies for your data.
I also compare for you the changes between elastic 7.6 and elastic 8.x and show you what changed during this major release.
This course since elastic is bringing many changes in a short period of time will constantly grow.
Topics like elastic Logstash and way more topics are already planned and will be released soon - for free when you purchase this course. I will keep updating this course as long as elastic 8.x is the most recent version of elastic.
So with that being said - this is the course for everyone who wants to use elastic, Kibana, beats...