
Welcome to Grafana Time Series Data Visualization
The architecture of the monitoring system
Three components of metrics collection - Collector, Time Series database, Query and Visualization
The flow of data from the source, collectd to the database and to visualization tools.
Different collectors
Different metric or Time series database
Various Query and Visualization tools
Introduction to AWS EC2 Instance
Creating new EC2 instance with CentOS Operating System
Configuring security groups and private key to login
Setup and configure putty to login to EC2 Instance
Login to EC2 instance by opening ports for required IP address
Configure Grafana repository
Installing Grafana using yum
Start Grafana service
Opening the required port
Verifying installation
Creating test Data Source
Create a new Dashboard
Create random walk graph
Overview of Docker
Docker port mapping overview
Configure docker repo file and installation
Running docker
Verifying running container
Opening required port to access docker container
Access Grafana running within the container
Run Graphite container
Map required ports of container to host ports
Verify Graphite installation
Access Graphite web application
Add test metric using Netcat
Verify the added metric within Graphite
Configure and Test Graphite Data Source
Create a new dashboard using Graphite Data Source
Access default metric from Carbon Storage
Install collectd data collector using yum
Overview of collectd configuration plugin
Enable required plugin for log and Graphite
Configure Graphite plugin configuration
Start collectd service
Verifying collectd metrics in Graphite Data Source
Basic concepts of Metric
Discussion Metric Tuple - Name, Value, and Timestamp
Metric and Time-series relation
Data Source Introduction
Data Source connection details
Reading data from Data Source
Data Source configuration in Grafana
Mapping of Dashboard and Panel mapping to Datasource
Dashboard and Panel Timeframe
Dashboard Rows and Columns
Panel arrangements within Dashboards
Introduction to Panels
Panels arrangements in Dashboard
Types of Panels
Timerange for Panels
Creating graph panel using sample data
Configuring visualization like Draw modes, mode options, Hover tooltip, Stacking
Changing the legend
Selecting and unselecting the series for visualization
Adding more data series to graph
Configuring X and Y-Axis
General settings like Title, Description, and Transparency
Introduction to Singlestat panel
Purpose of Singlestat panel
Customizing the visualization of values, coloring and Spark lines
Setting the thresholds
Threshold coloring options
Configuring it as Gauge
Value or Range mapping to Text
Purpose of Table Panel
Creating a sample Table Panel
Different Table Transformation
Column and Row style options
Setting the threshold
Threshold coloring of value, cells or rows
Time Series Aggregation Eg: Average, Minimum, Maximum, Current, Total, Count, etc.,
Table add column settings
Rendering value as a link
Creating sample Gauge
Purpose of Gauge panel
Configuring display, Field and Threshold
Various type of calculations like Minimum, Maximum, Mean, Count, Range, Delta, Step, etc.
Configuring threshold coloring
Adding more threshold ranges
Value or Range to Text mapping
Creating bar gauge visualization
Purpose of bar gauge visualization
Difference between normal gauge and bar gauge
Adding more threshold ranges
Different modes and orientation of bar gauges
Value or Range to text mapping
Creating load to the system
Creating Heatmap Panel
Purpose of Heatmap Panel
Histogram and Bucket concepts in X and Y Axis
Configuring Display colors, Scale, legend, and Buckets
Tooltip with histogram
Different color scheme
Importance and need of using Log scale in Y axis
Panel graph with Y Log Scale
Visually seeing the difference between linear and Y Log scale
Detailed view and relatively comparing the small values with large values.
Avoiding domination of a single metric
Dashboard Time range options
Quick range time selection
Custom range time selection
Time range supported units
Displaying entire period of hour, week, day, month etc.,
Discussing different time range samples
Panel over riding time range
Panel Relative time
Panel Time Shift
Using Time Shift and Relative time together
Configuring Auto refresh options
Relative now delay configuration
Introduction and Purpose of Alerts
Architecture and Alert trigger mechanism
Supported Data source
Creating the alerts in panels
Setting rules and Conditions
Reason to avoid False positive values
Different states of alerts
Overview on Error handling and notification
Different alert states
State change between Ok, Pending and Alerting
What makes the state to change
Purpose of 'For' and 'Evaluate every' Option
Sample panel with various state changes
Using Various Conditions
Condition sequencing
Different calculation for conditions like max, min, avg, count etc.,
Using the query with timeframe
Using conditions like 'is above', 'is below' , 'is outside range', 'is within range'
No Data and Error Handing State change
Listing alerting rules
Filtering alerting rules
Pausing alerts
Setting new notification channel
Notification configuration
Using notification channel as part of alerts
Create panel with list of alerts
Configure panel with options and filter
Filtering alerts based on State
Need and importance of Variables
Different types of variables
Creating a query variable
Use variable in title and Description
Variable interpolation
Multiple option selection in variables
Need of Interval variable
Creating Interval variable
Using variables with Interval
Using variable with Relative time and time shift
Need for Data source variable
Creating Data source variable
Demo with Data source variable
Purpose of Grafana Annotations
Adding new annotations and Tags
Creating new area annotation
Managing annotations
Setting annotation filters
Configure annotation legend and properties
Creating new annotation query
Adding filters for annotation query
Controlling annotation properties
Enabling and hiding annotations
Creating a new dashboard folder
Managing dashboard folders
Folder permission overview
Folder settings
Purpose of Grafana Playlist
Creating a new playlist
Managing Grafana playlist
Preview and delete the playlist
Managing dashboards within a playlist
Different play modes of the playlist
Need for dashboard sharing
Creating a shareable link for Grafana dashboard
Creating a dashboard snapshot and advantages of snapshots
Managing list of snapshots
List, View and delete snapshots
Export dashboard as JSON model
Import external dashboard into Grafana
Manage versions of Grafana dashboard
Comparing different versions of a dashboard
Restoring an older version of a dashboard
Visually compare different versions of Grafana
Overview of various configuration files like defaults.ini and custom.ini
Various sections in the configuration file
Setting environmental variable for configuration key
Different default paths and settings
Organization and users mapping within Grafana
Adding and managing users
Adding and managing Organization
Mapping users to multiple organization
Organization and Data Source relation
Editing users, password, permission, organization, etc.,
Introduction and purpose of the scripted dashboard
Overview of sample scripted dashboard
Co-relate dashboard with JSON model
Create a new dashboard with a sample script
Verify newly created dashboard
Introduction to Grafana Plugins
Installing a sample plugin
Verify Annotation list plugin
Create a panel with custom plugin
List of installed custom plugins
Update custom plugins
Remove a plugin
This course requires the following:
An AWS account or any cloud instance for CentOS (optional) available at AWS
Access to AWS CloudWatch to try the demo
Docker Desktop, which can be installed from Docker official website
Note: If you are a Udemy Business user, please consult your employer before downloading any software.
Covers the functionalities as administrators, Devops Engineer, developers etc
Installation of Grafana in Linux, Windows as well as using Docker
Setting up various Data Sources within Grafana
Detailed discussion on Dashboards, Panels and building blocks of Grafana
Adding and Editing of Graphs and Panels
Detailed discussion on Panels like Graph, Singlestat, Table, Heatmap, Alert List Dashboard List
Advanced discussion on Variables, Annotations, Folders, Playlist, Search, Sharing, Time Range, Export & Import, Scripted Dashboards, Dashboard Version History
Configuring various data sources like Graphite, Prometheus, InfluxDB, Elasticsearch, AWS Cloudwatch, MySQL, OpenTSDB, TestData etc
Advanced discussion on alert settings and notification
Collaborate IoT, Infrastructure and DevOps data and Visualize with very intuitive UI using Grafana
Key Functionalities and Features:
Installation and Setup: Grafana's compatibility with major operating systems like Linux and Windows, along with containerization options using Docker, ensures that it can be deployed in diverse environments seamlessly. This flexibility aids in easy integration into existing workflows and systems.
Data Source Integration: Setting up various data sources within Grafana, such as Graphite, Prometheus, InfluxDB, and more, allows for a centralized view of metrics and data across different platforms. This integration is crucial for maintaining comprehensive monitoring and analytics.
Dashboard and Panel Configuration: Grafana's robust dashboard functionality includes the ability to create and modify graphs, panels, and other visual components like Tables, Heatmaps, and Singlestat panels. These tools help in distilling large datasets into readable and actionable insights.
Advanced Features: Discussions on advanced features like variables, annotations, and scripted dashboards enhance Grafana’s utility by allowing customization and dynamic responses based on user interactions or predefined scripts.
Alerting and Notifications: With advanced alert settings, Grafana helps in proactive monitoring and immediate response to system anomalies or performance issues, which is essential for maintaining system reliability and performance.
Collaboration and Visualization: The ability to collaborate on IoT, infrastructure, and DevOps data, and visualize it through an intuitive UI, makes Grafana an invaluable tool for teams aiming to streamline operations and enhance decision-making processes.