
Pinot is a real-time distributed olap datastore for low-latency analytical queries on massive data. Use it for user-facing real-time analytics and dashboards with stream and batch ingestion.
This lecture covers the concepts of Tables and Segments in Pinot
Explore how the Apache Pinot controller, with Helix, keeps the cluster healthy and scalable by managing ZooKeeper metadata, providing admin endpoints, and coordinating brokers and segments across multiple controllers.
Build a real-time streaming pipeline using Kafka and Pinot by creating a topic, defining a user schema and table config, and ingesting json messages from Kafka to query live data.
Understand forward indexing in Apache Pinot, including extent encoded and sorted forward index, dictionary mapping, and chunked storage to speed queries while handling high cardinality with raw values.
Create a real-time Pinot table with an inverted index over a Kafka stream, define a schema with dimensions like user country and a timestamp, and validate the indexing workflow end-to-end.
Apache Pinot is a Realtime Distributed Analytical Datastore. It can handle millions of real-time events per minute and can also serve queries in a few milliseconds.
Pinot is a new Big Data Technology that is being adopted by multiple companies like Linkedin, Uber, Slack, Target, Walmart, and many others. With real-time analytics of big data becoming pretty important, Learning an On-Demand Technology like Pinot will be a great addition to your skillset.
Pinot is mainly used in User facing Realtime Analytics where end-users of an application can directly send queries to Pinot. User-facing applications need to respond back in a few milliseconds and also need to handle a huge volume of requests. Pinot can do both of these really well. Pinot can also be used to get insights from real-time data.
I have created this Hands-On Course on Apache Pinot so that you can get a good understanding of what Pinot is and when to use it.
This course covers the following topics
An introduction to Pinot.
Typical use cases for Pinot.
Hands-On sessions to set up a complete Pinot cluster in your local machine.
A quick introduction to Kafka to show how it can be used along with Pinot for Stream Ingestion.
Stream and Batch ingestion in Pinot with corresponding Hands-On Sessions.
Improving query latencies with Indexing in Pinot with a Hands-On Session.
Improving query latencies in Pinot using pre-aggregation techniques with a Hands-On Session.
Different types of queries which are supported by Pinot.
This course ensures that you get a good idea about the various concepts of Pinot. Also, the Hands-On sessions ensure that all the concepts you have learned can be implemented practically.