
My personal introduction to the course which will enable you to bring 31 day searches down to 31 minutes or less.
The primary objectives for achieving fast searches involve an understanding of the way data is indexed and the way that SPL is processed and executed in the environment.
Part 2 on the Fast Search Overview
Walk through the most effect processes to achieve fast searches for extracting valuable insights from your data.
Details on Segmentation, both major and minor. Review of Reporting commands and their mechanics. SPL tricks for command usage strategies to improve search speeds
Details regarding effective use of stats command for fast and efficient SPL.
Overview of loadjob
A look at the SPL command types and what they mean.
Details on using TERM effectively in your SPL
Details on using NOT TERM effectively in your SPL
What if you want to search an index for intel from another index like threats, intel feeds, or other events? With the search_term macro, you can find events from one index connected to events in another index, including using time windows. You could look in an index for a time window of 5 minutes before and 1 minute after the appearance of traffic involving an ip address list from another index by modifying the macro provided here.
search_term(2) - stats count by $field$ | eval $field$ = "TERM($pre$".$field$.")" | stats values($field$) AS search | table search | eval search = mvjoin(search," OR ")
The final search shown in this video took 4.3s to search 64.5k events over All time on a desktop indexer. This search is much more effective when the number of events filtered is very large (sparse searches) so that the indexers pull few events for parsing.
You will learn to leverage Splunk indexing mechanics, Splunk indexers in parallel, and optimal SPL to increase your search speed/efficiency by on average over 500k times faster; search times of months or days will be reduced down to minutes or seconds. A basic understanding of Splunk SPL commands and data analytics (averages and sums) is useful, but not essential, for success in this course because basic SPL will also be covered. Comfort with Linux and with Cloud services are both helpful in following the process for installing Splunk on the Cloud (highly recommended). Much like with Google Cloud and AWS, the first year with Azure is free.
The key to searching fast in Splunk is to begin with a good idea of what you are looking for and how you will render that data into a form that you will use to understand the answer. You'll need to move away from wanting to see "everything" because the human eye is not designed to look at millions and billions of complex events. You'll need to plan the kind of information and format that you want to see into a relatively small number of rows and columns or lines on a chart. Be careful to avoid wanting to look at raw data because that is the easiest way to waste a lot of your time, slow you down and miss something.