Statistics & Probability for Data Science & Machine Learning

Explore the measure of central tendency by computing mean, median, and mode using real datasets. Learn how distribution and outliers affect these values and their interpretation.

Learn to quantify data spread with range, interquartile range, percentiles, variance, standard deviation, and mean absolute deviation, plus outlier effects on mean and median.

Explore linear regression by plotting a line from two numerical variables, and interpret slope, intercept, and positive or negative relationships.

Explore covariance and the covariance matrix, using X (height) and Y (weight) to show positive and negative relationships, discuss sample vs population formulas, and relate to Pearson and Spearman correlations.

Understand the normal distribution and the empirical rule, using mean, standard deviation, and z-scores on the standard normal curve. Apply these tools to estimate percentiles, medians, and comparisons of performance.

Apply the normal distribution and the empirical rule to compute areas under the curve for percentages below or above a z-score using the z-table, with mean and standard deviation.

Examine the normal distribution (Gaussian) with z-scores, percentile calculations, and standardization to set screening thresholds based on mean and standard deviation.

Explore the basics of probability with coin tosses, dice, and marbles to compute simple outcomes and events. Contrast theoretical and experimental probability and relate them to data science applications.

Explore statistical significance through real-world experiments on advertising effects on children's eating, and master probability concepts, including sample space, independent events, and the addition rule.

Explore how false positives and false negatives affect the probability of actual drug use given a positive test, with a 5% base rate, and examine weather delays' dependence on snow.

Master permutation and combination concepts for data science and machine learning through practical examples, building sample spaces and applying factorial-based formulas to compute arrangements and probabilities.

Explore combinatorics in probability, using permutations and combinations to count outcomes—like exactly three heads in eight coin flips, basketball free throws, and officer selections—guided by factorial-based formulas.

This lecture derives variance rules for independent random variables, showing Var(X+Y)=Var(X)+Var(Y) and Var(X−Y)=Var(X)+Var(Y), discusses dependent cases, and applies to real problems like commute fuel consumption and height comparisons.