
This brief lecture provides an overview of the module and some prerequisites for the course.
This lecture provides a introduction to machine learning. We also differentiate some sister branches, namely AI and Data Science.
This lecture introduces the formal supervised learning setup. We detail things like empirical risk minimization, loss, testing data, etc.
This lecture outlines the need for test data as a means to approximate true risk. We also differentiate the difference between memorizing and true learning.
This lecture provides an overview of unsupervised learning. We also discuss some common use-cases and the formalized setup of UL.
This lecture briefly covers other types of learning such as Reinforcement Learning.
This is an example of supervised learning done on the mushroom dataset. We encounter many common themes that come up in machine learning.
In this lecture, we discuss a common issue engineers run into: bad data. We explore how bad data can yield limitations.
This lecture provides a brief overview of the bias-variance tradeoff. In particular, we discuss underfitting and overfitting -- common issues ML engineers encounter.
This lecture introduces the formalism to come in understanding machine learning.
In this lecture, we discuss ways to assess model performance. We go further into empirical risk minimization and the importance of test data.
In this lecture, we discuss trade-offs observed in machine learning. In particular, we mathematically work with the bias-variance trade-off.
This lecture outlines the foundations of regression function estimation and some nuance in the process.
In this lecture, we provide a brief example on regression, exploring rigid and flexible models.
This lecture details takeaways from the bias-variance trade-off and how engineers can use it to inform model evaluation.
This video provides an introduction to the regression module and discusses the prerequisites required.
In this lecture, we provide an introduction to the objective of regression, outlining a motivating example.
In this video, we mathematically and intuitively derive the foundations of OLS regression. We outline how the model is set up, the assumptions, and the method of estimation for a simple linear regression model.
This lecture derives the estimators for with-intercept uni-variate regression models.
In this example, we fit with-intercept and without-intercept regression models to the Gentoo penguins dataset.
In this lecture, we mathematically derive the beta-estimators in the multiple linear regression framework.
In this lecture, we solve the motivating example on the Gapminder dataset through R's functionality and directly.
In this lecture, we explain the output of OLS and how it can be interpreted.
In this lecture, we outline how to test the statistical significance of predictors by using hypothesis testing.
In this lecture, we discuss confidence intervals pertaining to regression estimators and model significance.
In this lecture, we outline how to evaluate the performance of a regression model.
In this lecture, we outline methods of feature selection, including common step-wise algorithms.
In this lecture, we outline some common paradigms and issues that we can encounter with regression and some possible ways to mitigate them.
In this lecture, we introduce regularization methods.
In this lecture, we outline ridge regression and the benefits it can offer.
In this lecture, we discuss best subset discussion. We talk about the modified penalty term.
In this lecture, we modify the penalty term differently (by using the 1-norm) to yield LASSO regression.
In this lecture, we discuss alternative variants of regression.
In this lecture, we work through an example on Gapminder data using regularization.
In this lecture, we introduce cross validation as a means to estimate test error in a data-efficient manner.
In this lecture, we work through an example using cross validation on the Gapminder dataset.
In this lecture, we outline how to use cross validation for hyperparameter selection.
In this lecture, we introduce and outline non-linear modelling and the use of basis functions.
In this lecture, we work through example results using polynomial regression on the Gapminder data.
In this lecture, we discuss localized step function regression.
In this lecture, we look at step function regression results on the Gapminder dataset.
In this lecture, we introduce regression splines.
In this example, we use regression splines on the Gapminder dataset.
In this lecture, we introduce smoothing splines.
This brief example uses smoothing splines on the Gapminder dataset.
In this lecture, we outline generalized additive models.
In this lecture, we analyze the results of an example using Generalized Additive Models on the Gapminder dataset.
In this lecture, we discuss how to compare regression models of different classes.
In this lecture, we work through a streamlined AutoML example on the Gapminder dataset.
This lecture is an outline to the classification module.
This lecture goes over the classification problem setup and discusses the similarities to regression.
In this lecture, we dive into the formalized classification setup.
This lecture presents methods of classification performance evaluation.
This lecture introduces K-Nearest-Neighbours (KNN). We also look at the implications of the bias-variance framework in this framework.
This lecture investigates the differences between KNN and OLS regression for classification tasks.
This lecture introduces the Gapminder data and outlines the approach for classification to come in the follow-up examples.
This worked example uses KNN and OLS to perform classification on the Gapminder dataset.
This lecture introduces the basics of logistic regression as well as the logistic function.
This lecture formalizes the foundations of logistic regression.
This is an example on using logistic regression to model credit default.
This lecture analyzes the nuance of output interpretation in machine learning, highlighting the significance of confounding.
This lecture formulates multinomial logistic regression.
This is an example of multinomial logistic regression on the Palmer Penguins dataset.
This lecture differentiates discriminative models vs. generative models and then introduces the generative model framework.
This lecture derives the Gaussian Bayes classifier.
This lecture introduces Quadratic Discriminant Analysis (QDA) as a restricted Bayes classifier.
This lecture introduces LDA as a restricted form of QDA.
This lecture introduces 2 variants of Naive Bayes Classifiers as forms of restricted QDA models.
This is an example of generative models (QDA in this video) on the Palmer Penguins dataset.
This is a continuation of the Palmer Penguins example, applying other generative variants beyond QDA.
Are you ready to build a strong and practical foundation of machine learning?
This comprehensive course is designed to take you from the foundational principles of machine learning to advanced techniques in regression, classification, clustering, and neural networks. Whether you're a student, a data science enthusiast, or a professional looking to sharpen your skills, this course will give you the tools and intuition you need to work effectively with real-world data.
What You'll Learn In This Course:
We begin with a conceptual overview of machine learning, exploring different types of learning paradigms—supervised, unsupervised, and more. You’ll learn how to approach problems, evaluate models, and understand common pitfalls such as overfitting, bad data, and inappropriate assumptions.
From there, we dive into Modelling:
Regression
Linear Models
Regularization (Ridge, LASSO)
Cross-Validation
Flexible Approaches like Splines and Generalized Additive Models
Classification Techniques are covered in depth, including:
Logistic Regression
KNN, Generative Models
Decision Trees
Neural Networks and Backpropagation for more Advanced Modeling.
Finally, we explore Clustering:
K-Means Clustering
Hierarchical Methods
Discussing Algorithmic Strengths, Challenges, and Evaluation Techniques.
Practice with Hands-on Examples:
We teach the concepts of Machine Learning with engaging, hands-on examples using well known datasets such as Gapminder and Palmer Penguins. Mathematical formulas are broken down and explained thoroughly step by step. Not only will you gain the theoretical understanding of Machine Learning, but also the practical intuition and experience for future projects.
With real-world datasets, detailed derivations, and clear explanations, this course bridges the gap between theory and application. By the end of the course, you will have a strong arsenal of fundamential machine learning techniques, know when and how to apply them, and understand the mathematical theories that power them—all with practical, real-world relevance.