
Discover the fundamentals of machine learning from statistical learning through deep learning, covering bias-variance trade-offs with sampling bootstrap, model selection, radicalization, tree-based methods, SVMs, unsupervised learning, and classification matrices.
Explore the history from linear regression, discriminant analysis (lda), and logistic regression to generalized linear models and neural networks, with python and r for beginners.
Explore linear regression as the foundational supervised learning model, fitting sales from advertising budgets (TV, radio, newspaper) using least squares, and assess relationships with confidence intervals, hypothesis tests, and F-tests.
Explore how classification builds on linear regression through logistic regression, using the sigmoid link to map inputs to probabilities. Learn maximum likelihood, odds ratios, and two-class and multi-class logistic regression.
Discover how to select predictive models to boost accuracy and reduce complexity. Learn best subset, forward and backward stepwise selection, and criteria such as cp, aic, eic, and adjusted r-squared.
Go beyond linearity by transforming linear regression with polynomial features and step functions, using model selection and Cp or adjusted R-squared to choose the degree and build feature engineering indicators.
Explore decision trees and regression trees that segment predictor space into regions using thresholds, and learn how random forests and BART use bagging and pruning to boost accuracy.
Explore deep learning foundations with artificial neural networks, convolutional neural networks, and recurrent neural networks, including key training concepts like backpropagation, cross-entropy, and data augmentation.
Analyze classification metrics for model evaluation, including accuracy, confusion matrix, specificity, sensitivity, ROC AUC, and the F1 score derived from precision and recall.
Learn to build a linear regression model to predict miles per gallon from the Auto MPG dataset using features like cylinders, displacement, horsepower, and weight, with normalization.
Explore ridge regression as a regularized linear model, apply F regression feature selection, clean and encode data, and evaluate mean absolute error on New York City real estate data.
Explore how random forests operate as an ensemble of decision trees trained with bagging to curb overfitting, featuring classifiers, visualization, and digits classification.
Learn to build a multi layer perceptron with TensorFlow for handwritten digit classification. Normalize data, flatten inputs, use dense layers, train with validation, and evaluate with a confusion matrix.
Build a convolutional neural network in TensorFlow using a 32 by 32 by 3 input, 32 three-by-three filters, and a 2 by 2 max pool for ten-class image classification.
Explore principal component analysis (PCA) as an unsupervised learning technique, implement it with scikit-learn, fit on data, and interpret principal components and variance explained using scatter plots and vector arrows.
Explore how roc auc uses true positive rate and false positive rate across thresholds to evaluate classifier performance, including handling imbalanced data and interpreting precision, recall, and f1 scores.
The notebooks should be in the following order (Udemy system order them in a strange way):
ex0 - intro to python
ex0 - numpy, pandas, matplotlib
ex1 - linear regression
ex2 - logistic regression
ex3 - ridge, lasso
ex4 - decision tree, random forests
ex5 - random forests
ex6 - svm
ex7 - mlp, cnn, rnn, tuning
ex8 - cnn
ex9 - rnn, lstm on imdb
ex10 - pca, kmeans
ex11 - rocauc
This is an introduction course of machine learning. The course will cover a wide range of topics to teach you step by step from handling a dataset to model delivery. The course assumes no prior knowledge of the students. However, some prior training in python programming and some basic calculus knowledge is definitely helpful for the course. The expectation is to provide you the same knowledge and training as that is provided in an intro Machine Learning or Artificial Intelligence course at a credited undergraduate university computer science program.
The course is comparable to the Introduction of Statistical Learning, which is the intro course to machine learning written by none other than the greatest of all: Trevor Hastie and Rob Tibshirani! The course was modeled from the "Introduction to Statistical Learning" from Stanford University.
The course is taught by Yiqiao Yin, and the course materials are provided by a team of amazing instructors with 5+ years of industry experience. All instructors come from Ivy League background and everyone is eager to share with you what they know about the industry.
The course has the following topics:
Introduction
Basics in Statistical Learning
Linear Regression
Clasification
Sampling and Bootstrap
Model Selection & Regularization
Going Beyond Linearity
Tree-based Method
Support Vector Machine
Deep Learning
Unsupervised Learning
Classification Metrics
The course is composed of 3 sections:
Lecture series <= Each chapter has its designated lecture(s). The lecture walks through the technical component of a model to prepare students with the mathematical background.
Lab sessions <= Each lab session covers one single topic. The lab session is complementary to a chapter as well as a lecture video.
Python notebooks <= This course provides students with downloadable python notebooks to ensure the students are equipped with the technical knowledge and can deploy projects on their own.