
This lesson is the course overview.
Let's discuss what is in this course.
Is this course right for you?
Let's discuss the structure of the course.
Let's define the components of an ANN.
There's a framework for optimal learning. Let's define it here.
There's a framework for optimal learning. Let's define it here.
There's a framework for optimal learning. Let's define it here.
There's a framework for optimal learning. Let's define it here.
Let's discuss a framework for applying the learning techniques.
In this lecture let's define learning curves.
Let's learn about model fit in this lecture.
Let's learn about underrepresented datasets.
In this lecture let's learn what a mapping function is.
What is the error surface and why is it important in deep learning.
Let's learn about the features of an error surface.
Deep learning models aren non-convex.
What are the components of a deep learning model.
More about components.
Let's learn about capacity in this lecture.
Let's learn the anatomy of a Keras model.
Let's work through a case study in model capacity.
Let's work through a case study in model capacity.
Let's work through a case study in model capacity.
The importance of batch size.
A case study in batch size.
Let's work through a case study in model capacity.
Let's work through a case study in model capacity.
Let's learn about loss functions.
How to choose the right loss function for the job.
Case study on loss functions for regression.
Case study on loss functions for regression.
Case study on loss functions for regression.
Let's work a case study on loss functions.
Let's work a case study on loss functions.
Let's work a case study on loss functions.
Let's work a case study on loss functions.
Let's define learning rates.
Let's learn how to configure learning rates.
Let's learn about learning rate schedules.
Let's cover learning rates in Keras.
Case study on learning rates.
Case study on learning rates.
Case study on learning rates.
Case study on learning rates.
What is data scaling?
Let's scale some data.
What is normalization and standardization.
Let's work through a data scaling case study.
Let's work through a data scaling case study.
Let's work through a data scaling case study.
Let's work through a data scaling case study.
Let's learn about activation functions and vanishing gradients.
Let's define ReLU.
Let's learn when ReLU is the right choice.
Let's work through a case study on vanishing gradients.
Let's work through a case study on vanishing gradients.
Let's learn about exploding gradients.
Let's learn about gradient clipping in Keras.
Let's work through a case study on exploding gradients.
Let's work through a case study on exploding gradients.
Let's define batch normalization.
Let's cover some tips for applying batch normalization.
Let's work through a case study on batch normalization.
Let's work through a case study on batch normalization.
Let's work through a about greedy layer-wise pretraining case study.
Let's work through a about greedy layer-wise pretraining case study.
What is the bias variance trade-off and what is overfitting.
Let's learn about reducing overfitting.
Let's learn about regularization approaches in neural networks.
What is weight penalization and why do we want to penalize them? Let's find out in this lesson.
Let's learn how to penalize large weights in neural networks.
Let's discover some tips for applying weight regularization.
Let's work through a case study on weight regularization.
Let's work through a case study on weight regularization.
Let's define activity regularization.
Let's learn about smaller activations.
Tips for regularization.
Let's learn about activity regularization in Keras.
Let's work through a case study on activity regularization.
Let's learn about forcing weight constraints.
Let's learn how to use weight constraints.
Tips for applying weight constraints.
Let's learn about weight constraints in keras.
Let's work through a case study on weight contraints.
Let's define dropout.
Let's learn about the anatomy of dropping out.
Let's cover some dropout tips.
Dropout in Keras.
Case study on dropping out.
Let's define noise regularization.
Let's learn how to add noise.
Tips on adding noise.
Let's add some noise in Keras.
In this lesson let's work through a noise regularization case study.
In this lesson let's define ensemble learning.
In this less on let's learn about a committee of networks.
Let's learn about the varying the three major components of an ensemble model.
Let's define model averaging ensembles.
Let's learn about defining ensembles in Keras.
Let's work through a case study on averaging ensembles.
Let's work through a case study on averaging ensembles.
Let's work through a case study on averaging ensembles.
Let's learn about weighted average ensembles.
Let's work through a case study on weighted averaging ensembles.
Let's work through a case study on weighted averaging ensembles.
Let's work through a case study on weighted averaging ensembles.
Let's work through a case study on weighted averaging ensembles.
Let's learn about resampling ensembles.
Let's work through a case study on resampling ensembles.
Let's work through a case study on resampling ensembles.
Let's work through a case study on resampling ensembles.
Let's work through a resampling ensemble case study.
Let's define horizontal voting ensembles
Let's work through a case study on horizontal voting ensembles.
Let's work through a case study on horizontal voting ensembles.
Thank you for taking my courses!!
** Mike's courses are popular with many of our clients." Josh Gordon, Developer Advocate, Google **
Great course to see the impacts of model inputs, such as the quantity of epochs, batch size, hidden layers, and nodes, on the accuracy of the results. - Kevin
Best course on neural network tuning I've taken thus far. -Jazon Samillano
Very nice explanation. - Mohammad
Welcome to Performance Tuning Deep Learning Models Master Class.
Deep learning neural networks have become easy to create. However, tuning these models for maximum performance remains something of a challenge for most modelers. This course will teach you how to get results as a machine learning practitioner. This is a step-by-step course in getting the most out of deep learning models on your own predictive modeling projects.
My name is Mike West and I'm a machine learning engineer in the applied space. I've worked or consulted with over 50 companies and just finished a project with Microsoft. I've published over 50 courses and this is 53 on Udemy. If you're interested in learning what the real-world is really like then you're in good hands.
This course was designed around three main activities for getting better results with deep learning models: better or faster learning, better generalization to new data, and better predictions when using final models.
Who is this course for?
This course is for developers, machine learning engineers and data scientists that want to enhance the performance of their deep learning models. This is an intermediate level to advanced level course. It's highly recommended the learner be proficient with Python, Keras and machine learning.
What are you going to Learn?
An introduction to the problem of overfitting and a tour of regularization techniques
Accelerate learning through better configured stochastic gradient descent batch size, loss functions, learning rates, and to avoid exploding gradients via gradient clipping.
Learn to combat overfitting and an introduction of regularization techniques.
Reduce overfitting by updating the loss function using techniques such as weight regularization, weight constraints, and activation regularization.
Effectively apply dropout, the addition of noise, and early stopping.
Combine the predictions from multiple models and a tour of ensemble learning techniques.
Diagnose poor model training and problems such as premature convergence and accelerate the model training process.
Combine the predictions from multiple models saved during a single training run with techniques such as horizontal ensembles and snapshot ensembles.
Diagnose high variance in a final model and improve the average predictive skill.
This course is a hands on-guide. It is a playbook and a workbook intended for you to learn by doing and then apply your new understanding to your own deep learning Keras models. To get the most out of the course, I would recommend working through all the examples in each tutorial. If you watch this course like a movie you'll get little out of it.
In the applied space machine learning is programming and programming is a hands on-sport.
Thank you for your interest in Performance Tuning Deep Learning Models Master Class.
Let's get started!