
Explore regression performance metrics such as mean square error, root mean square error, mean absolute error, mean absolute percentage error, and R squared, and learn when to use each.
evaluate regression models in Python using mean squared error, mean absolute error, mean absolute percentage error, and r-squared on a diabetes dataset split into training and test sets.
Explore a pairplot style regression visualization that plots predicted versus real values using the Boston dataset. See how points near a 45-degree line indicate good predictions, with outliers visible.
Learn to evaluate binary classification models with confusion matrices, true positives, true negatives, false positives, false negatives, and metrics like accuracy, precision, recall, F1, and balanced accuracy, considering thresholds.
Explore binary classification performance metrics in Python by computing the confusion matrix, accuracy, balanced accuracy, precision, recall, F1, and a comprehensive classification report on test data.
Explore how the ROC curve evaluates binary classification by varying thresholds, plotting true positive rate against false positive rate, and using the area under the curve to indicate model quality.
Evaluate a binary classifier in python by plotting the roc curve and computing auc score using a breast cancer dataset and a random forest model, with train/test split and predict_proba.
Explore multiclass model evaluation in Python by building and interpreting confusion matrices, calculating class-wise precision and recall, and using macro and micro averaged metrics for accuracy and balanced accuracy.
Explore multiclass classification performance metrics in Python using a random forest classifier, including confusion matrix, classification report, accuracy score, balanced accuracy score, and precision with micro and macro averages.
Use balance and accuracy to compare models, especially with imbalanced datasets. Apply precision, recall, and the F1 score, plus micro or macro averages and roc curve area for multiclass evaluation.
In this practical course, we are going to focus on the performance evaluation of supervised machine learning models using Python programming language.
After a model has been trained or during hyperparameter tuning, we have to check its performance in order to assess whether it overfits or not. That's why, according to particular projects and needs, we need to select performance metrics carefully. In fact, the choice of the wrong metrics may give us an unreliable model. On the contrary, using the proper performance indicators can lead our project to a higher value.
With this course, you are going to learn:
Performance metrics for regression models (R-squared, Mean Absolute Error, Mean Absolute Percentage Error)
Performance metrics for binary classification models (confusion matrix, precision, recall, accuracy, balanced accuracy, ROC curve and its area)
Performance metrics for multi-class classification models (accuracy, balanced accuracy, macro averaged precision)
All the lessons of this course start with a brief introduction and end with a practical example in Python programming language and its powerful scikit-learn library. The environment that will be used is Jupyter, which is a standard in the data science industry. All the Jupyter notebooks are downloadable.
This course is part of my Supervised Machine Learning in Python online course, so you'll find some lessons that are already included in the larger course.