
Assess how feature importance quantifies a feature's influence on a model's target prediction, ranks features, and communicates data-driven insights from models like random forests.
Learn to compute feature importance across linear models and tree-based ensembles (logistic regression, linear regression, elastic net, SVM, decision trees, random forest, gradient boosting), using coefficients and scaling when needed.
Explore shap values for feature importance and model interpretation, using additive explanations and marginal contributions across feature subsets to reveal how features influence predictions.
Explore feature importance and model interpretation in Python using shap with tree-based models, including random forests and decision trees, via tree explainer and summary plots.
Learn how to compute SHAP values with SHAP in Python for regression and classification, using kernel explainer and pipelines to explain model predictions.
Learn recursive feature elimination (RFE) for supervised dimensionality reduction by training a model to score feature importance and iteratively removing the least important features.
Explore recursive feature elimination in Python using a random forest to select the most important features with cross-validation, retrieving named features and applying the final model for predictions.
In this practical course, we are going to focus on feature importance and model interpretation in supervised machine learning using Python programming language.
Feature importance makes us better understand the information behind data and allows us to reduce the dimensionality of our problem considering only the relevant information, discarding all the useless variables. A common dimensionality reduction technique based on feature importance is the Recursive Feature Elimination.
Model interpretation helps us to correctly analyze and interpret the results of a model. A common approach for calculating model interpretation is the SHAP technique.
With this course, you are going to learn:
How to calculate feature importance according to a model
SHAP technique for calculating feature importance according to every model
Recursive Feature Elimination for dimensionality reduction, with and without the use of cross-validation
All the lessons of this course start with a brief introduction and end with a practical example in Python programming language and its powerful scikit-learn library. The environment that will be used is Jupyter, which is a standard in the data science industry. All the Jupyter notebooks are downloadable.
This course is part of my Supervised Machine Learning in Python online course, so you'll find some lessons that are already included in the larger course.