Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Linear Algebra and Feature Selection in Python
Role Play
Highest Rated
Rating: 4.6 out of 5(1,104 ratings)
4,482 students

Linear Algebra and Feature Selection in Python

Gain the Theoretical and Practical Foundations to Learn Machine Learning and AI with Understanding
Created by365 Careers
Last updated 8/2025
English
English [Auto],

What you'll learn

  • Understand the math behind machine learning and AI models
  • Become familiar with basic and advanced linear algebra notions
  • Be able to solve linear equations
  • Determine independency of a set of vectors and explore what it means for ML and AI
  • Calculate eigenvalues and eigenvectors
  • Perform Linear Discriminant Analysis (LDA)
  • Perform Dimensionality Reduction in Python
  • Carry out Principal Components Analysis (PCA)
  • Compare the performance of PCA and LDA for classification with SVMs

Course content

5 sections42 lectures3h 9m total length
  • What Does The Course Cover3:49

    Build a strong foundation in linear algebra and dimensionality reduction, including PCA and LDA, with practical Python examples and data science applications.

  • Why Linear Algebra?3:12

    Explore why linear algebra matters for geometry, dimensionality reduction, and machine learning, and learn how vectors and matrices transform feature spaces to manage large data sets.

  • The Case of the Mysterious Model Failure1:43
  • Solving Quadratic Equations2:50
  • Why Quadratic Equations Are More Than Just a Formula2:58
  • Vectors4:42

    Explore vectors, their magnitude, direction, and geometric arrows. Learn addition, subtraction, and dot product, with length compatibility and scalar results, for row and column vectors.

  • Vector Addition: Geometric View0:37
  • Matrices3:42

    Handle matrices as dimensional objects with shape m by n. Use addition, subtraction, and multiplication via dot products; scalars are 1x1 and vectors are 1x n or n x 1.

  • Matrices
  • Matrix Transformations: Geometric View0:35
  • Vectors and Matrices: The Language of Intelligence2:03
  • The Transpose of Vectors and Matrices, the Identity Matrix3:51

    Learn how to transpose vectors and matrices, turning rows into columns and shaping non-square matrices, and explore the identity matrix I and its role in multiplying A or V.

  • Why the Identity Matrix Matters in AI1:40
  • Linear Independence and Linear Span of Vectors6:40

    Explore linear combinations, linear span, and basis concepts. Learn about standard basis vectors and linear independence, and see how these ideas underpin vector spaces and eigenvectors.

  • Smart Features, Smarter Models: Why Linear Independence Fuels AI2:06
  • Basis of a Vector Space, Determinant of a Matrix, Inverse of a Matrix9:58

    Explore the basis of a vector space and determine linear independence and span. Compute the determinant of a matrix and derive its inverse, illustrated with a two-by-two example.

  • Basis, Determinant, and Inverse — The Backbone of Machine Learning Math1:54
  • Solving Equations of the Form Ax=b5:30

    Solve linear systems using matrix form A x = y, obtaining x by left-multiplying with A's inverse when A is invertible; use Gauss method for non-invertible cases.

  • The Gauss Method7:07

    Learn the Gauss method (Gaussian elimination) for solving Ax = y by forming the augmented matrix, applying row operations to create zeros, and using back substitution to find x.

  • The Gauss Method
  • Other Solutions to the Equation Ax=b8:18

    Solve A x = y using gaussian elimination and explore four cases: unique solution, general solution with a parameter, scenarios with two zero rows, and no solution.

  • Determining Linear Independence of a Random Set of Vectors3:31

    Use Gaussian elimination to determine linear independence of vectors, illustrated by a three-vector example solved with an augmented matrix to reveal the trivial solution.

  • Eigenvalues and Eigenvectors3:04

    Explore eigenvalues and eigenvectors and their geometric meaning under linear transformations. Learn how to find eigenpairs, a key step for dimensionality reduction.

  • Eigenvalues & Eigenvectors — The DNA of Transformations in AI1:23
  • Explain the role of linear algebra to your colleague
  • Calculating Eigenvalues3:37

    Compute eigenvalues by solving the characteristic equation det(A - lambda I) = 0 for a 2x2 matrix. This yields eigenvalues -1 and 3.

  • Calculating Eigenvectors6:25

    Apply Gaussian elimination to solve (A - lambda I) v = 0 and identify eigenvectors: for lambda 3, vector [1,1]; for lambda -1, vector [-1,1].

  • Linear Algebra Essentials

Requirements

  • Suitable for beginners. Some understanding of Python basics and math would be an advantage.

Description

Do you want to learn linear algebra?

You have come to the right place!

First and foremost, we want to congratulate you because you have realized the importance of obtaining this skill. Whether you want to pursue a career in data science, AI engineering, machine learning, data analysis, software engineering, or statistics, you will need to know how to apply linear algebra.

This course will allow you to become a professional who understands the math on which algorithms are built, rather than someone who applies them blindly without knowing what happens behind the scenes.

But let’s answer a pressing question you probably have at this point:

“What can I expect from this course and how it will help my professional development?”

In brief, we will provide you with the theoretical and practical foundations for two fundamental parts of data science and statistical analysis – linear algebra and dimensionality reduction.

Linear algebra is often overlooked in data science and AI courses, despite being of paramount importance. Most instructors tend to focus on the practical application of specific frameworks rather than starting with the fundamentals, which leaves you with knowledge gaps and a lack of full understanding. In this course, we give you an opportunity to build a strong foundation that would allow you to grasp complex ML and AI topics.

The course starts by introducing basic algebra notions such as vectors, matrices, identity matrices, the linear span of vectors, and more. We’ll use them to solve practical linear equations, determine linear independence of a random set of vectors, and calculate eigenvectors and eigenvalues, all preparing you for the second part of our learning journey - dimensionality reduction.

The concept of dimensionality reduction is crucial in data science, statistical analysis, and machine learning. This isn’t surprising, as the ability to determine the important features in a dataset is essential - especially in today’s data-driven age when one must be able to work with very large datasets.

Imagine you have hundreds or even thousands of attributes in your data. Working with such complex information could lead to a variety of problems – slow training time, the possibility of multicollinearity, the curse of dimensionality, or even overfitting the training data.

Dimensionality reduction can help you avoid all these issues, by selecting the parts of the data which actually carry important information and disregarding the less impactful ones.

In this course, we’ll discuss two staple techniques for dimensionality reduction – Principal Components Analysis (PCA), and Linear Discriminant Analysis (LDA). These methods transform the data you work with and create new features that carry most of the variance related to a given dataset. First, you will learn the theory behind PCA and LDA. Then, going through two complete examples in Python, you will see how data transformation occurs in practice. For this purpose, you will get one step-by-step application of PCA and one of LDA. Finally, we will compare the two algorithms in terms of speed and accuracy.

We’ve put a lot of effort into making this course the perfect foundational training for anyone who wants to become a data analyst, data scientist, machine learning engineer, or AI engineer.

Who this course is for:

  • Ideal for beginner data science and machine learning students
  • Aspiring data analysts
  • Aspiring data scientists
  • Aspiring machine learning engineers
  • People who want to level-up their career and add value to their company
  • Anyone who wants to start a career in data science or machine learning