
Enhance machine learning models by using genetic algorithms to optimize hyperparameters in Python, boosting performance and accuracy.
Apply genetic algorithms to optimize hyperparameters of SVM and multilayer neural networks, perform feature selection, and implement from scratch in Python on three datasets for an intermediate level course.
Explore support vector machines for classification and regression, maximizing the margin with a hyperplane defined by support vectors, and adjust kernels, C, and gamma to handle non-linear separability.
Explore neural networks with input, hidden, and output layers, weighted connections, and activation functions like sigmoid and rectified units, trained by backpropagation and gradient descent with learning rate and momentum.
Explore optimization with gradient descent to minimize error across weight configurations, contrasting local and global minima and discussing how P versus NP relates to polynomial time.
Explore nature-inspired metaheuristics for solving large optimization problems, aiming for global optima or good local minima. Focus on genetic algorithm and related methods such as tabu search and simulated annealing.
Explore how genetic algorithms emulate evolution through population-based search, using crossover, mutation, and selection to generate new solutions each generation. Encode solutions in binary as chromosomes, with genes representing bits.
Apply selective reproduction to evolve solutions toward higher fitness via crossover and mutation. Use elitism to keep top solutions and select parents by roulette wheel or tournament selection.
Explore how genetic algorithms encode parameters into binary chromosomes and decode them back to real values within a defined lower and upper bound, illustrated with svm gamma.
Explore how a genetic algorithm runs from pseudocode to a flowchart. Cover generations, population size, crossover and mutation probabilities, and tournament selection with K.
Evolve an initial population through generations using tournament selection, crossover, and mutation to produce a final population, tracking the best chromosome for the optimal solution.
Genetic algorithm accelerates hyperparameter optimization beyond grid search by evolving many promising parameter combinations across generations to find more accurate models, unlike brute force.
Predict building heating and cooling loads using a genetic algorithm on the UCI energy efficiency dataset with eight predictors, including relative compactness, surface area, and glazing variables.
Apply a genetic algorithm to optimize SVM hyperparameters, selecting C and gamma for the kernel with fitness-based evaluation to maximize accuracy, decoding binary chromosomes into continuous values.
Decode the chromosome of zeros and ones into actual C and gamma values for SVM using binary-to-real mapping, with left/right indexing and powers of two to obtain the objective value.
Decode svm hyperparameters from a genetic algorithm chromosome by mapping binary bits to x and y using powers of two and negative indices, yielding the objective function value.
Explore how a genetic algorithm optimizes svm hyperparameters by decoding chromosome bits into c and gamma, computing fitness via svm accuracy, and selecting the best chromosome.
Decode binary chromosomes to actual C and gamma values within bounds, apply one-hot encoding and min-max normalization on the energy efficiency data, then evaluate SVM accuracy with cross-validation.
Prepare the dataset for a support vector machine regression by splitting x and y. Apply fivefold cross-validation with an RBF kernel to compute objective function value for GA optimization.
Define an objective value function that decodes a chromosome into C and gamma, evaluates SVM performance with X and Y using k-fold cross-validation, and reports the average error to minimize.
Explore selecting two parents in a genetic algorithm for SVM optimization using tournament selection, decoding chromosomes to C and gamma, and evaluating each candidate with the objective function (error).
Select two parents for crossover using tournament selection on three random solutions from a 20-solution population, guided by an objective function. Define find_parents_for_tournament_selection to ensure unique picks.
Select and evaluate three candidate solutions using an objective function to compare average error, then pick the two with the lowest error as parents for crossover, updating the parents array.
Test a tournament selection function to pick two parent solutions for a genetic algorithm, selecting the best of three random candidates by the lowest error on dataset, preparing for crossover.
Explore how to optimize SVM hyperparameters C and gamma by decoding chromosomes, computing the objective function from accuracy, and applying a genetic algorithm crossover to produce offspring solutions.
Explore two-point crossover in genetic algorithms for SVM optimization by selecting two distinct cut points to swap middle segments between two parents, producing two children.
Demonstrate a three-segment crossover in a genetic algorithm for svm optimization, using two random indices to swap the middle segments of two parents and assemble two offspring.
Learn how to create two children from two parents by selecting the first, middle, and last segments and concatenating them via a segment-based crossover, with a probabilistic rate.
Apply mutation operators to genetic algorithm solutions for SVM optimization, flipping binary genes with a low mutation probability to diversify offspring gene-by-gene.
Explore implementing a Python mutation operator for a genetic algorithm, mutating binary genes with a probability, and updating a child’s genes step by step.
Define a mutation function for genetic algorithm children and probability of mutation, mutate two children, print results, and integrate into a single Python script.
Combine all svm optimization functions into one file and optimize the C and gamma hyperparameters with a genetic algorithm using tournament selection on the energy efficiency dataset, with 3-fold cross-validation.
Optimize svm hyperparameters c and gamma using a genetic algorithm on the energy efficiency dataset; preprocess with dummy variables and min-max scaling, shuffle data, and focus on predicting heating load.
Configure a genetic algorithm to optimize SVM hyperparameters on a preprocessed dataset, using 40-population, 20 generations, 100% crossover, 0.3 mutation, and k-fold cross-validation. Track the best chromosome per generation.
Explore setting genetic algorithm parameters, initialize a 40-solution population, 20 generations, 100 percent crossover, and mutation at 3, while tracking objective function values to converge on the best chromosome.
Explore svm optimization with a genetic algorithm, managing populations across generations, using tournament selection, crossover and mutation to minimize the objective function error on the dataset.
We apply crossover and mutation to generate two mutated children, evaluate each by its objective value (average error), and build a new population for the next generation in SVM optimization.
This lecture explains building the next generation in a genetic algorithm: mutate two children per pair, form a 40-member population, sort by objective value, and keep the best per generation.
Explore how a genetic algorithm optimizes SVM hyperparameters C and gamma, selecting the best chromosome from the last generation and the best across all generations to maximize accuracy.
This lecture swaps a support vector machine for a multilayer perceptron to optimize thermal load predictions, using one-hot encoding, normalization, and a genetic algorithm to tune neurons and learning rate.
optimize an mlp model with a genetic algorithm by encoding hyperparameters, using tournament selection and elitism, decoding learning rate and momentum, and evaluating via threefold cross‑validation to minimize error.
Explore how genetic algorithm crossover combines two parents to produce two children, exchanging neurons and hidden layers via combinatorial crossover and two-point crossover for continuous genes, with tournament-selected parents.
Mutate neurons and hidden layers, along with continuous genes, via a genetic algorithm, decode learning rate and momentum, and evaluate fitness as three-fold average error.
Apply a genetic algorithm to optimize an mlp, using elitism, mutation, and population replacement, while tracking per-generation minimums and decoding learning rate and momentum.
This lecture presents MLP progressor settings—hidden layer 100, Adam, learning rate 0.001, constant, momentum 0.9—and shows genetic algorithm outperforming stochastic gradient descent, from 90% to 92%, with SBM classification.
Optimize svm classification for spam detection using genetic algorithm to tune hyperparameters, leveraging 57 features, scaling, pca to 30 components, and 10-fold cross-validation, achieving accuracy improvement from 83% to 93%.
Apply feature selection with a genetic algorithm to a breast cancer Wisconsin dataset, clean missing data, drop an irrelevant id column, and prepare a nine-feature csv for Python.
Learn feature selection with a gene-like chromosome to pick a subset of nine features for classifying benign versus malignant data, including features 0, 1, 5, 7, and 8 in Python.
Apply a genetic algorithm for feature selection to identify the best subset of features for a support vector machine, maximizing accuracy (e.g., 97 percent with features 1,5,6,7,9).
Explore machine learning as learning from data and its use in fraud detection, cancer diagnosis, personalized marketing, and core tasks like classification, regression, and clustering.
In this course, you will learn what hyperparameters are, what Genetic Algorithm is, and what hyperparameter optimization is. In this course, you will apply Genetic Algorithm to optimize the performance of Support Vector Machines (SVMs) and Multilayer Perceptron Neural Networks (MLP NNs). It is referred to as hyperparameter tuning or parameter tuning. You will also learn how to do feature selection using Genetic Algorithm.
Hyperparameter optimization will be done on two datasets:
A regression dataset for the prediction of cooling and heating loads of buildings
A classification dataset regarding the classification of emails into spam and non-spam
The SVM and MLP will be applied on the datasets without optimization and compare their results to after their optimization
Feature Selection will be done on one dataset:
Classification of benign tumors from malignant tumors in a breast cancer dataset
By the end of this course, you will have learnt how to code Genetic Algorithm in Python and how to optimize your machine learning algorithms for maximum performance. You would have also learnt how to apply Genetic Algorithm for feature selection.
To sum up:
You will learn what hyperparameters are (sometimes referred to as parameters, though different)
You will learn Genetic Algorithm
You will use Genetic Algorithm to optimize the performance of your machine learning algorithms
Maximize your model's accuracy and predictive abilities
Optimize the performance of SVMs and MLP Neural Networks
Apply feature selection to extract the features that are relevant to the predicted output
Get the best out of your machine learning model
Remove redundant features, which in return will reduce the time and complexity of your model
Understand what are the features that have a relationship to the output and which do not
You do not need to have a lot of knowledge and experience in optimization or Python programming - it helps, but not a must to succeed in this course.
This course will teach you how to optimize the functionality of your machine learning algorithms
Where every single line of code is explained thoroughly
The code is written in a simple manner that you will understand how things work and how to code Genetic Algorithm even with zero knowledge in Python
Basically, you can think of this as not only a course that teaches you how to optimize your machine learning model, but also Python programming!
Real Testaments -->
1) "This is my second course with Dana. This course is a combination of Metaheuristic and machine learning. It gives a wide picture of machine learning hyperparameter optimization. I recommend taking this course if you know basics of machine learning and you want to solve some problems using ML. By applying the techniques of GA optimization, you will have better performance of ML. The codes provided in this course are very straightforward and easy to understand. The course deserves five stars because of the lecture contents and examples. The instructor knowledgeable about the topic and talented in programming." -- Abdulaziz, 5 star rating
2) "An excellent course! Great for anyone interested in fine-tuning their machine-learning models. I really enjoyed the from scratch implementations and how well they are explained. These implementations from scratch help one understand the theory very well. An interesting thing to point out is that this course uses Metaheustistics to optimise machine-learning. However, you can use machine-learning classifiers to help your Metaheuristic predict good or bad regions." -- Dylan, 5 star rating
3) "Very helpful, for application of optimization algorithm to optimize ML algorithm parameters and got to do this using python, wonderful." -- Erigits, 5 star rating
4) "well explained course. The topic is not an easy one but to date the explanations have been clear. The course has an interesting spreadsheet project." -- Martin, 5 star rating
5) "Thank you very much for this awesome course. Lots of new things learn from this course." -- Md. Mahmudul, 5 star rating