Key Takeaways
Hands-On Genetic Algorithms with Python by Eyal Wirsansky is a new book which explores the world of genetic algorithms to solve search, optimization, and AI-related tasks, and improve machine learning models. InfoQ interviewed Eyal Wirsansky about how genetic algorithms work and what they can be used for.
In addition to our interview, InfoQ was able to obtain a sample chapter which can be downloaded here.
InfoQ: How do genetic algorithms work?
Eyal Wirsansky: Genetic algorithms are a family of search algorithms inspired by the principles of evolution in nature. They imitate the process of natural selection and reproduction, by starting with a set of random solutions, evaluating each one of them, then selecting the better ones to create the next generation of solutions. As generations go by, the solutions we have get better at solving the problem. This way, genetic algorithms can produce high-quality solutions for various problems involving search, optimization, and learning. At the same time, their analogy to natural evolution allows genetic algorithms to overcome some of the hurdles encountered by traditional search and optimization algorithms, especially for problems with a large number of parameters and complex mathematical representations.
InfoQ: What type of problems do genetic algorithms solve?
Wirsansky: Genetic algorithms can be used for solving almost any type of problem, but they particularly shine where traditional algorithms cannot be used, or fail to produce usable results within a practical amount of time. For example, problems with very complex or non-existing mathematical representation, problems where the number of variables involved is large, and problems with noisy or inconsistent input data. In addition, genetic algorithms are better equipped to handle deceptive problems, where traditional algorithms may get trapped in a suboptimal solution.
Genetic algorithms can even deal with cases where there is no way to evaluate an individual solution by itself, as long as there is a way to compare two solutions and determine which of them is better. An example can be a machine learning-based agent that drives a car in a simulated race. A genetic algorithm can optimize and tune the agent by having different versions of it compete against each other to determine which version is better.
InfoQ: What are the best use cases for genetic algorithms?
Wirsansky: The most common use case is where we need to assemble a solution using a combination of many different available parts; we want to select the best combination, but the number of possible combinations is too large to try them all. Genetic algorithms can usually find a good combination within a reasonable amount of time. Examples can be scheduling personnel, planning of delivery routes, designing bridge structures, and also constructing the best machine learning model from many available building blocks, or finding the best architecture for a deep learning model.
Another interesting use case is where the evaluation is based on peoples opinion or response. For example, you can use the genetic algorithm approach to determine the design parameters for a web sitesuch as color palette, font size, and location of components on the pagethat will achieve the best response from customers, such as conversion or retention. This idea can also be used for genetic art artificially created paintings or music that prove pleasant to the human eye (or ear).
Genetic algorithms can also be used for ongoing optimizationcases where the best solution may change over time. The algorithm can run continuously within the changing environment and respond dynamically to these changes by updating the best solution based on the current generation.
InfoQ: How can genetic algorithms select the best subset of features for supervised learning?
Wirsansky: In many cases, reducing the number of featuresused as inputs for a model in supervised learningcan increase the models accuracy, as some of the features may be irrelevant or redundant. This will also result in a simpler, better generalizing model. But we need to figure out which are the features that we want to keep. As this comes down to finding the best combination of features out of a potentially immense number of possible combinations, genetic algorithms provide a very practical approach. Each potential solution is represented by a list of booleans, one for each feature.
The value of the boolean (0 or 1) represents the absence or presence of the corresponding feature. These lists of boolean values are used as genetic material, that can be exchanged between solutions when we mate them, or even mutated by flipping values randomly. Using these mating and mutation operations, we create new generations out of preceding ones, while giving an advantage to solutions that yielded better performing models. After a while, we can have some good solutions, each representing a subset of the features. This is demonstrated in Chapter 7 of the book (our sample chapter) with the UCI Zoo dataset using python code, where the best performance was achieved by selecting six particular features out of the original sixteen.
InfoQ: What are the benefits that we can get from using genetic algorithms with machine learning for hyperparameter tuning?
Wirsansky: Every machine learning model utilizes a set of hyperparametersvalues that are set before the training takes place and affect the way the learning is done. The combined effect of hyperparameters on the performance of the model can be significant. Unfortunately, finding the best combination of the hyperparameter valuesalso known as hyperparameter tuningcan be as difficult as finding a needle in a haystack.
Two common approaches are grid search and random search, each with its own disadvantages. Genetic algorithms can be used in two ways to improve upon these methods. One way is by optimizing the grid search, so instead of trying out every combination on the grid, we can search only a subset of combinations but still get a good combination. The other way is to conduct a full search over the hyperparameter space, as genetic algorithms are capable of handling a large number of parameters as well as different parameter types continuous, discrete and categorical. These two approaches are demonstrated in Chapter 8 of the book with the UCI Wine dataset using python code.
InfoQ: How can genetic algorithms be used in Reinforcement Learning?
Wirsansky: Reinforcement Learning (RL) is a very exciting and promising branch of machine learning, with the potential to handle complex, everyday-life-like tasks. Unlike supervised learning, RL does not present an immediate 'right/wrong' feedback, but instead provides an environment where a longer-term, cumulative reward is sought after. This kind of setting can be viewed as an optimization problem, another area where genetic algorithms excel.
As a result, genetic algorithms can be utilized for reinforcement learning in several different ways. One example can be determining the weights and biases of a neural network that interacts with its environment by mapping input values to output values. Chapter 10 of the book includes two examples of applying genetic algorithms to RL tasks, using the OpenAI Gym environments mountain-car and cart-pole.
InfoQ: What is bio-inspired computing?
Wirsansky: Genetic algorithms are just one branch within a larger family of algorithms called Evolutionary Computation, all inspired by Darwinian evolution. One particularly interesting member of this family is Genetic Programming, that evolves computer programs aiming to solve a specific problem. More broadly, as evolutionary computation techniques are based on various biological systems or behaviors, they can be considered part of the algorithm family known as Bio-inspired Computing.
Among the many fascinating members of this family are Ant Colony Optimizationimitating the way certain species of ants locate food and mark the paths to it, giving advantage to closer and richer locations of food; Artificial Immune Systems, capable of identifying and learning new threats, as well as applying the acquired knowledge and respond faster the next time a similar threat is detected; and Particle Swarm Optimization, based on the behavior of flocks of birds or schools of fish, where individuals within the group work together towards a common goal without central supervision.
Another related, broad field of computation is Artificial Life, involving systems and processes imitating natural life in different ways, such as computer simulations and robotic systems. Chapter 12 of the book includes two relevant Python-written examples, one solving a problem using genetic programming, and the otherusing particle swarm optimization.
Eyal Wirsansky is a senior software engineer, a technology community leader, and an artificial intelligence researcher and consultant. Eyal started his software engineering career as a pioneer in the field of voice over IP, and he now has over 20 years' experience of creating a variety of high-performing enterprise solutions. While in graduate school, he focused his research on genetic algorithms and neural networks. One outcome of his research is a novel supervised machine learning algorithm that combines the two. Eyal leads the Jacksonville (FL) Java user group, hosts the Artificial Intelligence for Enterprise virtual user group, and writes the developer-oriented artificial intelligence blog, ai4java.
Continued here:
Q&A on the Book Hands-On Genetic Algorithms with Python - InfoQ.com
- Genetics - National Geographic Society - March 28th, 2025
- Genetics: Introduction, law of inheritance and Sex Determination - BYJU'S - March 28th, 2025
- Genetics, ecology and evolution of phage satellites - Nature.com - March 28th, 2025
- As a geneticist, I will not mourn 23andMe and its jumble of useless health information | Adam Rutherford - The Guardian - March 28th, 2025
- Rare loss-of-function variants in HECTD2 and AKAP11 confer risk of bipolar disorder - Nature.com - March 28th, 2025
- With 23andMe filing for bankruptcy, what happens to consumers genetic data? - The Conversation Indonesia - March 28th, 2025
- A genetic tree as a movie: Moving beyond the still portrait of ancestry - Phys.org - March 28th, 2025
- Genetic mutations linked to Marek's disease in chickens identified - Phys.org - March 28th, 2025
- 23andMe is looking to sell customers genetic data. Heres how to delete it - CNN - March 28th, 2025
- Horses Pulled Off a Genetic Trick Only Viruses Were Thought to Use - SciTechDaily - March 28th, 2025
- CONSUMER ALERT: Warning 23AndMe Customers That Their Private Genetic Data May Be at Risk - Office of the Attorney General for the District of Columbia - March 28th, 2025
- A new study reveals the genetic change that made horses so athletic - KUOW News and Information - March 28th, 2025
- "Mystery ancestors" gave humans 20% of our current DNA, but who were they? - Earth.com - March 28th, 2025
- Correcting the Mutation Behind a Genetic Eye Disease - The Scientist - March 28th, 2025
- Your DNA is safe here: The AncestryDNA Genetic Test Kit is only $39 now - New York Post - March 28th, 2025
- 23andMe Is Bankrupt. Heres What You Need to Know About Your Genetic Data. - The Wall Street Journal - March 28th, 2025
- Commentary: 23andMe files for bankruptcy, putting its hoard of personal health information at risk - Los Angeles Times - March 28th, 2025
- DNA Microscopy Creates 3D Maps of Life From the Inside Out - SciTechDaily - March 28th, 2025
- Eugenics Must Be Included in Genetics Curriculum: Prof - Mirage News - March 28th, 2025
- 11-minute video on human genetics can make people more accepting of others, reveals new study - Hindustan Times - February 24th, 2025
- Advancing Cancer Genetic Testing to Improve Prevention and Patient Treatment - The Scientist - February 24th, 2025
- Environmental factors, lifestyle choices have greater impact on health than genes, study finds - ABC News - February 24th, 2025
- Study finds lifestyle, environment have greater impact on lifespan than genetics - CBS Boston - February 24th, 2025
- Safeguard repressor locks hepatocyte identity and blocks liver cancer - Nature.com - February 24th, 2025
- Mass spectrometry-based mapping of plasma protein QTLs in children and adolescents - Nature.com - February 24th, 2025
- The Avestagenome Project and TIGS Sign Strategic Alliance to Advance Research in Rare Genetic Disorders - The Tribune India - February 24th, 2025
- Researchers make breakthrough discovery after studying genetics of trees: 'There is a need for proactive conservation' - MSN - February 24th, 2025
- iPSCs and iPSC-derived cells as a model of human genetic and epigenetic variation - Nature.com - February 24th, 2025
- Beyond genetics: The biggest factors that influence health and aging - Earth.com - February 24th, 2025
- Genetic diversity and dietary adaptations of the Central Plains Han Chinese population in East Asia - Nature.com - February 24th, 2025
- How a uniquely human genetic tweak changed the voices of mice - NPR - February 24th, 2025
- Genetic evidence identifies a causal relationship between EBV infection and multiple myeloma risk - Nature.com - February 24th, 2025
- Genetic markers of early response to lurasidone in acute schizophrenia - Nature.com - February 24th, 2025
- Bupa to offer first genetic test for disease prediction in UK - The Times - February 24th, 2025
- Advancing Therapeutic Knowledge of Genetic Influence in ALS: Matthew B. Harms, MD - Neurology Live - February 24th, 2025
- Association of dietary carbohydrate ratio, caloric restriction, and genetic factors with breast cancer risk in a cohort study - Nature.com - February 24th, 2025
- Evaluation of polygenic scores for hypertrophic cardiomyopathy in the general population and across clinical settings - Nature.com - February 24th, 2025
- Familiar autism-linked genes emerge from first analysis of Latin American cohort - The Transmitter: Neuroscience News and Perspectives - February 24th, 2025
- Almost 90% of people would agree to genetic testing to tailor medication use, survey finds - Medical Xpress - February 24th, 2025
- Largest Genetic Study of Bipolar Disorder Identifies 298 Regions of the Genome That Increase Risk for the Condition - Mount Sinai - January 27th, 2025
- Study Sheds Light On The Origin Of Earth Lifes Genetic Code - Astrobiology News - January 27th, 2025
- Largest study on the genetics of bipolar disorder to date gives new insights into the underlying biology - Medical Xpress - January 27th, 2025
- Genetic Swiss Army Knife: New Tool For Gene Editing And Therapy - Forbes - January 27th, 2025
- Uhm Ji-won says the power of genetics is undeniable with Hyun Bin and Son Ye-jin's son - - January 27th, 2025
- Integrative proteogenomic analysis identifies COL6A3-derived endotrophin as a mediator of the effect of obesity on coronary artery disease -... - January 27th, 2025
- Genetic analysis reveals the genetic diversity and zoonotic potential of Streptococcus dysgalactiae isolates from sheep - Nature.com - January 27th, 2025
- Eight psychiatric disorders share the same genetic causes, study says - Medical Xpress - January 27th, 2025
- Exploring genetic associations and drug targets for mitochondrial proteins and schizophrenia risk - Nature.com - January 27th, 2025
- Predictive Genetic Testing and Consumer Genomics Market - GlobeNewswire - January 27th, 2025
- Evolution without sex: How mites have survived for millions of years - EurekAlert - January 27th, 2025
- Our Understanding of Rules that Produce Lifes Genetic Code May Require a Revision - DISCOVER Magazine - January 27th, 2025
- Personalized therapy for rare genetic diseases: Patient-derived organoids offer new hope - Medical Xpress - January 27th, 2025
- The One Thing That's More Important for Longevity Than Your Genes - Parade Magazine - January 27th, 2025
- Complete recombination map of the human genome created - Medical Xpress - January 27th, 2025
- Evidence of genetic determination of annual movement strategies in medium-sized raptors - Nature.com - January 27th, 2025
- Genetic study of Alaska red king crabs suggests species is more diverse and resilient to climate change - Global Seafood Alliance - January 27th, 2025
- Smartwatches reveal insights into psychiatric illnesses and genetic links - Medical Xpress - January 27th, 2025
- Unlocking the Blueprint of Human Life With a Revolutionary DNA Map - SciTechDaily - January 27th, 2025
- Largest Genetic Study of Bipolar Disorder Identifies Nearly 300 Risk-Associated Genome Regions - Inside Precision Medicine - January 27th, 2025
- Genetic Discrimination Is Coming for Us All - The Atlantic - November 16th, 2024
- Family connection: Genetics of suicide - WNEM - November 16th, 2024
- Study links heart shape to genetic risk of cardiovascular diseases - News-Medical.Net - November 16th, 2024
- Genetic architecture of cerebrospinal fluid and brain metabolite levels and the genetic colocalization of metabolites with human traits - Nature.com - November 16th, 2024
- Genetic connectivity of wolverines in western North America - Nature.com - November 16th, 2024
- Toward GDPR compliance with the Helmholtz Munich genotype imputation server - Nature.com - November 16th, 2024
- Leveraging genetic variations for more effective cancer therapies - News-Medical.Net - November 16th, 2024
- Bringing precision to the murky debate on fish oil - University of Arizona News - November 16th, 2024
- International experts gathered in Tashkent to tackle rare disease for Uzbekistan - EurekAlert - November 16th, 2024
- Mercys Story: Living life with 22q, a genetic condition - WECT - November 16th, 2024
- Cold case with ties to Houghton County solved through genetic genealogy after 65 years - WLUC - November 16th, 2024
- 23andMe customer? Here's what to know about the privacy of your genetic data. - CBS News - November 16th, 2024
- Single-cell RNA analysis finds possible genetic drivers of bone cancer - Illumina - November 16th, 2024
- Multi-trait association analysis reveals shared genetic loci between Alzheimers disease and cardiovascular traits - Nature.com - November 16th, 2024
- With 23andMe Struck by Layoffs, Can You Delete Genetic Data? Here's What We Know - CNET - November 16th, 2024
- Genetic testing firm 23andMe cuts 40% of its workforce amid financial struggles - The Guardian - November 16th, 2024
- Genetic study solves the mystery of 'selfish' B chromosomes in rye - Phys.org - November 16th, 2024
- Genetic changes linked to testicular cancer offer fresh insights into the disease - Medical Xpress - November 16th, 2024
- Eating less and genetics help you to live longer, but which factor carries the most weight? - Surinenglish.com - November 16th, 2024
- We must use genetic technologies now to avert the coming food crisis - New Scientist - November 16th, 2024
- NHS England to screen 100,000 babies for more than 200 genetic conditions - The Guardian - October 6th, 2024