Key Takeaways
Hands-On Genetic Algorithms with Python by Eyal Wirsansky is a new book which explores the world of genetic algorithms to solve search, optimization, and AI-related tasks, and improve machine learning models. InfoQ interviewed Eyal Wirsansky about how genetic algorithms work and what they can be used for.
In addition to our interview, InfoQ was able to obtain a sample chapter which can be downloaded here.
InfoQ: How do genetic algorithms work?
Eyal Wirsansky: Genetic algorithms are a family of search algorithms inspired by the principles of evolution in nature. They imitate the process of natural selection and reproduction, by starting with a set of random solutions, evaluating each one of them, then selecting the better ones to create the next generation of solutions. As generations go by, the solutions we have get better at solving the problem. This way, genetic algorithms can produce high-quality solutions for various problems involving search, optimization, and learning. At the same time, their analogy to natural evolution allows genetic algorithms to overcome some of the hurdles encountered by traditional search and optimization algorithms, especially for problems with a large number of parameters and complex mathematical representations.
InfoQ: What type of problems do genetic algorithms solve?
Wirsansky: Genetic algorithms can be used for solving almost any type of problem, but they particularly shine where traditional algorithms cannot be used, or fail to produce usable results within a practical amount of time. For example, problems with very complex or non-existing mathematical representation, problems where the number of variables involved is large, and problems with noisy or inconsistent input data. In addition, genetic algorithms are better equipped to handle deceptive problems, where traditional algorithms may get trapped in a suboptimal solution.
Genetic algorithms can even deal with cases where there is no way to evaluate an individual solution by itself, as long as there is a way to compare two solutions and determine which of them is better. An example can be a machine learning-based agent that drives a car in a simulated race. A genetic algorithm can optimize and tune the agent by having different versions of it compete against each other to determine which version is better.
InfoQ: What are the best use cases for genetic algorithms?
Wirsansky: The most common use case is where we need to assemble a solution using a combination of many different available parts; we want to select the best combination, but the number of possible combinations is too large to try them all. Genetic algorithms can usually find a good combination within a reasonable amount of time. Examples can be scheduling personnel, planning of delivery routes, designing bridge structures, and also constructing the best machine learning model from many available building blocks, or finding the best architecture for a deep learning model.
Another interesting use case is where the evaluation is based on peoples opinion or response. For example, you can use the genetic algorithm approach to determine the design parameters for a web sitesuch as color palette, font size, and location of components on the pagethat will achieve the best response from customers, such as conversion or retention. This idea can also be used for genetic art artificially created paintings or music that prove pleasant to the human eye (or ear).
Genetic algorithms can also be used for ongoing optimizationcases where the best solution may change over time. The algorithm can run continuously within the changing environment and respond dynamically to these changes by updating the best solution based on the current generation.
InfoQ: How can genetic algorithms select the best subset of features for supervised learning?
Wirsansky: In many cases, reducing the number of featuresused as inputs for a model in supervised learningcan increase the models accuracy, as some of the features may be irrelevant or redundant. This will also result in a simpler, better generalizing model. But we need to figure out which are the features that we want to keep. As this comes down to finding the best combination of features out of a potentially immense number of possible combinations, genetic algorithms provide a very practical approach. Each potential solution is represented by a list of booleans, one for each feature.
The value of the boolean (0 or 1) represents the absence or presence of the corresponding feature. These lists of boolean values are used as genetic material, that can be exchanged between solutions when we mate them, or even mutated by flipping values randomly. Using these mating and mutation operations, we create new generations out of preceding ones, while giving an advantage to solutions that yielded better performing models. After a while, we can have some good solutions, each representing a subset of the features. This is demonstrated in Chapter 7 of the book (our sample chapter) with the UCI Zoo dataset using python code, where the best performance was achieved by selecting six particular features out of the original sixteen.
InfoQ: What are the benefits that we can get from using genetic algorithms with machine learning for hyperparameter tuning?
Wirsansky: Every machine learning model utilizes a set of hyperparametersvalues that are set before the training takes place and affect the way the learning is done. The combined effect of hyperparameters on the performance of the model can be significant. Unfortunately, finding the best combination of the hyperparameter valuesalso known as hyperparameter tuningcan be as difficult as finding a needle in a haystack.
Two common approaches are grid search and random search, each with its own disadvantages. Genetic algorithms can be used in two ways to improve upon these methods. One way is by optimizing the grid search, so instead of trying out every combination on the grid, we can search only a subset of combinations but still get a good combination. The other way is to conduct a full search over the hyperparameter space, as genetic algorithms are capable of handling a large number of parameters as well as different parameter types continuous, discrete and categorical. These two approaches are demonstrated in Chapter 8 of the book with the UCI Wine dataset using python code.
InfoQ: How can genetic algorithms be used in Reinforcement Learning?
Wirsansky: Reinforcement Learning (RL) is a very exciting and promising branch of machine learning, with the potential to handle complex, everyday-life-like tasks. Unlike supervised learning, RL does not present an immediate 'right/wrong' feedback, but instead provides an environment where a longer-term, cumulative reward is sought after. This kind of setting can be viewed as an optimization problem, another area where genetic algorithms excel.
As a result, genetic algorithms can be utilized for reinforcement learning in several different ways. One example can be determining the weights and biases of a neural network that interacts with its environment by mapping input values to output values. Chapter 10 of the book includes two examples of applying genetic algorithms to RL tasks, using the OpenAI Gym environments mountain-car and cart-pole.
InfoQ: What is bio-inspired computing?
Wirsansky: Genetic algorithms are just one branch within a larger family of algorithms called Evolutionary Computation, all inspired by Darwinian evolution. One particularly interesting member of this family is Genetic Programming, that evolves computer programs aiming to solve a specific problem. More broadly, as evolutionary computation techniques are based on various biological systems or behaviors, they can be considered part of the algorithm family known as Bio-inspired Computing.
Among the many fascinating members of this family are Ant Colony Optimizationimitating the way certain species of ants locate food and mark the paths to it, giving advantage to closer and richer locations of food; Artificial Immune Systems, capable of identifying and learning new threats, as well as applying the acquired knowledge and respond faster the next time a similar threat is detected; and Particle Swarm Optimization, based on the behavior of flocks of birds or schools of fish, where individuals within the group work together towards a common goal without central supervision.
Another related, broad field of computation is Artificial Life, involving systems and processes imitating natural life in different ways, such as computer simulations and robotic systems. Chapter 12 of the book includes two relevant Python-written examples, one solving a problem using genetic programming, and the otherusing particle swarm optimization.
Eyal Wirsansky is a senior software engineer, a technology community leader, and an artificial intelligence researcher and consultant. Eyal started his software engineering career as a pioneer in the field of voice over IP, and he now has over 20 years' experience of creating a variety of high-performing enterprise solutions. While in graduate school, he focused his research on genetic algorithms and neural networks. One outcome of his research is a novel supervised machine learning algorithm that combines the two. Eyal leads the Jacksonville (FL) Java user group, hosts the Artificial Intelligence for Enterprise virtual user group, and writes the developer-oriented artificial intelligence blog, ai4java.
Continued here:
Q&A on the Book Hands-On Genetic Algorithms with Python - InfoQ.com
- Genetic Discrimination Is Coming for Us All - The Atlantic - November 16th, 2024
- Family connection: Genetics of suicide - WNEM - November 16th, 2024
- Study links heart shape to genetic risk of cardiovascular diseases - News-Medical.Net - November 16th, 2024
- Genetic architecture of cerebrospinal fluid and brain metabolite levels and the genetic colocalization of metabolites with human traits - Nature.com - November 16th, 2024
- Genetic connectivity of wolverines in western North America - Nature.com - November 16th, 2024
- Toward GDPR compliance with the Helmholtz Munich genotype imputation server - Nature.com - November 16th, 2024
- Leveraging genetic variations for more effective cancer therapies - News-Medical.Net - November 16th, 2024
- Bringing precision to the murky debate on fish oil - University of Arizona News - November 16th, 2024
- International experts gathered in Tashkent to tackle rare disease for Uzbekistan - EurekAlert - November 16th, 2024
- Mercys Story: Living life with 22q, a genetic condition - WECT - November 16th, 2024
- Cold case with ties to Houghton County solved through genetic genealogy after 65 years - WLUC - November 16th, 2024
- 23andMe customer? Here's what to know about the privacy of your genetic data. - CBS News - November 16th, 2024
- Single-cell RNA analysis finds possible genetic drivers of bone cancer - Illumina - November 16th, 2024
- Multi-trait association analysis reveals shared genetic loci between Alzheimers disease and cardiovascular traits - Nature.com - November 16th, 2024
- With 23andMe Struck by Layoffs, Can You Delete Genetic Data? Here's What We Know - CNET - November 16th, 2024
- Genetic testing firm 23andMe cuts 40% of its workforce amid financial struggles - The Guardian - November 16th, 2024
- Genetic study solves the mystery of 'selfish' B chromosomes in rye - Phys.org - November 16th, 2024
- Genetic changes linked to testicular cancer offer fresh insights into the disease - Medical Xpress - November 16th, 2024
- Eating less and genetics help you to live longer, but which factor carries the most weight? - Surinenglish.com - November 16th, 2024
- We must use genetic technologies now to avert the coming food crisis - New Scientist - November 16th, 2024
- NHS England to screen 100,000 babies for more than 200 genetic conditions - The Guardian - October 6th, 2024
- Largest-ever genetic study of epilepsy finds possible therapeutic targets - Medical Xpress - October 6th, 2024
- 23andMe is on the brink. What happens to all its DNA data? - NPR - October 6th, 2024
- The mountains where Neanderthals forever changed human genetics - Big Think - October 6th, 2024
- Gene Activity in Depression Linked to Immune System and Inflammation - Neuroscience News - October 6th, 2024
- Integrative multi-omics analysis reveals genetic and heterotic contributions to male fertility and yield in potato - Nature.com - October 6th, 2024
- Genetic and non-genetic HLA disruption is widespread in lung and breast tumors - Nature.com - October 6th, 2024
- Aneuploidy as a driver of human cancer - Nature.com - October 6th, 2024
- Myriad Genetics and Ultima Genomics to Explore the UG - GlobeNewswire - October 6th, 2024
- Biallelic and monoallelic variants in EFEMP1 can cause a severe and distinct subtype of heritable connective tissue disorder - Nature.com - October 6th, 2024
- Genetic and clinical correlates of two neuroanatomical AI dimensions in the Alzheimers disease continuum - Nature.com - October 6th, 2024
- Cracking the Genetic Code on Facial Features - DISCOVER Magazine - October 6th, 2024
- Ancestry vs. 23andMe: How to Pick the Best DNA Testing Kit for You - CNET - October 6th, 2024
- The Mercedes-AMG C63 is bold, but beholden to its genetics - Newsweek - October 6th, 2024
- The Austin Chronic: Texas A&Ms Hemp Breeding Program Adds Drought-Resistant Genetics to the National Collection - Austin Chronicle - October 6th, 2024
- Genetics and AI Help Patients with Early Detection of Breast Cancer Risk - Adventist Review - October 6th, 2024
- 23andMe Is Sinking Fast. Can the Company Survive? - WIRED - October 6th, 2024
- Genetic variations in remote UK regions linked to higher disease risk - Medical Xpress - October 6th, 2024
- Comprehensive mapping of genetic activity brings hope to patients with chronic pain - Medical Xpress - October 6th, 2024
- Genetics - Definition, History and Impact | Biology Dictionary - June 2nd, 2024
- Gene | Definition, Structure, Expression, & Facts | Britannica - June 2nd, 2024
- Raha Kapoor's blue eyes remind fans of her great-grandfather, Raj Kapoor; here's what genetics says - IndiaTimes - December 30th, 2023
- Human genetics | Description, Chromosomes, & Inheritance - December 13th, 2023
- BASIC GENETICS INFORMATION - Understanding Genetics - NCBI Bookshelf - December 13th, 2023
- Introduction to Genetics - Open Textbook Library - December 13th, 2023
- "When them genetics kick in its all over" - NBA fans send in rib-tickling reactions as LeBron James attends Zhuri James' volleyball game -... - October 16th, 2023
- David Liu, chemist: We now have the technology to correct misspellings in our DNA that cause known genetic diseases - EL PAS USA - April 7th, 2023
- World Health Day 2023: Understanding the science of Epi-genetics and how to apply it in our daily lives - Free Press Journal - April 7th, 2023
- Genetics - National Institute of General Medical Sciences (NIGMS) - March 29th, 2023
- GENETICS 101 - Understanding Genetics - NCBI Bookshelf - March 29th, 2023
- People always think Im skinny because of good genetics theyre shocked when they see what I used to lo... - The US Sun - March 29th, 2023
- Forensics expert explains 'genetic genealogy' process believed to be used in Kohberger's arrest - KTVB.com - January 6th, 2023
- Idaho student murders: What is genetic genealogy, a tool reportedly used to help capture the suspect? - FOX 10 News Phoenix - January 6th, 2023
- What is a Genetic Counselor and How Can They Help You Navigate Your Healthcare Journey? - ABC4.com - December 3rd, 2022
- Ancient Art and Genetics Reveal Origin of World's Most Expensive Spice - The Wire Science - June 26th, 2022
- Myriad Genetics Teams Up with Epic to Make Genetic Testing Accessible to More Patients with Electronic Health Record (EHR) Integration - GlobeNewswire - June 26th, 2022
- Obesity and genetics: Expert shares insights - Hindustan Times - June 26th, 2022
- Researchers discover genetic variants that increase Alzheimer's risk - WCVB Boston - June 26th, 2022
- Where science meets fiction: the dark history of eugenics - The Guardian - June 26th, 2022
- Clinical Conference: A Discussion with BASE10 Genetics - Skilled Nursing News - June 26th, 2022
- Genetics Really Said Copy And Paste: People Are Amazed At How Similar This Woman Looks To Her Dad In These 5 Recreation Photos - Bored Panda - June 26th, 2022
- 49 Genetic Variants That Increase the Risk of Varicose Veins Identified - Technology Networks - June 26th, 2022
- Genetic relationships and genome selection signatures between soybean cultivars from Brazil and United States after decades of breeding | Scientific... - June 26th, 2022
- Earlham woman loses weight with ChiroThin after her own doctor told her "genetics" wouldn't allow that to happen | Paid Content - Local 5 -... - June 26th, 2022
- Science and genetics used to boost Fernside farm - New Zealand Herald - June 26th, 2022
- Genetics-based guidelines to buying a bull at an auction - Farmer's Weekly SA - June 26th, 2022
- Polio: we're developing a safer vaccine that uses no genetic material from the virus - The Conversation - June 26th, 2022
- 7 lifestyle habits which can halve your risk of dementia - World Economic Forum - June 26th, 2022
- Addressing the 'Trust Factor': South Carolina Researchers Tackle Health Disparities Using Genetics - Physician's Weekly - June 8th, 2022
- Dumb luck, genetics? Why have some people never caught COVID-19? | Daily Sabah - Daily Sabah - June 8th, 2022
- Genetics Breakthrough in Sea Urchins to Aid in Biomedical Research - Scripps Institution of Oceanography - June 8th, 2022
- Genetic Control Of Autoimmune Disease Mapped To Cellular Level - Bio-IT World - June 8th, 2022
- Bazelet to Supply Its Federally Legal Cannabis Genetics to DEA Approved Research Entities for Rigorous Scientific Research on the Clinical Effects of... - June 8th, 2022
- Alameda County Awaits Key Decision Regarding The Use of Genetic Testing in Asbestos Cases - JD Supra - June 8th, 2022
- Diversity in Genetic Research Is Key to Enhancing Treatment of Chronic Diseases in Africa - Technology Networks - June 8th, 2022
- CSU partners with American Hereford Association on genetics research - Beef Magazine - June 8th, 2022
- Unraveling the Tangled History of Polar Bears to Brown Bears Using Genetic Sequencing - Nature World News - June 8th, 2022
- Did My Lifestyle or Genetics Cause ATTR-CM? Learning More About This Heart Condition That Often Goes Misdiagnosed - SurvivorNet - June 8th, 2022
- Your genes affect your education. Here's why that's controversial. - Big Think - June 8th, 2022
- Study mines cancer genetics to help with targeted treatment - ABC News - April 26th, 2022