Metaheuristic Optimization 14. Genetic Programming 思 Thomas Weise ó 汤卫 [email protected] ó http://iao.hfuu.edu.cn Hefei University, South Campus 2 合肥学院 南艳湖校区/南2区 Faculty of Computer Science and Technology 计算机科学与技术系 Institute of Applied Optimization 应用优化研究所 230601 Shushan District, Hefei, Anhui, China 中国 安徽省 合肥市 蜀山区 230601 Econ. & Tech. Devel. Zone, Jinxiu Dadao 99 经济技术开发区 锦绣大道99号 Outline 1 Introduction 2 Symbolic Regression 3 Genetic Programming 4 Tree Creation 5 Data Mining 6 Bloat 7 Representations in GP website 8 Epistasis Metaheuristic Optimization Thomas Weise 2/84 Section Outline 1 Introduction 2 Symbolic Regression 3 Genetic Programming 4 Tree Creation 5 Data Mining 6 Bloat 7 Representations in GP 8 Epistasis Metaheuristic Optimization Thomas Weise 3/84 Introduction What is Genetic Programming? Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. population-based optimization algorithm Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. population-based optimization algorithm proceeds in iterations (called generations) Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. population-based optimization algorithm proceeds in iterations (called generations) population undergoes survival selection in each generation Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. population-based optimization algorithm proceeds in iterations (called generations) population undergoes survival selection in each generation selected individuals can reproduce via mutation and recombination Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. population-based optimization algorithm proceeds in iterations (called generations) population undergoes survival selection in each generation selected individuals can reproduce via mutation and recombination But what does it optimize? What is it good for? What is the difference to a Genetic Algorithm, Evolution Strategy, or Differential Evolution? Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. But what does it optimize? What is it good for? What is the difference to a Genetic Algorithm, Evolution Strategy, or Differential Evolution? 1 It evolves programs or Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. But what does it optimize? What is it good for? What is the difference to a Genetic Algorithm, Evolution Strategy, or Differential Evolution? 1 It evolves programs or 2 tree or graph data structures. Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. But what does it optimize? What is it good for? What is the difference to a Genetic Algorithm, Evolution Strategy, or Differential Evolution? 1 It evolves programs or 2 tree or graph data structures. Programs in the wider sense of the word: Algorithm-like, interpretable in- structions. A formula is a program, a decision tree is a program etc. Metaheuristic Optimization Thomas Weise 4/84 Introduction What is Genetic Programming? Genetic Programming is an Evolutionary Algorithm. But what does it optimize? What is it good for? What is the difference to a Genetic Algorithm, Evolution Strategy, or Differential Evolution? 1 It evolves programs or 2 tree or graph data structures. Programs in the wider sense of the word: Algorithm-like, interpretable in- structions. A formula is a program, a decision tree is a program etc. [1–3] [4] Made popular by Koza , but earlier works by e.g., Fogel et al. , Smith [5], Forsyth [6–8], Cramer [9], Schmidhuber [10, 11], Hicklin [12], and Fujuki [13] Metaheuristic Optimization Thomas Weise 4/84 What’s it good for? So what is Genetic Programming good for? Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance [2, 3, 16, 22, 24, 27, 30, 33, 38, 39, 52, 63–67, 69, 71–96] Engineering Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance [2, 3, 16, 22, 24, 27, 30, 33, 38, 39, 52, 63–67, 69, 71–96] Engineering [52, 61, 74, 81, 83, 97] Systems Security Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance [2, 3, 16, 22, 24, 27, 30, 33, 38, 39, 52, 63–67, 69, 71–96] Engineering [52, 61, 74, 81, 83, 97] Systems Security [19, 27, 61, 70–73, 75–77, 82, 83, 90–92, 96–109] Networking and Communication Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance [2, 3, 16, 22, 24, 27, 30, 33, 38, 39, 52, 63–67, 69, 71–96] Engineering [52, 61, 74, 81, 83, 97] Systems Security [19, 27, 61, 70–73, 75–77, 82, 83, 90–92, 96–109] Networking and Communication [70, 90, 91, 95, 102, 110–113] Multi-Agent Systems / Behaviors Just to name a few. Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance [2, 3, 16, 22, 24, 27, 30, 33, 38, 39, 52, 63–67, 69, 71–96] Engineering [52, 61, 74, 81, 83, 97] Systems Security [19, 27, 61, 70–73, 75–77, 82, 83, 90–92, 96–109] Networking and Communication [70, 90, 91, 95, 102, 110–113] Multi-Agent Systems / Behaviors Just to name a few. [38, 39, 71–73, 82, 99, 104–106, 114–118] Chemistry Metaheuristic Optimization Thomas Weise 5/84 What’s it good for? So what is Genetic Programming good for? [3, 9, 14–33] Maths / Symbolic Regression [34–36] Art [2, 16, 26, 37–40] Computer Graphics [6, 8, 37–39, 41–62] Data Mining [2, 3, 16, 24, 30, 33, 63–69] Circuit Design / Digital Technology [38, 39, 43, 46, 47, 59] Prediction [31, 33, 43–47, 70] Economy and Finance [2, 3, 16, 22, 24, 27, 30, 33, 38, 39, 52, 63–67, 69, 71–96] Engineering [52, 61, 74, 81, 83, 97] Systems Security [19, 27, 61, 70–73, 75–77, 82, 83, 90–92, 96–109] Networking and Communication [70, 90, 91, 95, 102, 110–113] Multi-Agent Systems / Behaviors Just to name a few.