DOCSLIB.ORG

Arxiv:1903.02915V2 [Cs.NE] 17 Apr 2019 an Important Factor That Has Ignited the Widespread Adop- Namic Problems

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Arxiv:1903.02915V2 [Cs.NE] 17 Apr 2019 an Important Factor That Has Ignited the Widespread Adop- Namic Problems jMetalPy: a Python Framework for Multi-Objective Optimization with Metaheuristics Antonio Ben´ıtez-Hidalgoa, Antonio J. Nebroa, Jose´ Garc´ıa-Nietoa, Izaskun Oregib, Javier Del Serb,c,d aDepartamento de Lenguajes y Ciencias de la Computaci´on,Ada Byron Research Building, University of M´alaga, 29071 M´alaga, Spain bTECNALIA, 48160 Derio, Spain cUniversity of the Basque Country (UPV/EHU), 48013 Bilbao, Spain dBasque Center for Applied Mathematics (BCAM), 48009 Bilbao, Spain Abstract This paper describes jMetalPy, an object-oriented Python-based framework for multi-objective optimization with metaheuristic techniques. Building upon our experiences with the well-known jMetal framework, we have developed a new multi-objective optimization software platform aiming not only at replicating the former one in a different programming language, but also at taking advantage of the full feature set of Python, including its facilities for fast prototyping and the large amount of available libraries for data processing, data analysis, data visualization, and high-performance computing. As a result, jMetalPy provides an environment for solving multi-objective optimization problems focused not only on traditional metaheuristics, but also on techniques supporting preference articulation and dynamic problems, along with a rich set of features related to the automatic generation of statistical data from the results generated, as well as the real-time and interactive visualization of the Pareto front approximations produced by the algorithms. jMetalPy offers additionally support for parallel computing in multicore and cluster systems. We include some use cases to explore the main features of jMetalPy and to illustrate how to work with it. Keywords: Multi-Objective Optimization, Metaheuristics, Software Framework, Python, Statistical Analysis, Visualization 1. Introduction publicly available in GitHub1. In this paper, we present jMetalPy, a new multi-objective Multi-objective optimization problems are widely found in optimization framework written in Python. Our motivation for many disciplines [1, 2], including engineering, economics, lo- developing jMetalPy stems from our past experience with jMetal gistics, transportation or energy, among others. They are char- and from the fact that nowadays Python has become a very acterized by having two or more conflicting objective functions prominent programming language with a plethora of interest- that have to be maximized or minimized at the same time, with ing features, which enables fast prototyping fueled by its large their optimum composed by a set of trade-off solutions known ecosystem of libraries for numerical and scientific computing as Pareto optimal set. Besides having several objectives, other (NumPy [7], Scipy [8]), data analysis (Pandas), machine learn- factors can make this family of optimization problems particu- ing (Scikit-learn [9]), visualization (Matplotlib [10], Holoviews larly difficult to tackle and solve with exact techniques, such as [11], Plotly [12]), large-scale processing (Dask [13], PySpark deceptiveness, epistasis, NP-hard complexity, or high dimen- [14]) and so forth. Our goal is not only to rewrite jMetal in sionality [3]. As a consequence, the most popular techniques to Python, but to focus mainly on aspects where Python can help deal with complex multi-objective optimization problems are fill the gaps not covered by Java. In particular, we place our metaheuristics [4], a family of non-exact algorithms including interest in the analysis of results provided by the optimization evolutionary algorithms and swarm intelligence methods (e.g. algorithms, real-time and interactive visualization, preference ant colony optimization or particle swarm optimization). articulation for supporting decision making, and solving dy- arXiv:1903.02915v2 [cs.NE] 17 Apr 2019 An important factor that has ignited the widespread adop- namic problems. Furthermore, since Python can be thought of tion of metaheuristics is the availability of software tools eas- as a more agile programming environment for prototyping new ing their implementation, execution and deployment in practi- multi-objective solvers, jMetalPy also incorporates a full suite cal setups. In the context of multi-objective optimization, one of statistical significance tests and related tools for the sake of of the most acknowledged frameworks is jMetal [5], a project a principled comparison among multi-objective metaheuristics. started in 2006 that has been continuously evolving since then, jMetalPy has been developed by Computer Science engi- including a full redesign from scratch in 2015 [6]. jMetal is im- neers and scientists to support research in multi-objective op- plemented in Java under the MIT licence, and its source code is timization with metaheuristics, and to utilize the provided al- gorithms for solving real-word problems. Following the same Email addresses: [email protected] (Antonio Ben´ıtez-Hidalgo), [email protected] (Antonio J. Nebro), [email protected] (Jose´ 1jMetal: https://github.com/jMetal/jMetal. As of April 18, 2019, Garc´ıa-Nieto), [email protected] (Izaskun Oregi), the papers about jMetal had accumulated more than 1280 citations (source: [email protected] (Javier Del Ser) Google Scholar) Preprint submitted to journal (under review) April 18, 2019 open source philosophy as in jMetal, jMetalPy is released un- Our purpose of this paper is to describe jMetalPy, and to der the MIT license. The project is in continuous development, illustrate how it can be used by members of the community in- with its source code hosted in GitHub2, where the last stable terested in experimenting with metaheuristics for solving multi- and current development versions can be freely obtained. objective optimization problems. To this end, we include some The main features of jMetalPy are summarized as follows: implementation use cases based on NSGA-II to explore the main variants considered in jMetalPy, from standard versions • jMetalPy is implemented in Python (version 3.6+), and its (generational and steady state), to dynamic, reference-point based, object-oriented architecture makes it flexible and extensible. parallel and distributed flavors of this solver. A experimental • It provides a set of classical multi-objective metaheuristics use case is also described to exemplify how the statistical tests (NSGA-II [15], GDE3 [16], SMPSO [17], OMOPSO [18], and visualization tools included in jMetalPy can be used for MOEA/D [19]) and standard families of problems for bench- post-processing and analyzing the obtained results in depth. For marking (ZDT, DTLZ, WFG [2], and LZ09 [20]). background concepts and formal definitions of multi-objective optimization, we refer to our previous work in [5]. • Dynamic multi-objective optimization is supported, includ- The remaining of this paper is organized as follows. In Sec- ing the implementation of dynamic versions of NSGA-II and tion 2, a review of relevant related algorithmic software plat- SMPSO, as well as the FDA [21] problem family. forms is conducted to give an insight and rationale of the main differences and contribution of jMetalPy. Section 3 delves into • Reference point based preference articulation algorithms, such the jMetalPy architecture and its main components. Section 4 as SMPSO/RP [22] and versions of NSGA-II and GDE3, are explains a use case of implementation. Visualization facilities also provided. are described in Section 5, while a use case of experimentation • It implements quality indicators for multi-objective optimiza- with statistical procedures is explained in Section 6. Finally, tion, such as Hypervolume [23], Additive Epsilon [24] and Section 7 presents the conclusions and outlines further related Inverted Generational Distance [25]. work planned for the near future. • It provides visualization components to display the Pareto 2. Related Works front approximations when solving problems with two ob- jectives (scatter plot), three objectives (scatter plot 3D), and In the last two decades, a number of software frameworks many-objective problems (parallel coordinates graph and a devoted to the implementation of multi-objective metaheuris- tailored version of Chord diagrams). tics has been contributed to the community, such as ECJ [33], EvA [34], JCLEC-MO [35], jMetal [5, 6], MOEA Framework • Support for comparative studies, including a wide number of [36], and Opt4J [37], which are written in Java; ParadisEO- statistical tests and utilities (e.g. non-parametric test, post- MOEO [38], and PISA [39], developed in C/C++; and PlatEMO hoc tests, boxplots, CD plot), including the automatic gen- [40], implemented in Matlab. They all have in common the in- A eration of LTEX tables (mean, standard deviation, median, clusion of representative algorithms from the the state of the art, interquartile range) and figures in different formats. benchmark problems and quality indicators for performance as- • jMetalPy can cooperatively work alongside with jMetal. The sessment. latter can be used to run algorithms and compute the qual- As has been mentioned in the introduction, there is a grow- ity indicators, while the post-processing data analysis can be ing interest within the scientific community in software frame- carried out with jMetalPy. works implemented in Python, since this language offers a large ecosystem of libraries, most of them devoted to data analysis, • Parallel computing is supported based on Apache Spark [26] data processing and visualization. When it comes
Load more

Recommended publications
  • Appendix H: MOEA Software Availability
    H MOEA Software Availability H.1 Introduction This appendix describes some of the main public-domain MOEA software that is currently available. This description includes the following information: Name: Name of the software system Description: Any relevant information about the system Environment: Software environment for which the software is intended Language: Programming language in which the software is written Availability: Software availability Original sources of each of the systems analyzed are cited, but readers should be aware of the fact that many of these systems are also mirrored at the EMOO repository located at (see under Software): http://delta.cs.cinvestav.mx/~ccoello/EMOO/ with a mirror at: http://www.lania.mx/~ccoello/EMOO Note that although commercial software for multi-objective optimization also exists (e.g., iSIGHT, which is briefly described in Chapter 5), such systems are not included here, since we limited the contents of this appendix to public- domain software. 678 H MOEA Software Availability Table H.1: MOEA Software Name Description Environment Availability Metaheuristic Includes imple- Any platform Antonio J. Nebro Algorithms in mentations in supporting Java ([email protected]), or download Java (JMetal) Java of: NSGA-II at: http://neo.lcc.uma.es/metal/ [358], SPEA2 index.html [1712], PAES [858], OMOPSO [1546], AbYSS [1137], MOCell [1136]. It also includes several test functions Multiple- Includes: Pareto Linux/Unix; Andrzej Jaszkiewicz Objective Simulated An- Standard C++ ([email protected]) MetaHeuristics
    [Show full text]
  • Metaheuristic Optimization Frameworks: a Survey and Benchmarking
    Soft Comput DOI 10.1007/s00500-011-0754-8 ORIGINAL PAPER Metaheuristic optimization frameworks: a survey and benchmarking Jose´ Antonio Parejo • Antonio Ruiz-Corte´s • Sebastia´n Lozano • Pablo Fernandez Ó Springer-Verlag 2011 Abstract This paper performs an unprecedented com- and affordable time and cost. However, heuristics are parative study of Metaheuristic optimization frameworks. usually based on specific characteristics of the problem at As criteria for comparison a set of 271 features grouped in hand, which makes their design and development a com- 30 characteristics and 6 areas has been selected. These plex task. In order to solve this drawback, metaheuristics features include the different metaheuristic techniques appear as a significant advance (Glover 1977); they are covered, mechanisms for solution encoding, constraint problem-agnostic algorithms that can be adapted to incor- handling, neighborhood specification, hybridization, par- porate the problem-specific knowledge. Metaheuristics allel and distributed computation, software engineering have been remarkably developed in recent decades (Voß best practices, documentation and user interface, etc. A 2001), becoming popular and being applied to many metric has been defined for each feature so that the scores problems in diverse areas (Glover and Kochenberger 2002; obtained by a framework are averaged within each group of Back et al. 1997). However, when new are considered, features, leading to a final average score for each frame- metaheuristics should be implemented and tested, implying work. Out of 33 frameworks ten have been selected from costs and risks. the literature using well-defined filtering criteria, and the As a solution, object-oriented paradigm has become a results of the comparison are analyzed with the aim of successful mechanism used to ease the burden of applica- identifying improvement areas and gaps in specific tion development and particularly, on adapting a given frameworks and the whole set.
    [Show full text]
  • Automatic Configuration of Multi-Objective Optimizers and Multi-Objective Configuration
    Chapter 1 Automatic Configuration of Multi-objective Optimizers and Multi-objective Configuration Leonardo C. T. Bezerra1, Manuel López-Ibáñez2, and Thomas Stützle3 Abstract Heuristic optimizers are an important tool in academia and industry, and their performance-optimizing configuration requires a significant amount of expertise. As the proper configuration of algorithms is a crucial aspect in the engineering of heuristic algorithms, a significant research effort has been dedicated over the last years towards moving this step to the computer and, thus, make it automatic. These research efforts go way beyond tuning only numerical parameters of already fully defined algorithms, but exploit automatic configuration as a means for automatic algorithm design. In this chapter, we review two main aspects where the research on automatic configuration and multi-objective optimization intersect. The first is the automatic configuration of multi-objective optimizers, where we discuss means and specific approaches. In addition, we detail a case study that shows how these approaches can be used to design new, high-performing multi-objective evolutionary algorithms. The second aspect is the research on multi-objective configuration, that is, the possibility of using multiple performance metrics for the evaluation of algorithm configurations. We highlight some few examples in this direction. Key words: multi-objective optimization, automatic algorithm configuration, automatic configuration of multi-objective optimizers, automatic configuration considering multiple objectives Instituto Metrópole Digital (IMD), Universidade Federal do Rio Grande do Norte (UFRN), Natal, RN, Brazil ([email protected]) · Alliance Manchester Business School, University of Manchester, UK ([email protected]) · IRIDIA, Université Libre de Bruxelles (ULB), Brussels, Belgium ([email protected]).
    [Show full text]
  • Application of Computational Intelligence to Explore and Analyze System Architecture and Design Alternatives
    Scholars' Mine Doctoral Dissertations Student Theses and Dissertations Fall 2019 Application of computational intelligence to explore and analyze system architecture and design alternatives Gene Lesinski Follow this and additional works at: https://scholarsmine.mst.edu/doctoral_dissertations Part of the Systems Engineering Commons Department: Engineering Management and Systems Engineering Recommended Citation Lesinski, Gene, "Application of computational intelligence to explore and analyze system architecture and design alternatives" (2019). Doctoral Dissertations. 2837. https://scholarsmine.mst.edu/doctoral_dissertations/2837 This thesis is brought to you by Scholars' Mine, a service of the Missouri S&T Library and Learning Resources. This work is protected by U. S. Copyright Law. Unauthorized use including reproduction for redistribution requires the permission of the copyright holder. For more information, please contact [email protected]. APPLICATION OF COMPUTATIONAL INTELLIGENCE TO EXPLORE AND ANALYZE SYSTEM ARCHITECTURE AND DESIGN ALTERNATIVES by EUGENE JOSEPH LESINSKI III A DISSERTATION Presented to the Faculty of the Graduate Faculty of the MISSOURI UNIVERSITY OF SCIENCE AND TECHNOLOGY In Partial Fulfillment of the Requirements for the Degree DOCTOR OF PHILOSOPHY in SYSTEMS ENGINEERING 2019 Approved by: Steven Corns, PhD, Advisor Suzanna Long, PhD Cihan Dagli, PhD Stephen Raper, PhD Donald Wunsch, PhD John Farr, PhD 2019 Eugene Joseph Lesinski III All Rights Reserved iii PUBLICATION DISSERTATION OPTION This dissertation consists of four peer reviewed publications that have been published, accepted, or that will be submitted, which have been formatted in the style used by the Missouri University of Science & Technology. Paper I: Pages 13-29 is a paper that has been published in IEEE Conference on Evolutionary Computation.
    [Show full text]
  • Paradiseo-MO: from Fitness Landscape Analysis to Efficient
    ParadisEO-MO: From Fitness Landscape Analysis to Efficient Local Search Algorithms Jérémie Humeau, Arnaud Liefooghe, El-Ghazali Talbi, Sébastien Verel To cite this version: Jérémie Humeau, Arnaud Liefooghe, El-Ghazali Talbi, Sébastien Verel. ParadisEO-MO: From Fitness Landscape Analysis to Efficient Local Search Algorithms. [Research Report] RR-7871, 2012. hal- 00665421v1 HAL Id: hal-00665421 https://hal.inria.fr/hal-00665421v1 Submitted on 1 Feb 2012 (v1), last revised 4 Jun 2013 (v2) HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. ParadisEO-MO: From Fitness Landscape Analysis to Efficient Local Search Algorithms Jérémie Humeau, Arnaud Liefooghe, El-Ghazali Talbi, Sébastien Verel RESEARCH REPORT N° 7871 February 2012 Project-Team Dolphin ISSN 0249-6399 ISRN INRIA/RR--7871--FR+ENG ParadisEO-MO: From Fitness Landscape Analysis to Efficient Local Search Algorithms Jérémie Humeau∗, Arnaud Liefooghe†, El-Ghazali Talbi‡, Sébastien Verel§ Project-Team Dolphin Research Report n° 7871 — February 2012 — 34 pages Abstract: This document presents a general-purpose software framework dedicated to the design, the analysis and the implementation of local search algorithms: ParadisEO-MO. A sub- stantial number of single-solution based local search metaheuristics has been proposed so far, and an attempt of unifying existing approaches is here presented.
    [Show full text]
  • Evolutionary Algorithms and Other Metaheuristics in Water Resources: Current Status, Research Challenges and Future Directions*,**
    Environmental Modelling & Software 62 (2014) 271e299 Contents lists available at ScienceDirect Environmental Modelling & Software journal homepage: www.elsevier.com/locate/envsoft Position paper Evolutionary algorithms and other metaheuristics in water resources: Current status, research challenges and future directions*,** * H.R. Maier a, , Z. Kapelan b, J. Kasprzyk c, J. Kollat d, L.S. Matott e, M.C. Cunha f, G.C. Dandy a, M.S. Gibbs a, E. Keedwell b, A. Marchi a, A. Ostfeld g, D. Savic b, D.P. Solomatine h, i, J.A. Vrugt j, k, l, A.C. Zecchin a, B.S. Minsker m, E.J. Barbour n, G. Kuczera o, F. Pasha p, A. Castelletti q, M. Giuliani q, P.M. Reed r a School of Civil, Environmental and Mining Engineering, The University of Adelaide, Adelaide, SA 5005, Australia b College of Engineering, Mathematics and Physical Sciences, University of Exeter, Harrison Building, North Park Road, Exeter EX4 4QF, United Kingdom c Civil Environmental and Architectural Engineering Department, University of Colorado Boulder, UCB 428, Boulder, CO 80309, USA d DecisionVis, 315 S. Allen St., Ste 321, State College, PA 16801, USA e Center for Computational Research, University at Buffalo, Buffalo, NY 14203, USA f Department of Civil Engineering, University of Coimbra, Rua Luís Reis Santos e Polo II, 3030-788 Coimbra, Portugal g Civil and Environmental Engineering, Technion e Israel Institute of Technology, Haifa 32000, Israel h UNESCO-IHE Institute for Water Education, Delft, The Netherlands i Water Resources Section, Delft University of Technology, The Netherlands j Department of Civil and Environmental Engineering, University of California Irvine, Irvine, CA, USA k Department of Earth System Science, University of California Irvine, Irvine, CA, USA l Institute for Biodiversity and Ecosystem Dynamics, University of Amsterdam, Amsterdam, The Netherlands m Department of Civil and Environmental Engineering, 205 N.
    [Show full text]
  • And Many-Objective Evolutionary Algorithms
    Automatically Designing State-of-the-Art Multi- and Many-Objective Evolutionary Algorithms Leonardo C. T. Bezerra [email protected] Instituto Metrópole Digital (IMD), Universidade Federal do Rio Grande do Norte, Natal, RN, Brazil Downloaded from http://direct.mit.edu/evco/article-pdf/28/2/195/1858883/evco_a_00263.pdf by guest on 28 September 2021 Manuel López-Ibáñez [email protected] Alliance Manchester Business School, University of Manchester, UK Thomas Stützle [email protected] IRIDIA, CoDE, Université Libre de Bruxelles, Belgium https://doi.org/10.1162/evco_a_00263 Abstract A recent comparison of well-established multiobjective evolutionary algorithms (MOEAs) has helped better identify the current state-of-the-art by considering (i) pa- rameter tuning through automatic configuration, (ii) a wide range of different setups, and (iii) various performance metrics. Here, we automatically devise MOEAs with ver- ified state-of-the-art performance for multi- and many-objective continuous optimiza- tion. Our work is based on two main considerations. The first is that high-performing algorithms can be obtained from a configurable algorithmic framework in an auto- mated way. The second is that multiple performance metrics may be required to guide this automatic design process. In the first part of this work, we extend our previously proposed algorithmic framework, increasing the number of MOEAs, underlying evo- lutionary algorithms, and search paradigms that it comprises. These components can be combined following a general MOEA template, and an automatic configuration method is used to instantiate high-performing MOEA designs that optimize a given performance metric and present state-of-the-art performance.
    [Show full text]
  • Optimal Solution for Santa Fe Trail Ant Problem Using MOEA Framework
    International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 04 Issue: 04 | Apr -2017 www.irjet.net p-ISSN: 2395-0072 Optimal Solution for Santa Fe Trail Ant Problem using MOEA Framework Parneet Aulakh1, Sarvesh Chopra2 1Research Scholar, CT institute of engineering management and technology, Jalandhar,Punjab,India 2 Assistant Professor, CT institute of engineering management and technology, Jalandhar, India Abstract : Multi-objective optimization is also a most real problems. Pareto optimality considers significant topic for research from past few decades. This solutions to be superior or inferior to another solution is because of the multi-objective nature of real world only when it is superior in all objectives or inferior in all problems. Most of the real world problems are complex objectives, respectively. The Santa Fe Ant Problem is a and versatile in nature, and quite often need more than conventional ideal problem that has been studied over one conflicting objective functions to be optimized the past two decades and is still being rigorously simultaneously. Researchers have developed many multi- researched. Santa Fe Trail is well-known of its objective optimization procedures. Santa Fe Trail Ant reputation of being hard due to evolutionary computing Problem has been widely used to analyze experiment and methods not solving it at much higher effectiveness than examine various evolutionary computing methods and random search. NSGA II is an evolutionary algorithm in multi-objective optimization problems. In this, Santa Fe which the main advantage is that it handles multi- Trail Ant problem is solved in its best optimization valued objective solution given in sets of solutions, which solution using various techniques includes mainly Non- provide computation of an approximation of the entire dominated Sorting Genetic Algorithm (NSGA II), Simulated Pareto front.
    [Show full text]
  • Paradiseo-MOEO Arnaud Liefooghe, Laetitia Jourdan, El-Ghazali Talbi
    A software framework based on a conceptual unified model for evolutionary multiobjective optimization: ParadisEO-MOEO Arnaud Liefooghe, Laetitia Jourdan, El-Ghazali Talbi To cite this version: Arnaud Liefooghe, Laetitia Jourdan, El-Ghazali Talbi. A software framework based on a conceptual unified model for evolutionary multiobjective optimization: ParadisEO-MOEO. European Journal of Operational Research, Elsevier, 2011, 209 (2), pp.104-112. 10.1016/j.ejor.2010.07.023. hal-00522612 HAL Id: hal-00522612 https://hal.archives-ouvertes.fr/hal-00522612 Submitted on 1 Oct 2010 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. European Journal of Operational Research xxx (2010) xxx–xxx Contents lists available at ScienceDirect European Journal of Operational Research journal homepage: www.elsevier.com/locate/ejor Decision Support A software framework based on a conceptual unified model for evolutionary multiobjective optimization: ParadisEO-MOEO ⇑ Arnaud Liefooghe a,b, , Laetitia Jourdan a, El-Ghazali Talbi a,c a Université Lille 1, Laboratoire d’Informatique Fondamentale de Lille, UMR CNRS 8022, INRIA Lille-Nord Europe, Parc Scientifique de la Haute Borne, 40 Avenue Halley, 59650 Villeneuve d’Ascq, France b University of Coimbra, CISUC, Department of Informatics Engineering, Portugal c King Saud University, Riyadh, Saudi Arabia article info abstract Article history: This paper presents a general-purpose software framework dedicated to the design and the implementa- Received 24 April 2009 tion of evolutionary multiobjective optimization techniques: ParadisEO-MOEO.
    [Show full text]
  • Automatically Designing State-Of-The-Art Multi- and Many-Objective Evolutionary Algorithms
    Automatically Designing State-of-the-Art Multi- and Many-Objective Evolutionary Algorithms Leonardo C. T. Bezerra [email protected] Instituto Metrópole Digital (IMD), Universidade Federal do Rio Grande do Norte, Natal, RN, Brazil Manuel López-Ibáñez [email protected] Alliance Manchester Business School, University of Manchester, UK Thomas Stützle [email protected] IRIDIA, CoDE, Université Libre de Bruxelles, Belgium https://doi.org/10.1162/evco_a_00263 Abstract A recent comparison of well-established multiobjective evolutionary algorithms (MOEAs) has helped better identify the current state-of-the-art by considering (i) pa- rameter tuning through automatic configuration, (ii) a wide range of different setups, and (iii) various performance metrics. Here, we automatically devise MOEAs with ver- ified state-of-the-art performance for multi- and many-objective continuous optimiza- tion. Our work is based on two main considerations. The first is that high-performing algorithms can be obtained from a configurable algorithmic framework in an auto- mated way. The second is that multiple performance metrics may be required to guide this automatic design process. In the first part of this work, we extend our previously proposed algorithmic framework, increasing the number of MOEAs, underlying evo- lutionary algorithms, and search paradigms that it comprises. These components can be combined following a general MOEA template, and an automatic configuration method is used to instantiate high-performing MOEA designs that optimize a given performance metric and present state-of-the-art performance. In the second part, we propose a multiobjective formulation for the automatic MOEA design, which proves critical for the context of many-objective optimization due to the disagreement of es- tablished performance metrics.
    [Show full text]
  • And Many-Objective Evolutionary Algorithms
    Automatically Designing State-of-the-Art Multi- and Many-Objective Evolutionary Algorithms Leonardo C. T. Bezerra [email protected] Instituto Metrópole Digital (IMD), Universidade Federal do Rio Grande do Norte, Natal, RN, Brazil Manuel López-Ibáñez [email protected] Alliance Manchester Business School, University of Manchester, UK Thomas Stützle [email protected] IRIDIA, CoDE, Université Libre de Bruxelles, Belgium https://doi.org/10.1162/evco_a_00263 Abstract A recent comparison of well-established multiobjective evolutionary algorithms (MOEAs) has helped better identify the current state-of-the-art by considering (i) pa- rameter tuning through automatic configuration, (ii) a wide range of different setups, and (iii) various performance metrics. Here, we automatically devise MOEAs with ver- ified state-of-the-art performance for multi- and many-objective continuous optimiza- tion. Our work is based on two main considerations. The first is that high-performing algorithms can be obtained from a configurable algorithmic framework in an auto- mated way. The second is that multiple performance metrics may be required to guide this automatic design process. In the first part of this work, we extend our previously proposed algorithmic framework, increasing the number of MOEAs, underlying evo- lutionary algorithms, and search paradigms that it comprises. These components can be combined following a general MOEA template, and an automatic configuration method is used to instantiate high-performing MOEA designs that optimize a given performance metric and present state-of-the-art performance. In the second part, we propose a multiobjective formulation for the automatic MOEA design, which proves critical for the context of many-objective optimization due to the disagreement of es- tablished performance metrics.
    [Show full text]
  • Parallel Evolutionary Algorithms for Multi- Objective Optimization
    Parallel evolutionary algorithms for multi- objective optimization Prof. El-Ghazali TALBI University Lille 1 [email protected] www.lifl.fr/~talbi Motivations . High-dimensional and complex optimization problems in many areas of academic and industrial concern Telecommunication, genomics, transportation, engineering design, … . Metaheuristics (ex. EAs) reduce the computational complexity of search BUT Parallel issue remains important: . More and more complex metaheuristics . Huge search space . CPU or memory intensive of the objective function Motivations . Rapid development of technology . Processors: Multi-core processors, GPU, … . Networks (LAN & WAN): Myrinet, Infiniband, Optical networks, … . Data storage . Increasing ratio performance / cost Goals . Speedup the search real-time and interactive optimization methods, dynamic optimisation, … . Improve quality of solutions cooperation, better even on a single processor . Improve robustness (different instances, design space) . Solving large problems instances, accuracy of mathematics models Taxonomy of metaheuristics Metaheuristics Single Population solution Hill Simulated Tabu Evol. Swarm Climbing annealing search algorithms optimisation . Solution-based metaheuristics: Hill Climbing, Simulated Annealing, Tabu Search, VNS, … . Population-based metaheuristics: Evolutionary Algorithms, Scatter Search, Swarm optimization, … Outline . Parallel Metaheuristics: Design issues . Parallel Metaheuristics: Implementation issues . Hardware platforms, Programming models . Performance
    [Show full text]