Differential Evolution with Local Information for Neuro-Fuzzy Systems Optimisation ⇑ Ming-Feng Han , Chin-Teng Lin, Jyh-Yeong Chang

Total Page:16

File Type:pdf, Size:1020Kb

Differential Evolution with Local Information for Neuro-Fuzzy Systems Optimisation ⇑ Ming-Feng Han , Chin-Teng Lin, Jyh-Yeong Chang Knowledge-Based Systems 44 (2013) 78–89 Contents lists available at SciVerse ScienceDirect Knowledge-Based Systems journal homepage: www.elsevier.com/locate/knosys Differential evolution with local information for neuro-fuzzy systems optimisation ⇑ Ming-Feng Han , Chin-Teng Lin, Jyh-Yeong Chang Institute of Electrical Control Engineering, National Chiao Tung University, 1001 University Road, Hsinchu 300, Taiwan, ROC article info abstract Article history: This paper proposes a differential evolution with local information (DELI) algorithm for Takagi–Sugeno– Received 3 October 2012 Kang-type (TSK-type) neuro-fuzzy systems (NFSs) optimisation. The DELI algorithm uses a modified Received in revised form 21 December 2012 mutation operation that considers a neighbourhood relationship for each individual to maintain the Accepted 23 January 2013 diversity of the population and to increase the search capability. This paper also proposes an adaptive Available online 4 February 2013 fuzzy c-means method for determining the number of rules and for identifying suitable initial parameters for the rules. Initially, there are no rules in the NFS model; the rules are automatically generated by the Keywords: fuzzy measure and the fuzzy c-means method. Until the firing strengths of all of the training patterns sat- Neuro-fuzzy systems (NFSs) isfy a pre-specified threshold, the process of rule generation is terminated. Subsequently, the DELI algo- Differential evolution (DE) Neuro-fuzzy systems optimisation rithm optimises all of the free parameters for NFSs design. To enhance the performance of the DELI Evolutionary algorithm (EA) algorithm, an adaptive parameter tuning based on the 1/5th rule is used for the tuning scale factor F. Optimisation The 1/5th rule dynamically adjusts the tuning scale factor in each period to enhance the search capability of the DELI algorithm. Finally, the proposed NFS with DELI model (NFS-DELI) is applied to nonlinear con- trol and prediction problems. The results of this paper demonstrate the effectiveness of the proposed NFS-DELI model. Crown Copyright Ó 2013 Published by Elsevier B.V. All rights reserved. 1. Introduction mise the sophisticated membership functions for a nonlinear water-level control system. Seng [20] proposed a neuro-fuzzy net- The popular research topic of neuro-fuzzy systems (NFSs) has work that was based on the radial basis function neural network in been successfully applied to many areas [1–10]. Such systems which all of the parameters are tuned simultaneously using a GA. bring both low-level learning and computational power of neural Juang [22] successfully applied a GA to TSK-type recurrent neu- networks into fuzzy systems and the high-level, human-like think- ro-fuzzy system design for control problems. ing and reasoning of fuzzy systems to neural networks. To train the Another category of EAs for NFSs design called particle swarm parameters for designing an NFS, many papers had employed the optimisation (PSO) appears to provide efficient and powerful backpropagation (BP) algorithm [1,8–10]. The BP algorithm is a search capability in the search space; this evolutionary computa- powerful training technique that quickly minimises the error func- tion technique was developed by Kennedy and Eberhart in 1995 tion of the NFS. However, the BP algorithm may become trapped at [42]. The underlying motivation for the development of the PSO a local optimal solution and never find the global optimal solution. algorithm is the social behaviour of animals, such as bird flocking, To overcome this disadvantage, many researchers have proposed fish schooling and swarming. The PSO algorithm has been success- NFS design that uses evolutionary algorithms (EA) [11–23]. fully applied to many optimisation problems, such as NFSs design The genetic algorithm (GA) is one of the most well-known EAs. [23–26] for control problems, and has shown improved perfor- Many researchers have developed GAs to implement fuzzy systems mance over GAs. and neuro-fuzzy systems to automate the determination of param- Hybrid EAs have been investigated in many studies [27–30]. eters and structures [14–22].The genetic fuzzy system [8–17] was Such hybrids are frequently combinations of local searches and characterised using a fuzzy system as an individual in a genetic EA s, also known memetic algorithms [29,30]. A hybrid of a cultural operator. Russo [18] applied a GA to the design of fuzzy controller method and a cooperative PSO (CPSO) was applied in the design of membership functions, in which each fuzzy rule was treated as an a functional link-based neural fuzzy network (FLNFN) [27]; this individual. Ng and Li [19] applied chromosomes in a GA to opti- method was referred to as the FLNFN–CCPSO algorithm. In the FLNFN–CCPSO algorithm, a swarm optimises only one parameter of an FLNFN. Another hybrid EA was the combination of a GA and a PSO, which is called the HGAPSO algorithm [28]. In the HGA- ⇑ Corresponding author. Tel.: +886 3 5712121. PSO algorithm, new individuals are created by a combination of a E-mail addresses: [email protected] (M.-F. Han), [email protected] (C.-T. Lin), [email protected] (J.-Y. Chang). PSO and the crossover and mutation operations of a GA. 0950-7051/$ - see front matter Crown Copyright Ó 2013 Published by Elsevier B.V. All rights reserved. http://dx.doi.org/10.1016/j.knosys.2013.01.023 M.-F. Han et al. / Knowledge-Based Systems 44 (2013) 78–89 79 Moreover, the differential evolution (DE) algorithm, proposed Rulej : IF x1 is A1j and x2 is A2j and ...xn is Anj 1 by Storn and Price [31,32], which is an efficient global optimiser ð Þ THEN yj ¼ w0j þ w1jx1 þ ...þ wnjxn; in the continuous search domain. The DE algorithm employs the difference of two randomly selected individuals as the source of where x1, ..., xn are the input variables, yi is the system output random variations for third individual and applies to difficult opti- variable, A1i, ..., Ani are the linguistic terms of the pre-condition misation problems [31–39,52–54]. Comparison with GA, the DE part with a Gaussian membership function, n is the number of input algorithm is faster and easier EA. Further research [40] has pro- variables, and w0j, ..., wnj are the TSK weights. posed a modified DE (MODE) algorithm for an adaptive neural fuz- The architecture of four-layered NFS is shown in Fig. 1, which is zy network (ANFN-MODE) design. This MODE algorithm provides a comprised of the input, membership function, rule, and output lay- cluster-based mutation scheme for preventing the algorithm from ers. The operation functions of the nodes in each layer of the NFS (l) becoming trapped in the local optima of the search space. In addi- are described as follows, where O denotes the output of a node tion, the MODE algorithm has been applied to locally recurrent in the lth layer: NFSs design [41]. However, the MODE algorithm lacks a self- adaptive parameter tuning strategy for obtaining more reliable 2.1.1. Layer 1—input layer convergence performance [34,39]. No computation is performed in this layer. Each node in this This paper proposes a DELI algorithm for designing a TSK-type layer corresponds to one input variable and only transmits input NFS. Initially, there are no rules in the NFS model; the fuzzy rules values directly to the next layer. That is, are automatically generated by an adaptive fuzzy c-means method. ð1Þ O ¼ xi; ð2Þ Subsequently, all free parameters are learned by the proposed DELI algorithm. In the DELI algorithm, a self-adaptive parameter tuning where i =1,2,..., n are the input variables of the NFS. strategy based on the 1/5th rule is used to adjust the tuning scale factor F effectively. In the simulation, the proposed NFS with DELI 2.1.2. Layer 2—membership function layer model (NFS-DELI) is applied to nonlinear control and prediction Each node in this layer is a membership function that corre- problems. The contributions of this paper are summarized as sponds to the linguistic label of one of the input variables in layer follows: 1. In other words, the membership value specifies the degree to which an input value belongs to a fuzzy set and is calculated in (1) An adaptive fuzzy c-means method is proposed to determine layer 2 according to the expression: the number of rules for the NFS and identify suitable initial ð2Þ 2 2 parameters for an individual in the DELI algorithm. O ¼ lij ¼ exp ðxi À mijÞ =rij ; ð3Þ (2) The proposed DELI algorithm adopts a modified mutation where j =1,2,..., M, M is the number of rules in the NFS, and operation in evaluating the global best individual, the local m and r are the centre (mean) and the width (variance) of the best individual, and randomly chosen individuals for main- ij ij Gaussian membership function of the input variable, respectively. taining the diversity of population and increasing the search capability. 2.1.3. Layer 3—Rule layer (3) We also propose a self-adaptive parameter tuning strategy This layer receives one-dimensional membership degrees of the based on the 1/5th rule to effectively adjust the tuning scale associated rule from a set of nodes in layer 2. Here, the product factor F in the DELI algorithm and balance the exploitation operator is adopted to perform the precondition part of the fuzzy ability and the exploration ability. rules. As a result, the output function of each inference node is (4) Three simulations are conducted to evaluate the perfor- mance of the NFS-DELI algorithm. Comparisons with other EAs demonstrate the superiority of the performance of the NFS-DELI model. (5) In the simulation, we use non-parametric Wilcoxon signed- rank test to verify the statistical significance.
Recommended publications
  • Application of Fuzzy Differential Evolutionary Algorithms in Biological Data Mining
    International Journal of Scientific & Engineering Research Volume 10, Issue 1, January-2019 1379 ISSN 2229-5518 Application of Fuzzy Differential Evolutionary Algorithms in Biological Data Mining S.Poongothai1,*, C.Dharuman2 , P. Venkatesan3 1Asst. Professor, Department of Mathematics, SRM University, Ramapuram Campus, Chennai, India. 2 Professor, Department of Mathematics, SRM University, Ramapuram Campus, Chennai, India. 3Faculty of Research, Sri Ramachandra University, Chennai, India. *Corresponding author: [email protected] Abstract In the world, everyday massive quantity of statistics being generated at a fee some distance higher than via which it could be tested by means of human comprehension alone, data mining became an essential undertaking for extracting as plenty useful data from this statistical data as possible. The standardized data mining techniques are appropriate enough to a positive extent but they are restrained by some limitations, and particularly for those cases that evolutionary approaches performs greater as well as extra capable. In this paper, a nature inspired evolutionary strategies is used for data mining with unique connection with Differential algorithm. We additionally expand to the hybrid algorithms- Fuzzy Differential Algorithms. Keywords: Data mining, Fuzzy logic, Differential Evolutionary algorithm, FURIA, Hybrid FDE 1. Introduction In data mining, especially in medical field, various computerized tools and techniques provides many advantages in health related problems. Most commonly used technique is artificial intelligence in disease diagnosis [1-3]. Evolutionary Algorithms are the class of general purpose of stochastic optimization algorithms based on neo-Darwinian theory. Differential Genetic Algorithm is one of the branch of Evolutionary Algorithm is recognized as a significant stochastic search technique in the recent world [4].
    [Show full text]
  • Revisiting Evolutionary Algorithms in Feature Selection and Nonfuzzy/Fuzzy Rule Based Classification Satchidananda Dehuri1 and Ashish Ghosh2∗
    Advanced Review Revisiting evolutionary algorithms in feature selection and nonfuzzy/fuzzy rule based classification Satchidananda Dehuri1 and Ashish Ghosh2∗ This paper discusses the relevance and possible applications of evolutionary algo- rithms, particularly genetic algorithms, in the domain of knowledge discovery in databases. Knowledge discovery in databases is a process of discovering knowl- edge along with its validity, novelty,andpotentiality. Various genetic-based feature selection algorithms with their pros and cons are discussed in this article. Rule (a kind of high-level representation of knowledge) discovery from databases, posed as single and multiobjective problems is a difficult optimization problem. Here, we present a review of some of the genetic-based classification rule discovery methods based on fidelity criterion. The intractable nature of fuzzy rule mining using single and multiobjective genetic algorithms reported in the literatures is reviewed. An extensive list of relevant and useful references are given for further research. C 2013 Wiley Periodicals, Inc. How to cite this article: WIREs Data Mining Knowl Discov 2013. doi: 10.1002/widm.1087 INTRODUCTION is by means of data mining or knowledge discovery he current information era is characterized by from databases (KDD).3–6 Through data mining, in- T a great expansion in the volume of data that teresting knowledge7 can be extracted and the dis- are being generated by low-cost devices (e.g., scan- covered knowledge can be applied in the target field ners, bar code readers, sensors) and stored. Intu- to increase the working efficiency and to improve itively, this large amount of stored data contains valu- the quality of decision making.
    [Show full text]
  • Genetic Optimization of Fuzzy Membership Functions for Cloud Resource Provisioning
    Genetic optimization of fuzzy membership functions for cloud resource provisioning Amjad Ullah, Jingpeng Li, Amir Hussain Yindong Shen Division of Computing Science and Mathematics School of Automation University of Stirling Huazhong University of Science and Technology Stirling FK9 4LA, UK Wuhan 430074, China Email: faul,jli,[email protected] Email: [email protected] Abstract—The successful usage of fuzzy systems can be seen this paper aims to find near optimal parameter settings for the in many application domains owing to their capabilities to design of the used membership functions with an objective to model complex systems by exploiting knowledge of domain obtain more improved results, i.e. better system performance experts. Their accuracy and performance are, however, primarily dependent on the design of its membership functions and control by minimizing the Service Level Objective (SLO) violations rules. The commonly employed technique to design membership (explained in IV-B) and reduced system running cost. functions is to exploit the knowledge of domain experts. However, An FRBS consists of two ingredients: (i) a Rule Base (RB) in certain application domains, the knowledge of domain experts which is a collection of IF-Then rules, and (ii) a Data Base are limited and therefore, cannot be relied upon. Alternatively, (DB) which contains the definitions and semantics for the optimization techniques such as genetic algorithms are utilized to optimize the various design parameters of fuzzy systems. In linguistic terms of fuzzy sets. The commonly used approach this paper, we report a case study of optimizing the membership of designing an FRBS is to acquire knowledge from domain functions of a fuzzy system using genetic algorithm, which is experts and represent it using a DB and an RB [5].
    [Show full text]
  • A Rule-Based Symbiotic Modified Differential Evolution for Self-Organizing Neuro-Fuzzy Systems
    Applied Soft Computing 11 (2011) 4847–4858 Contents lists available at ScienceDirect Applied Soft Computing j ournal homepage: www.elsevier.com/locate/asoc A Rule-Based Symbiotic MOdified Differential Evolution for Self-Organizing Neuro-Fuzzy Systems a b c,∗ a Miin-Tsair Su , Cheng-Hung Chen , Cheng-Jian Lin , Chin-Teng Lin a Department of Electrical Engineering, National Chiao-Tung University, Hsinchu 300, Taiwan, ROC b Department of Electrical Engineering, National Formosa University, Yunlin County 632, Taiwan, ROC c Department of Computer Science and Information Engineering, National Chin-Yi University of Technology, Taichung 411, Taiwan, ROC a r t i c l e i n f o a b s t r a c t Article history: This study proposes a Rule-Based Symbiotic MOdified Differential Evolution (RSMODE) for Self- Received 9 March 2009 Organizing Neuro-Fuzzy Systems (SONFS). The RSMODE adopts a multi-subpopulation scheme that uses Received in revised form 24 March 2011 each individual represents a single fuzzy rule and each individual in each subpopulation evolves sepa- Accepted 26 June 2011 rately. The proposed RSMODE learning algorithm consists of structure learning and parameter learning Available online 8 July 2011 for the SONFS model. The structure learning can determine whether or not to generate a new rule- based subpopulation which satisfies the fuzzy partition of input variables using the entropy measure. Keywords: The parameter learning combines two strategies including a subpopulation symbiotic evolution and a Neuro-fuzzy systems modified differential evolution. The RSMODE can automatically generate initial subpopulation and each Symbiotic evolution individual in each subpopulation evolves separately using a modified differential evolution.
    [Show full text]
  • A Genetic-Fuzzy System for Optimising Agent Steering
    COMPUTER ANIMATION AND VIRTUAL WORLDS Comp. Anim. Virtual Worlds 2010; 21: 453–461 Published online 25 May 2010 in Wiley InterScience (www.interscience.wiley.com)........................................................................................... DOI: 10.1002/cav.360 A genetic-fuzzy system for optimising agent steering ..........................................................................By Anton Gerdelan* and Carol O’Sullivan Fuzzy controllers are a popular method for animated character perception and control. A drawback of fuzzy systems is that time intensive manual calibration of system parameters is required. We introduce a new Genetic-Fuzzy System (GFS) that automates the tuning process of rules for animated character steering. An advantage of our GFS is that it is able to adapt the rules for steering behaviour during run time. We explore the parameter space of the new GFS, and discuss how the GFS can be implemented to run as a background process during normal execution of a simulation. Copyright © 2010 John Wiley & Sons, Ltd. KEY WORDS: agent navigation and steering; genetic algorithms; fuzzy logic Introduction tances in meters, into members of discrete fuzzy sets such as near, medium or far. This process is called Fuzzy logic controllers are an elegant solution for agents fuzzification. controlling the motion of real time animated charac- (2) Designing the value of fuzzy sets for outputs from ters, creatures and vehicles because fuzzy controllers the controller. These could be steering angles light, produce outputs that transition smoothly, rather than sharp, and very sharp. Using a singleton model, each stepping between output states, and because they can set must correspond to a single crisp output value, in be implemented to allow agents to react to changing radians for example.
    [Show full text]
  • Heuristic Design of Fuzzy Inference Systems: a Review of Three Decades of Research
    Heuristic design of fuzzy inference systems: a review of three decades of research Article Accepted Version Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0 Ojha, V., Abraham, A. and Snášel, V. (2019) Heuristic design of fuzzy inference systems: a review of three decades of research. Engineering Applications of Artificial Intelligence, 85. pp. 845-864. ISSN 0952-1976 doi: https://doi.org/10.1016/j.engappai.2019.08.010 Available at http://centaur.reading.ac.uk/85784/ It is advisable to refer to the publisher’s version if you intend to cite from the work. See Guidance on citing . To link to this article DOI: http://dx.doi.org/10.1016/j.engappai.2019.08.010 Publisher: Elsevier All outputs in CentAUR are protected by Intellectual Property Rights law, including copyright law. Copyright and IPR is retained by the creators or other copyright holders. Terms and conditions for use of this material are defined in the End User Agreement . www.reading.ac.uk/centaur CentAUR Central Archive at the University of Reading Reading’s research outputs online Heuristic Design of Fuzzy Inference Systems: A Review of Three Decades of Research Varun Ojha*1,2, Ajith Abraham3,4, and V´aclav Sn´aˇsel5 1ETH Z¨urich,Switzerland 2University of Reading, United Kingdom 3University of Pretoria, South Africa 4Machine Intelligence Research Labs (MIR Labs), WA, United States 5Technical University of Ostrava, Czech Republic Abstract This paper provides an in-depth review of the optimal design of type-1 and type-2 fuzzy inference systems (FIS) using five well known computational frameworks: genetic-fuzzy systems (GFS), neuro-fuzzy systems (NFS), hierarchical fuzzy systems (HFS), evolving fuzzy systems (EFS), and multiobjective fuzzy systems (MFS), which is in view that some of them are linked to each other.
    [Show full text]
  • Genetic Learning of Fuzzy Rule-Based Classification Systems Cooperating
    <ᎏ ᎏ< Genetic Learning of Fuzzy Rule-Based Classi®cation Systems Cooperating with Fuzzy Reasoning Methods Oscar Cordon * Department of Computer Science and Arti®cial Intelligence, University of Granada, 18071 Granada, Spain Marõa Jose del Jesus² Department of Computer Science, University of Jaen, 23071 Jaen, Spain Francisco Herrera³ Department of Computer Science and Arti®cial Intelligence, University of Granada, 18071 Granada, Spain In this paper, we present a multistage genetic learning process for obtaining linguistic fuzzy rule-based classi®cation systems that integrates fuzzy reasoning methods cooperat- ing with the fuzzy rule base and learns the best set of linguistic hedges for the linguistic variable terms. We show the application of the genetic learning process to two well known sample bases, and compare the results with those obtained from different learning algorithms. The results show the good behavior of the proposed method, which maintains the linguistic description of the fuzzy rules. ᮊ 1998 John Wiley & Sons, Inc. 1. INTRODUCTION In a supervised inductive learning process, a pattern classi®cation system is developed by means of a set of classi®ed examples used to establish a correspon- dence between the new pattern descriptions and the class labels. This system is a description of the concepts learned and it can be expressed as a logic expression, a set of fuzzy rules, a decision tree, or a neural network, among others. When the classi®cation system is composed of a set of fuzzy rules, it is called a fuzzy rule-based classi®cation systemŽ. FRBCS . * E-mail: [email protected]. ² E-mail: [email protected].
    [Show full text]
  • Developing a Fuzyy Inference System by Using Genetic Algorithms and Expert Knowledge (With a Case Study for Landslides in Iran)
    DEVELOPING A FUZYY INFERENCE SYSTEM BY USING GENETIC ALGORITHMS AND EXPERT KNOWLEDGE (WITH A CASE STUDY FOR LANDSLIDES IN IRAN) AZAR ZAFARI February, 2014 SUPERVISORS: Dr.Ali A. (Aliasghar) Alesheikh Dr.R. (Raul) Zurita-Milla DEVELOPING A FUZYY INFERENCE SYSTEM BY USING GENETIC ALGORITHMS AND EXPERT KNOWLEDGE (WITH A CASE STUDY FOR LANDSLIDES IN IRAN) AZAR ZAFARI Enschede, The Netherlands, February, 2014 Thesis submitted to the Faculty of Geo-Information Science and Earth Observation of the University of Twente in partial fulfilment of the requirements for the degree of Master of Science in Geo-information Science and Earth Observation. Specialization: GFM SUPERVISORS: Dr. Ali A. (Aliasghar) Alesheikh Dr. R. (Raul) Zurita-Milla THESIS ASSESSMENT BOARD: Dr.A. (Abolghasem) Sadeghi Prof. G. (George) Vosselman DISCLAIMER This document describes work undertaken as part of a programme of study at the Faculty of Geo-Information Science and Earth Observation of the University of Twente. All views and opinions expressed therein remain the sole responsibility of the author, and do not necessarily represent those of the Faculty. ABSTRACT Meeting the need to produce hazard maps has become more urgent than ever due to recent natural disasters like earthquakes, tsunami and hurricanes. This urgent need makes the scientific community to work more and more on assessing and understanding such natural disasters to mitigate casualties. One of these major hazards is landslides, which may follow all the aforementioned disasters. There are several methods for landslide susceptibility assessment. Most of them either use knowledge extracted from data or expert knowledge. Since all kinds of knowledge are not extractable from data and expert knowledge is inherently subjective, the need to develop a system for integrating knowledge is clearly tangible.
    [Show full text]
  • Genetic Fuzzy Systems: Taxonomy, Current Research Trends and Prospects
    Evol. Intel. (2008) 1:27–46 DOI 10.1007/s12065-007-0001-5 REVIEW ARTICLE Genetic fuzzy systems: taxonomy, current research trends and prospects Francisco Herrera Received: 1 October 2007 / Accepted: 17 October 2007 / Published online: 10 January 2008 Ó Springer-Verlag 2008 Abstract The use of genetic algorithms for designing they can deal with complex engineering problems which fuzzy systems provides them with the learning and adap- are difficult to solve by classical methods [73]. tation capabilities and is called genetic fuzzy systems Hybrid approaches have attracted considerable attention (GFSs). This topic has attracted considerable attention in in the Computational Intelligence community. One of the the Computation Intelligence community in the last few most popular approaches is the hybridization between years. This paper gives an overview of the field of GFSs, fuzzy logic and GAs leading to genetic fuzzy systems being organized in the following four parts: (a) a taxonomy (GFSs) [27]. A GFS is basically a fuzzy system augmented proposal focused on the fuzzy system components involved by a learning process based on evolutionary computation, in the genetic learning process; (b) a quick snapshot of the which includes genetic algorithms, genetic programming, GFSs status paying attention to the pioneer GFSs contri- and evolutionary strategies, among other evolutionary butions, showing the GFSs visibility at ISI Web of Science algorithms (EAs) [40]. including the most cited papers and pointing out the Fuzzy systems are one of the most important areas for milestones covered by the books and the special issues in the application of the Fuzzy Set Theory. Usually it is the topic; (c) the current research lines together with a considered a model structure in the form of fuzzy rule discussion on critical considerations of the recent devel- based systems (FRBSs).
    [Show full text]
  • Introduction to Genetic Algorithms S.N.Sivanandam · S.N.Deepa
    Introduction to Genetic Algorithms S.N.Sivanandam · S.N.Deepa Introduction to Genetic Algorithms With 193 Figures and 13 Tables Authors S.N.Sivanandam S.N.Deepa Professor and Head Ph.D Scholar Dept. of Computer Science Dept. of Computer Science and Engineering and Engineering PSG College of Technology PSG College of Technology Coimbatore - 641 004 Coimbatore - 641 004 TN, India TN, India Library of Congress Control Number: 2007930221 ISBN 978-3-540-73189-4 Springer Berlin Heidelberg New York This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilm or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable for prosecution under the German Copyright Law. Springer is a part of Springer Science+Business Media springer.com c Springer-Verlag Berlin Heidelberg 2008 The use of general descriptive names, registered names, trademarks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. Typesetting: Integra Software Services Pvt. Ltd., India Cover design: Erich Kirchner, Heidelberg Printed on acid-free paper SPIN: 12053230 89/3180/Integra 5 4 3 2 1 0 Preface The origin of evolutionary algorithms was an attempt to mimic some of the processes taking place in natural evolution.
    [Show full text]
  • Training Multilayer Perceptron with Genetic Algorithms and Particle Swarm Optimization for Modeling Stock Price Index Prediction
    entropy Article Training Multilayer Perceptron with Genetic Algorithms and Particle Swarm Optimization for Modeling Stock Price Index Prediction Fatih Ecer 1 , Sina Ardabili 2,3, Shahab S. Band 4 and Amir Mosavi 5,6,7,* 1 Department of Business Administration, Afyon Kocatepe University, Afyonkarahisar 03030, Turkey; [email protected] 2 Biosystem Engineering Department, University of Mohaghegh Ardabili, Ardabil 5619911367, Iran; [email protected] 3 Kando Kalman Faculty of Electrical Engineering, Obuda University, 1034 Budapest, Hungary 4 Future Technology Research Center, College of Future, National Yunlin University of Science and Technology, 123 University Road, Section 3, Douliou, Yunlin 64002, Taiwan; [email protected] 5 Faculty of Civil Engineering, Technische Universität Dresden, 01069 Dresden, Germany 6 Institute of Research and Development, Duy Tan University, Da Nang 550000, Vietnam 7 School of Economics and Business, Norwegian University of Life Sciences, 1430 As, Norway * Correspondence: [email protected] or [email protected] Received: 22 August 2020; Accepted: 28 October 2020; Published: 31 October 2020 Abstract: Predicting stock market (SM) trends is an issue of great interest among researchers, investors and traders since the successful prediction of SMs’ direction may promise various benefits. Because of the fairly nonlinear nature of the historical data, accurate estimation of the SM direction is a rather challenging issue. The aim of this study is to present a novel machine learning (ML) model to forecast the movement of the Borsa Istanbul (BIST) 100 index. Modeling was performed by multilayer perceptron–genetic algorithms (MLP–GA) and multilayer perceptron–particle swarm optimization (MLP–PSO) in two scenarios considering Tanh (x) and the default Gaussian function as the output function.
    [Show full text]
  • Comparison Between Multiobjective GA and PSO for Parameter Optimization of AT2-FLC for a Real Application in FPGA
    Comparison between Multiobjective GA and PSO for Parameter Optimization of AT2-FLC for a real application in FPGA Yazmin Maldonado Oscar Castillo Division of Graduate Studies Division of Graduate Studies Tijuana Institute of Technology Tijuana Institute of Technology Tijuana, B.C. Mexico Tijuana, B.C. Mexico [email protected] [email protected] Abstract— This paper describes the design of a type-2 average Motor (ReSDCM). The optimization involves taking only fuzzy system on FPGAs and its optimization using multiobjective certain points of the T2-MF in order to give greater efficiency Particle Swarm Optimization (PSO) and a multiobjective Genetic to the algorithm. The PSO and GA have been tested in an Algorithm (GA) for the regulation of speed of a DC motor. Based average type-2 fuzzy logic system (AT2-FLC) for ReSDCM. on the concept of evolution, the PSO algorithm and GA are This paper is organized as follows. In section 2 we present applied to membership functions parameter optimization of type- 2 average fuzzy inference systems. Implementations and the basic concepts of type-2 fuzzy inference systems and the simulations are carried out in FPGA using the Xilinx system basic concepts of FPGA, in section 3 we present the generator. The optimization method was coded in Matlab. The optimization methods such as PSO and GA, in section 4 we results of comparison PSO with GA were analyzed statistically. show the design of AT2-FLC for FPGA. The results and optimization of AT2-FLC for ReSDCM are shown in Section Keywords- AT2-FLC, PSO, GA, T2-MF, FPGA, ReSDCM 5.
    [Show full text]