Low-dimensional space modeling-based differential evolution for large scale global optimization problems
Loading...
Files
Accepted Version
Date
2022-12-07
Authors
Fonseca, Thiago Henrique Lemos
Nassar, Silvia Modesto
de Oliveira, Alexandre César Muniz
Agard, Bruno
Journal Title
Journal ISSN
Volume Title
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Published Version
Abstract
Large-Scale Global Optimization (LSGO) has been an active research field. Part of this interest is supported by its application to cutting-edge research such as Deep Learning, Big Data, and complex real-world problems such as image encryption, real-time traffic management, and more. However, the high dimensionality makes solving LSGO a significant challenge. Some recent research deal with the high dimensionality by mapping the optimization process to a reduced alternative space. Nonetheless, these works suffer from the changes in the search space topology and the loss of information caused by the dimensionality reduction. This paper proposes a hybrid metaheuristic, so-called LSMDE (Low-dimensional Space Modeling-based Differential Evolution), that uses the Singular Value Decomposition to build a low-dimensional search space from the features of candidate solutions generated by a new SHADE-based algorithm (GM-SHADE). GM-SHADE combines a Gaussian Mixture Model (GMM) and two specialized local algorithms: MTS-LS1 and L-BFGS-B, to promote a better exploration of the reduced search space. GMM mitigates the loss of information in mapping high-dimensional individuals to low-dimensional individuals. Furthermore, the proposal does not require prior knowledge of the search space topology, which makes it more flexible and adaptable to different LSGO problems. The results indicate that LSMDE is the most efficient method to deal with partially separable functions compared to other state-of-the-art algorithms and has the best overall performance in two of the three proposed experiments. Experimental results also show that the new approach achieves competitive results for non-separable and overlapping functions on the most recent test suite for LSGO problems.
Description
Keywords
Clustering algorithms , Differential evolution , Dimensionality reduction , Gaussian mixture model , Heuristic algorithms , Optimization , Search problems , Singular value decomposition , Sociology , Statistics
Citation
Fonseca, T. H. L., Nassar, S. M., de Oliveira, A. C. M. and Agard, B. (2022) 'Low-dimensional space modeling-based differential evolution for large scale global optimization problems', IEEE Transactions on Evolutionary Computation. doi: 10.1109/TEVC.2022.3227440
Link to publisher’s version
Collections
Copyright
© 2022, IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.