Abstract
Differential Evolution (DE) is a well-known Evolutionary Algorithm (EA) for solving global optimization problems. Practical experiences, however, show that DE is vulnerable to problems like slow and/or premature convergence. In this article we propose a simple and modified DE framework, called MDE, which is a fusion of three recent modifications in DE: (1) Opposition-Based Learning (OBL); (2) tournament method for mutation; and (3) single population structure. These features have a specific role which helps in improving the performance of DE. While OBL helps in giving a good initial start to DE, the use of the tournament best base vector in the mutation phase helps in preserving the diversity. Finally the single population structure helps in faster convergence. Their synergized effect balances the exploitation and exploration capabilities of DE without compromising with the solution quality or the convergence rate. The proposed MDE is validated on a set of 25 standard benchmark problems, 7 nontraditional shifted benchmark functions proposed at the special session of CEC2008, and three engineering design problems. Numerical results and statistical analysis show that the proposed MDE is better than or at least comparable to the basic DE and several other state-of-the art DE variants.
- Abbass, H. 2002. The self-adaptive Pareto differential evolution algorithm. In Proceedings of the IEEE Congress on Evolutionary Computation. 831--836.Google Scholar
Cross Ref
- Ali, M., Pant, M., and Abraham, A. 2009. A modified differential evolution algorithm and its application to engineering problems. In Proceedings of the International Conference on Soft Computing and Pattern Recognition (SoCPaR09). 196--201. Google Scholar
Digital Library
- Babu, B. V. and Angira, R. 2006. Modified differential evolution (MDE) for optimization of nonlinear chemical processes. Comput. Chem. Engin. 30, 989--1002.Google Scholar
Cross Ref
- Back, T., Hoffmeister, F., and Schwefel, H. 1991. A survey of evolution strategies. In Proceedings of the 4th International Conference on Genetic Algorithms and Their Applications. 2--9.Google Scholar
- Brest, J., Boskovi, B., Greiner, S., Zumer, V., and Sepesy, M. 2007. Performance comparison of self-adaptive differential evolution algorithms. Soft Comput. 11, 7, 617--629. Google Scholar
Digital Library
- Brest, J., Greiner, S., Boskovic, B., Mernik, M., and Zumer, V. 2006. Self adapting control parameters in differential evolution: A comparative study of numerical benchmark problems. IEEE Trans. Evolut. Comput. 10, 6, 646--657. Google Scholar
Digital Library
- Brest, J., Zamuda, A., Boskovic, B., Maucec, M. S., and Zumer, V. 2009. Dynamic optimization using self-adaptive differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 415--421. Google Scholar
Digital Library
- Caponio, A., Neri, F., and Tirronen, V. 2009. Super-Fit control adaptation in memetic differential evolution frameworks. Soft Comput. 13, 811--831. Google Scholar
Digital Library
- Chakraborty, U. K., Ed. 2008. Advances in Differential Evolution. Springer. Google Scholar
Digital Library
- Das, S. and Konar, A. 2006. Design of two dimensional IIR filters with modern search heuristics: A comparative study. Int. J. Comput. Intell. Appl. 6, 3, 329--355.Google Scholar
Cross Ref
- Das, S., Abraham, A., and Konar, A. 2008. Adaptive clustering using improved differential evolution algorithm. IEEE Trans. Syst. Man Cybernet. 38, 1, 218--237. Google Scholar
Digital Library
- Das, S., Abraham, A., Chakraborty, U. K., and Konar, A. 2009. Differential evolution using a neighborhood based mutation operator. IEEE Trans. Evolut. Comput. 13, 2, 526--553. Google Scholar
Digital Library
- Deb, K. 2005. A population-based algorithm generator for real-parameter optimization. Soft Comput. 9, 236--253. Google Scholar
Digital Library
- Epitropakis, M. G., Plagianakos, V. P., and Vrahatis, M. N. 2009. Evolutionary adaptation of the differential evolution control parameters. In Proceedings of the IEEE Congress on Evolutionary Computation. 1359--1366. Google Scholar
Digital Library
- Fan, H.-Y. and Lampinen, J. 2003. A trigonometric mutation operation to differential evolution. J. Global Optimiz. 27, 105--129. Google Scholar
Digital Library
- Fogel, L. 1994. Evolutionary programming in perspective: The top-down view. In Computational Intelligence: Imitating Life, J. M. Zurada, R. J. Marks, and C. J. Robinson, Eds., IEEE Press, 135--146.Google Scholar
- Gamperle, R., Muller, S. D., and Koumoutsakos, A. 2002. A parameter study for differential evolution. In Proceedings of the WSEAS International Conference on Neural Networks and Applications, on Fuzzy Sets and Fuzzy Systems, and Evolutionary Computation (WSEAS NNA-FSFS-EC02). 11--15.Google Scholar
- Garcia, S., Molina, D., Lozano, M., and Herrera, F. 2009. A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: A case study on the CEC05 special session on real parameter optimization. J. Heurist. 15, 617--644. Google Scholar
Digital Library
- Goldberg, D. E. 1989. Genetic Algorithms in Search Optimization and Machine Learning. Addison-Wesley. Google Scholar
Digital Library
- Hendtlass, T. 2001. A combined swarm differential evolution algorithm for optimization problems. In Proceedings of the 14th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems. Lecture Notes in Computer Science, vol. 2070, Springer, 11--18. Google Scholar
Digital Library
- Joshi, R. and Sanderson, A. C. 1999. Minimal representation multi-sensor fusion using differential evolution. IEEE Trans. Syst. Man Cybernet. A29, 1, 63--76. Google Scholar
Digital Library
- Kaelo, P. and Ali, M. M. 2006. A numerical study of some modified differential evolution algorithms. Euro. J. Oper. Res. 169, 1176-1184.Google Scholar
Cross Ref
- Kannan, S., Slochanal, S., Subbaraj, P., and Padhy, N. 2004. Application of particle swarm optimization technique and its variants to generation expansion planning. Electr. Power Syst. Res. 70, 3, 203--210.Google Scholar
Cross Ref
- Lai, J. C. Y., Leung, F. H. F., and Ling, S. H. 2009. A new differential evolution algorithm with wavelet theory based mutation operation. In Proceedings of the IEEE Congress on Evolutionary Computation. 1116--1122. Google Scholar
Digital Library
- Lampinen, J. 1999. A bibliography of differential evolution algorithm. Tech. rep., Department of Information Technology, Laboratory of Information Processing. Lappeenranta University of Technology, http://www.lut.fi/jlampine/debiblio.htm.Google Scholar
- Lampinen, J. and Zelinka, I. 2000. On stagnation of the differential evolution algorithm. In Proceedings of the 6th International Mendel Conference on Soft Computing (MENDEL'00). 76--83.Google Scholar
- Liu, J. and Lampinen, J. 2005. A fuzzy adaptive differential evolution algorithm. Soft Comput. 9, 6, 448--462. Google Scholar
Digital Library
- Maaranen, H., Miettinen, K., and Makela, M. M. 2004. A quasi-random initial population for genetic algorithms. Comput. Math. Appl. 47, 12, 1885--1895. Google Scholar
Digital Library
- Menchaca-Mendez, A. and Coello Coello, C. A. 2009. A new proposal to hybridize the Nelder Mead differential evolution algorithm for constrained optimization. In Proceedings of the IEEE Congress on Evolutionary Computation. 2598--2605. Google Scholar
Digital Library
- Montgomery, J. 2009. Differential evolution: Difference vectors and movement in solution space. In Proceedings of the IEEE Congress on Evolutionary Computation. 2833--2840. Google Scholar
Digital Library
- Noman, N. and Iba, H. 2005. Enhancing differential evolution performance with local search for high dimensional function optimization. In Proceedings of the Conference on Genetic and Evolutionary Computation. 967--973. Google Scholar
Digital Library
- Noman, N and Iba, H. 2008. Accelerating differential evolution using an adaptive local search. IEEE Trans. Evolut. Comput. 12, 1, 107--125. Google Scholar
Digital Library
- Omran, M. G. H., Engelbrecht, A. P., and Salman, A. 2005a. Differential evolution methods for unsupervised image classification. In Proceedings of the IEEE Congress on Evolutionary Computation. 966--973.Google Scholar
- Omran, M. G. H., Salman, A., and Engelbrecht, A. P. 2005b. Self-Adaptive differential evolution. In Proceedings of the Conference on Computational Intelligence and Security. Lecture Notes in Artificial Intelligence, vol. 3801, Springer, 192--199. Google Scholar
Digital Library
- Omran, M. G. H., Engelbrecht, A. P., and Salman, A. 2008. Bare bones differential evolution. Euro. J. Oper. Res. Doi:10.1016/j.ejor.2008.02.035.Google Scholar
- Omran, M. G. H. and Engelbrecht, A. P. 2009. Free search differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 110--117. Google Scholar
Digital Library
- Pant, M., Ali, M., and Singh, V. P. 2009a. Parent centric differential evolution algorithm for global optimization. Opsearch 46, 2, 153--168.Google Scholar
Cross Ref
- Pant, M., Thangaraj, R., Abraham, A., and Grosan, C. 2009b. Differential evolution with laplace mutation operator. In Proceedings of the IEEE Congress on Evolutionary Computation. 2841--2849. Google Scholar
Digital Library
- Pant, M., Ali, M., and Abraham, A. 2009c. Mixed strategy embedded differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 1240--1246. Google Scholar
Digital Library
- Peng, F., Tang, K. E., Chen, G., and Yao, X. 2009. Multistart JADE with knowledge transfer for numerical optimization. In Proceedings of the IEEE Congress on Evolutionary Computation. 1889--2895. Google Scholar
Digital Library
- Price, W. L. 1983. Global optimization by controlled random search. J. Optimiz. Theory Appl. 40, 3, 333--348.Google Scholar
Cross Ref
- Qin, A. K., Huang, V. L., and Suganthan, P. N. 2009. Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans. Evolut. Comput. 13, 2, 398--417. Google Scholar
Digital Library
- Rahnamayan, S., Tizhoosh, H. R., and Salama, M. M. A. 2008a. Opposition-Based differential evolution. IEEE Trans. Evolut. Comput. 12, 1, 64--79. Google Scholar
Digital Library
- Rahnamayan, S., Tizhoosh, H. R., and Salama, M. M. A. 2008b. Opposition versus randomness in soft computing techniques. Appl. Soft Comput. 8, 2, 906--918. Google Scholar
Digital Library
- Rahnamayan, S. and Wang, G. G. 2008. Solving large scale optimization problems by opposition based differential evolution (ODE). WSEAS Trans. Comput. 7, 10, 1792--1804. Google Scholar
Digital Library
- Rogalsky, T., Derksen, R. W., and Kocabiyik, S. 1999. Differential evolution in aerodynamic optimization. In Proceedings of the 46th Annual Conference on Aeronautics Space Institution. 29--36.Google Scholar
- Ronkkonen, J., Kukkonen, S., and Price, K. V. 2005. Real parameter optimization with differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 506--513.Google Scholar
- Storn, R. and Price, K. 1995. Differential evolution: A simple and efficient adaptive scheme for global optimization over continuous spaces. Tech. rep. TR-95-012, University of California, Berkeley, CA.Google Scholar
- Talbi, H. and Batouche, M. 2004. Hybrid particle swarm with differential evolution for multimodal image registration. In Proceedings of the IEEE International Conference on Industrial Technology. 1567--1573.Google Scholar
- Tang, K., Yao, X., Suganthan, P. N., Macnish, C., Chen, Y.-P., Chen, C. M., and Yang, Z. 2007. Benchmark functions for the CEC'2008 special session and competition on large scale global optimization. Tech. rep., Nature Inspired Computation and Applications Laboratory, USTC, China. http://nical.ustc.edu.cn/cec08ss.php.Google Scholar
- Tasgetiren, F., Pan, M., Suganthan, P. N., and Liang, Y. C. 2009. A differential evolution algorithm with variable parameter search for real parameter continuous function optimization. In Proceedings of the IEEE Congress on Evolutionary Computation. 1247--1254. Google Scholar
Digital Library
- Teng, N. G. A., Teo, J., and Hijazi, M. H. A. 2009. Self-Adaptive population sizing for a tune-free differential evolution. Soft Comput. 13, 7, 709--724. Google Scholar
Digital Library
- Thomsen, R. 2004. Multimodal optimization using crowding-based differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 1382--1389.Google Scholar
Cross Ref
- Ting, C. K. and Huang, C.-H. 2009. Varying numbers of difference vectors in differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 1351--1358. Google Scholar
Digital Library
- Tizhoosh, H. R. 2005. Opposition-Based learning: A new scheme for machine intelligence. In Proceedings of the International Conference on Computer Intelligence Modeling Control and Automation (CIMCA'05). 695--701. Google Scholar
Digital Library
- Vesterstrom, J. and Thomsen, R. 2004. A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. In Proceedings of the IEEE Congress on Evolutionary Computation. 1980--1987.Google Scholar
- Wang, F. S. and Jang, H. J. 2000. Parameter estimation of a bio-reaction model by hybrid differential evolution. In Proceedings of the IEEE Congress on Evolutionary Computation. 410--417.Google Scholar
- Wang, Y. U., Li, B., and Lai, X. 2009. Variance priority based cooperative co-evolution differential evolution for large scale global optimization. In Proceedings of the IEEE Congress on Evolutionary Computation. 1232--1239. Google Scholar
Digital Library
- Wu, W. and Gu, X. 2009. A hybrid particle swarm optimization approach with prior crossover differential evolution. In Proceedings of the Conference on Genetic and Evolutionary Computation (GEC'09). 671--677. Google Scholar
Digital Library
- Yang, Z., Tang, K., and Yao, X. 2008a. Self-Adaptive differential evolution with neighborhood search. In Proceedings of the IEEE Congress on Evolutionary Computation. 1110--1116.Google Scholar
- Yang, Z., Tang, K., and Yao, X. 2008b. Large scale evolutionary optimization using cooperative co-evolution. Inf. Sci. 178, 15, 2985--2999. Google Scholar
Digital Library
- Yang, Z., Zhang, J., Tang, K. E., Yao, X., and Sanderson, A. C. 2009. An adaptive coevolutionary differential evolution algorithm for large scale optimization. In Proceedings of the IEEE Congress on Evolutionary Computation. 102--108. Google Scholar
Digital Library
- Zaharie, D. 2003. Control of population diversity and adaptation in differential evolution algorithms. In Proceedings of the 9th International Conference on Soft Computing (MENDEL'03), D. Matousek and P. Osmera, Eds. 41--46.Google Scholar
- Zaharie, D. and Petcu, D. 2004. Adaptive Pareto differential evolution and its parallelization. In Proceedings of the 5th International Conference on Parallel Processing and Applied Mathematics. 261--268.Google Scholar
- Zhang, C., Ning, J., Lu, S., Ouyang, D., and Ding, T. 2009. A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization. Oper. Res. Lett. 37, 117--122. Google Scholar
Digital Library
- Zhang, J. and Sanderson, A. C. 2009. JADE: Adaptive differential evolution with optional external archive. IEEE Trans. Evolut. Comput. 13, 5, 945--958. Google Scholar
Digital Library
- Zhang, W. J. and Xie, X. F. 2003. DEPSO: Hybrid particle swarm with differential evolution operator. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 3816--3821.Google Scholar
Index Terms
Improving differential evolution algorithm by synergizing different improvement mechanisms
Recommendations
A Fuzzy Adaptive Differential Evolution Algorithm
The differential evolution algorithm is a floating-point encoded evolutionary algorithm for global optimization over continuous spaces. The algorithm has so far used empirically chosen values for its search parameters that are kept fixed through an ...
Differential evolution with individual-dependent and dynamic parameter adjustment
Differential evolution (DE) is a powerful and versatile evolutionary algorithm for global optimization over continuous search space, whose performance is significantly influenced by its mutation operator and control parameters (population size, scaling ...
Non-monotone differential evolution
GECCO '08: Proceedings of the 10th annual conference on Genetic and evolutionary computationThe Differential Evolution algorithm uses an elitist selection, constantly pushing the population in a strict downhill search, in an attempt to guarantee the conservation of the best individuals. However, when this operator is combined with an ...






Comments