Improve Theoretical Upper Bound of Jumpk Function by Evolutionary Multitasking

ABSTRACT

Recently, the concept of evolutionary multitasking has emerged in the field of evolutionary computation as a promising approach to exploit the latent synergies among distinct optimization problems automatically. Many experimental studies have shown multifactorial evolutionary algorithm (MFEA), an implemented algorithm of evolutionary multitasking, can outperform the traditional optimization approaches of solving each task independently on handling synthetic and real-world multi-task optimization (MTO) problems in terms of solution quality and computation resource. However, as far as we know, there exists no study demonstrating the superiority of evolutionary multitasking from the aspect of theoretical analysis. In this paper, we propose a simple (4+2) MFEA to optimize the benchmarks Jumpk and LeadingOnes functions simultaneously. Our theoretical analysis shows that the upper bound of expected running time for the proposed algorithm on the Jumpk function can be improved to O(n2 + 2k) while the best upper bound for single-task optimization on this problem is O(nk-1). Moreover, the upper bound of expected running time to optimize LeadingOnes function is not increased. This result indicates that evolutionary multitasking is probably a promising approach to deal with some problems which traditional optimization methods can't well tackle. This paper provides an evidence of the effectiveness of the evolutionary multitasking from the aspect of theoretical analysis.

References

1. Alexis Bacopoulos. 1999. MULTICRITERIA OPTIMIZATION.
2. Liang Bao, Yutao Qi, Mengqing Shen, Xiaoxuan Bu, Jusheng Yu, Qian Li, and Ping Chen.2018. An Evolutionary Multitasking Algorithm for Cloud Computing Service Composition. In World Congress on Services. Springer, 130--144.
3. Cloninger C R, Rice J, and Reich T. 1979. Multifactorial inheritance with cultural transmission and assortative mating. II. a general model of combined polygenic and cultural inheritance. American Journal of Human Genetics 31, 2 (1979), 176.
4. Rich Caruana. 1997. Multitask Learning. Machine Learning 28, 1 (1997), 41--75.
5. L L Cavalli-Sforza and M W Feldman. 1973. Cultural versus biological inheritance: phenotypic transmission from parents to children. (A theory of the effect of parental phenotypes on children's phenotypes). American Journal of Human Genetics 25, 6 (1973), 618.
6. Qunjian Chen, Xiaoliang Ma, Zexuan Zhu, and Yiwen Sun. 2017. Evolutionary Multi-tasking Single-Objective Optimization Based on Cooperative Coevolutionary Memetic Algorithm. In International Conference on Computational Intelligence & Security.
7. Bingshui Da, Yew-Soon Ong, Liang Feng, AK Qin, Abhishek Gupta, Zexuan Zhu, Chuan-Kang Ting, Ke Tang, and Xin Yao. 2017. Evolutionary multitasking for single-objective continuous optimization: Benchmark problems, performance metric, and baseline results. arXiv preprint arXiv:1706.03470 (2017).
8. Duc Cuong Dang, Tobias Friedrich, Timo Kötzing, Martin S. Krejca, Per Kristian Lehre, Pietro S. Oliveto, Dirk Sudholt, and Andrew M. Sutton. 2016. Escaping Local Optima with Diversity Mechanisms and Crossover. In Genetic and Evolutionary Computation Conference. 645--652.
9. Duc Cuong Dang, Tobias Friedrich, Timo Kötzing, Martin S. Krejca, Per Kristian Lehre, Pietro S. Oliveto, Dirk Sudholt, and Andrew M. Sutton. 2018. Escaping Local Optima using Crossover with Emergent or Reinforced Diversity. IEEE Transactions on Evolutionary Computation 22, 3 (2018), 484--497.
10. Liang Feng, Lei Zhou, Jinghui Zhong, Abhishek Gupta, Yew-Soon Ong, KayChen Tan, and AK Qin. 2018. Evolutionary multitasking via explicit autoencoding. IEEE transactions on cybernetics 99 (2018), 1--14.
11. L. Feng, W. Zhou, L. Zhou, S. W. Jiang, J. H. Zhong, B. S. Da, Z. X. Zhu, and Y. Wang. 2017. An empirical study of multifactorial PSO and multifactorial DE. In Evolutionary Computation.
12. David E Goldberg.1989. Genetic algorithms in search, optimization and machine learning. (1989).
13. Abhishek Gupta. 2017. Evolutionary Multitasking for Single-objective Continuous Optimization: Benchmark Problems, Performance Metric, and Baseline Results. (2017).
14. A Gupta, Y Ong, B Da, L Feng, and S Handoko.2016. Measuring complementarity between function landscapes in evolutionary multitasking.In 2016 IEEE Congress on Evolutionary Computation, accepted.
15. Abhishek Gupta, Yew Soon Ong, and Liang Feng. 2016. Multifactorial Evolution: Toward Evolutionary Multitasking. IEEE Transactions on Evolutionary Computation 20, 3 (2016), 343--357.
16. Abhishek Gupta, Yew-Soon Ong, and Liang Feng. 2018. Insights on transfer optimization: Because experience is the best teacher. IEEE Transactions on Emerging Topics in Computational Intelligence 2, 1 (2018), 51--64.
17. A Gupta, Y. S. Ong, L. Feng, and K. C. Tan. 2016. Multiobjective Multifactorial Optimization in Evolutionary Multitasking. IEEE Transactions on Cybernetics 47, 7 (2016), 1652--1665.
18. Ryuichi Hashimoto, Hisao Ishibuchi, Naoki Masuyama, and Yusuke Nojima. 2018. Analysis of evolutionary multi-tasking as an island model. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. ACM, 1894--1897.
19. A. C. Heath, K. S. Kendler, L. J. Eaves, and D. Markell. 1985. The resolution of cultural and biological inheritance: Informativeness of different relationships. Behavior Genetics 15, 5 (1985), 439--465.
20. Thomas Jansen. 2013. Analyzing evolutionary algorithms: The computer science perspective. Springer Science & Business Media.
21. Timo Kø"tzing, Dirk Sudholt, and Madeleine Theile. 2011. How crossover helps in Pseudo-Boolean optimization. In Genetic and Evolutionary Computation Conference, GECCO 2011, Proceedings, Dublin, Ireland, July. 989--996.
22. Feldman M W and Laland K N. 1995. Gene-culture coevolutionary theory. Current Anthropology 36, 1 (1995), 131--156.
23. Frank Neumann and Carsten Witt. 2010. Bioinspired Computation in Combinatorial Optimization - Algorithms and Their Computational Complexity. Springer Berlin Heidelberg. 1035--1058 pages.
24. Yew Soon Ong. 2015. Towards Evolutionary Multitasking: A New Paradigm in Evolutionary Computation. (2015).
25. Yew Soon Ong and Abhishek Gupta. 2016. Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking. Cognitive Computation 8, 2 (2016), 125--142.
26. Ting Kei Pong, Paul Tseng, Shuiwang Ji, and Jieping Ye. 2009. Trace Norm Regularization: Reformulations, Algorithms, and Multi-Task Learning. Siam Journal on Optimization 20, 6 (2009), 3465--3489.
27. J. Rice, CR Cloninger, and T. Reich. 1978. Multifactorial inheritance with cultural transmission and assortative mating. I. Description and basic properties of the unitary models. American Journal of Human Genetics 30, 6 (1978), 618.
28. Wang Rui, Shiming Lai, Guohua Wu, Lining Xing, Wang Ling, and Hisao Ishibuchi. 2018. Multi-clustering via evolutionary multi-objective optimization. Information Sciences 450 (2018), S0020025518302275.
29. Ramon Sagarna and Yew Soon Ong. 2017. Concurrently searching branches in software tests generation through multitask evolution. In Computational Intelligence.
30. Alice E. Smith. 2002. Multi-objective optimization using evolutionary algorithms {Book Review}. Evolutionary Computation IEEE Transactions on 6, 5 (2002), 526-- 526.
31. M. Srinivas and L. M. Patnaik. 2002. Genetic algorithms: a survey. Computer 27, 6 (2002), 17--26.
32. Dirk Sudholt. 2013. A New Method for Lower Bounds on the Running Time of Evolutionary Algorithms. IEEE Transactions on Evolutionary Computation 17, 3 (2013), 418--435.
33. Gilbert Syswerda. 1989. Uniform Crossover in Genetic Algorithms. In International Conference on Genetic Algorithms.
34. Jing Tang, Yingke Chen, Zixuan Deng, Yanping Xiang, and Colin Paul Joy. 2018. A Group-based Approach to Improve Multifactorial Evolutionary Algorithm.. In IJCAI. 3870--3876.
35. Pham Dinh Thanh, Dinh Anh Dung, Tran Ngoc Tien, and Huynh Thi Thanh Binh. 2018. An Effective Representation Scheme in Multifactorial Evolutionary Algorithm for Solving Cluster Shortest-Path Tree Problem. In 2018 IEEE Congress on Evolutionary Computation (CEC). IEEE, 1--8.
36. Yu Wei Wen and Chuan Kang Ting. 2016. Learning ensemble of decision trees through multifactorial genetic programming. In Evolutionary Computation.
37. Ya Xue, Xuejun Liao, Lawrence Carin, and Balaji Krishnapuram. 2007. Multitask learning for classification with Dirichlet process priors. Journal of Machine Learning Research 8, 1 (2007), 35--63.
38. Yuan Yuan, Yew Soon Ong, Abhishek Gupta, Puay Siew Tan, and Xu Hua. 2017. Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP. In Region 10 Conference.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Search methodologies

      • Discrete space search