×

Quantum-behaved particle swarm optimization with Gaussian distributed local attractor point. (English) Zbl 1244.65089

Summary: This paper proposes a novel variant of quantum-behaved particle swarm optimization (QPSO) algorithm with the local attractor point subject to a Gaussian probability distribution (GAQPSO). The local attractor point in QPSO plays an important role in determining the convergence behavior of an individual particle. As such, the mean value and standard deviation of the proposed Gaussian probability distribution in GAQPSO are carefully selected. The distributions and diversities of the local attractor points in GAQPSO and QPSO are evaluated and compared.
For the purpose of comparison, two variants of the GAQPSO algorithm are proposed by using a mutation probability and other types of probability distribution. The GAQPSO has been comprehensively evaluated on the suite of CEC2005 benchmark functions, and the experimental results are compared with those of the PSO and QPSO algorithms based on different probability distributions. It is shown by the results that the GAQPSO algorithm is an effective approach that can improve the QPSO performance considerably, that is, the GAQPSO algorithm is less likely to be stuck in local optima and hence it can achieve better solutions in most cases.

MSC:

65K05 Numerical mathematical programming methods
90C15 Stochastic programming

Software:

CEC 05
PDFBibTeX XMLCite
Full Text: DOI Link

References:

[1] J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of IEEE International Conference on Neural Networks, 1995, pp. 1942-1948.; J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of IEEE International Conference on Neural Networks, 1995, pp. 1942-1948.
[2] Shi, Y.; Eberhart, R. C., A modified particle swarm optimizer, (Proceedings of the IEEE International Conference on Evolutionary Computation (1998), IEEE Press: IEEE Press Piscataway, NJ), 69-73
[3] Poli, R., Analysis of the publications on the applications of particle swarm optimisation, Journal of Artificial Evolution and Applications, 28, 1-10 (2008)
[4] Liang, J. J.; Qin, A. K.; Suganthan, P. N.; Baskar, S., Comprehensive learning particle swarm optimizer for global optimization of multimodal functions, IEEE Transactions on Evolutionary Computation, 10, 281-295 (2006)
[5] X. Xiao-Feng, Z. Wen-Jun, Y. Zhi-Lian, Adaptive particle swarm optimization on individual level, vol. 2, 2002, pp. 1215-1218.; X. Xiao-Feng, Z. Wen-Jun, Y. Zhi-Lian, Adaptive particle swarm optimization on individual level, vol. 2, 2002, pp. 1215-1218.
[6] J. Kennedy, R. Mendes, Population structure and particle swarm performance, 2002, pp. 1671-1676.; J. Kennedy, R. Mendes, Population structure and particle swarm performance, 2002, pp. 1671-1676.
[7] S. Yuhui, R.C. Eberhart, Fuzzy adaptive particle swarm optimization, in: Proceedings of the 2001 Congress on Evolutionary Computation, 2001, pp. 101-106.; S. Yuhui, R.C. Eberhart, Fuzzy adaptive particle swarm optimization, in: Proceedings of the 2001 Congress on Evolutionary Computation, 2001, pp. 101-106.
[8] P.S. Andrews, An investigation into mutation operators for particle swarm optimization, 2006, pp. 1044-1051.; P.S. Andrews, An investigation into mutation operators for particle swarm optimization, 2006, pp. 1044-1051.
[9] J.J. Liang, P.N. Suganthan, Dynamic multi-swarm particle swarm optimizer with a novel constraint-handling mechanism, in: IEEE Congress on Evolutionary Computation, 2006, CEC 2006, 2006, pp. 9-16.; J.J. Liang, P.N. Suganthan, Dynamic multi-swarm particle swarm optimizer with a novel constraint-handling mechanism, in: IEEE Congress on Evolutionary Computation, 2006, CEC 2006, 2006, pp. 9-16.
[10] van den Bergh, F.; Engelbrecht, A. P., A Cooperative approach to particle swarm optimization, IEEE Transactions on Evolutionary Computation, 8, 225-239 (2004)
[11] Mendes, R.; Kennedy, J.; Neves, J., The fully informed particle swarm: simpler, maybe better, IEEE Transactions on Evolutionary Computation, 8, 204-210 (2004)
[12] J. Kennedy, Bare bones particle swarms, in: Proceedings of the 2003 IEEE Swarm Intelligence Symposium, 2003, pp. 80-87.; J. Kennedy, Bare bones particle swarms, in: Proceedings of the 2003 IEEE Swarm Intelligence Symposium, 2003, pp. 80-87.
[13] J. Kennedy, Probability and dynamics in the particle swarm, 2004 Congress on Evolutionary Computation, 2004, pp. 340-347.; J. Kennedy, Probability and dynamics in the particle swarm, 2004 Congress on Evolutionary Computation, 2004, pp. 340-347.
[14] James, K., Dynamic-probabilistic particle swarms, (Proceedings of the 2005 Conference on Genetic and Evolutionary Computation (2005), ACM: ACM Washington DC, USA)
[15] T.J. Richer, T.M. Blackwell, The levy particle swarm, in: IEEE Congress on Evolutionary Computation, 2006, CEC 2006, 2006, pp. 808-815.; T.J. Richer, T.M. Blackwell, The levy particle swarm, in: IEEE Congress on Evolutionary Computation, 2006, CEC 2006, 2006, pp. 808-815.
[16] L.d.S. Coelho, R.A. Krohling, Predictive controller tuning using modified particle swarm optimization based on cauchy and Gaussian distributions, in: Proceedings of the VI Brazilian Conference on Neural Networks, Sao Paulo, Brazil, 2003.; L.d.S. Coelho, R.A. Krohling, Predictive controller tuning using modified particle swarm optimization based on cauchy and Gaussian distributions, in: Proceedings of the VI Brazilian Conference on Neural Networks, Sao Paulo, Brazil, 2003.
[17] R.A. Krohling, Gaussian swarm: a novel particle swarm optimization algorithm, 2004 IEEE Conference on Cybernetics and Intelligent Systems, 2004.; R.A. Krohling, Gaussian swarm: a novel particle swarm optimization algorithm, 2004 IEEE Conference on Cybernetics and Intelligent Systems, 2004.
[18] R.A. Krohling, Gaussian particle swarm with jumps, vol. 2, 2005, pp. 226-231.; R.A. Krohling, Gaussian particle swarm with jumps, vol. 2, 2005, pp. 226-231.
[19] R.A. Krohling, L. dos Santos Coelho, PSO-E: Particle Swarm with Exponential Distribution, 2006, pp. 1428-1433.; R.A. Krohling, L. dos Santos Coelho, PSO-E: Particle Swarm with Exponential Distribution, 2006, pp. 1428-1433.
[20] R.A. Krohling, E. Mendel, Bare bones particle swarm optimization with Gaussian or Cauchy jumps, IEEE Congress on Evolutionary Computation, 2009, CEC’09, 2009, pp. 3285-3291.; R.A. Krohling, E. Mendel, Bare bones particle swarm optimization with Gaussian or Cauchy jumps, IEEE Congress on Evolutionary Computation, 2009, CEC’09, 2009, pp. 3285-3291.
[21] N. Higashi, H. Iba, Particle swarm optimization with Gaussian mutation, in: Proceedings of the 2003 IEEE Swarm Intelligence Symposium, 2003, pp. 72-79.; N. Higashi, H. Iba, Particle swarm optimization with Gaussian mutation, in: Proceedings of the 2003 IEEE Swarm Intelligence Symposium, 2003, pp. 72-79.
[22] Clerc, M.; Kennedy, J., The particle swarm – explosion, stability, and convergence in amultidimensional complex space, IEEE Transactions on Evolutionary Computation, 6, 58-73 (2002)
[23] J. Sun, B. Feng, W. Xu, Particle swarm optimization with particles having quantum behavior, in: IEEE Congress on Evolutionary Computation, 2004, pp. 325-331.; J. Sun, B. Feng, W. Xu, Particle swarm optimization with particles having quantum behavior, in: IEEE Congress on Evolutionary Computation, 2004, pp. 325-331.
[24] J. Sun, B. Feng, W. XU, A Global search strategy of quantum-behaved particle swarm optimization, in: IEEE Conference on Cybernetics and Intelligent Systems, 2004, pp. 111-116.; J. Sun, B. Feng, W. XU, A Global search strategy of quantum-behaved particle swarm optimization, in: IEEE Conference on Cybernetics and Intelligent Systems, 2004, pp. 111-116.
[25] S. Jun, X. Wenbo, F. Bin, Adaptive parameter control for quantum-behaved particle swarm optimization on individual level, vol. 4, 2005, pp. 3049-3054.; S. Jun, X. Wenbo, F. Bin, Adaptive parameter control for quantum-behaved particle swarm optimization on individual level, vol. 4, 2005, pp. 3049-3054.
[26] Mikki, S. M.; Kishk, A. A., Quantum particle swarm optimization for electromagnetics, IEEE Transactions on Antennas and Propagation, 54, 2764-2775 (2006)
[27] Shouyi, L., A new QPSO based BP neural network for face detection, Fuzzy Information and Engineering (2007)
[28] Coelho, L. D., A quantum particle swarm optimizer with chaotic mutation operator, Chaos, Solitons and Fractals, 37 (2008)
[29] Omkar, S. N.; Rahul, K.; Ananth, T. V.S.; Naik, G. N.; Gopalakrishnan, S., Quantum behaved particle swarm optimization (QPSO) for multi-objective design optimization of composite structures, Expert Systems with Applications, 36, 11312-11322 (2009)
[30] dos Santos Coelho, L.; Alotto, P., Global optimization of electromagnetic devices using an exponential quantum-behaved particle swarm optimizer, IEEE Transactions on Magnetics, 44, 1074-1077 (2008)
[31] Coelho, L. S., Novel Gaussian quantum-behaved particle swarm optimiser applied to electromagnetic design, Science, Measurement & Technology, IET, 1, 290-294 (2007)
[32] L.d.S. Coelho, N. Nedjah, L.d.M. Mourelle, Gaussian quantum-behaved particle swarm optimization applied to fuzzy PID controller design studies in computational intelligence, vol. 121, 2008, pp. 1-15.; L.d.S. Coelho, N. Nedjah, L.d.M. Mourelle, Gaussian quantum-behaved particle swarm optimization applied to fuzzy PID controller design studies in computational intelligence, vol. 121, 2008, pp. 1-15. · Zbl 1154.90637
[33] Coelho, L.d. S., Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems, Expert Systems with Applications, 37, 1676-1683 (2010)
[34] L. Jing, X. Wenbo, S. Jun, Quantum-behaved particle swarm optimization with mutation operator, 2005, 4.; L. Jing, X. Wenbo, S. Jun, Quantum-behaved particle swarm optimization with mutation operator, 2005, 4.
[35] Liu, J.; Sun, J.; Xu, W. B., Quantum-behaved particle swarm optimization with adaptive mutation operator, Advances in Natural Computation, 4221, Pt 1, 959-967 (2006)
[36] Wei, F.; Jun, S.; Wenbo, X., Analysis of mutation operators on quantum-behaved particle swarm optimization algorithm, New Mathematics and Natural Computation (NMNC), 5, 487-496 (2009) · Zbl 1171.90556
[37] J. Sun, W. Fang, X.J. Wu, V. Palade, W.B. Xu, Quantum-behaved particle swarm optimization: analysis of the individual particle’s behavior and parameter selection, Evolutionary Computation, doi:10.1162/EVCO_a_00049.; J. Sun, W. Fang, X.J. Wu, V. Palade, W.B. Xu, Quantum-behaved particle swarm optimization: analysis of the individual particle’s behavior and parameter selection, Evolutionary Computation, doi:10.1162/EVCO_a_00049.
[38] Riget, J.; Vesterstroem, J., A diversity-guided particle swarm optimizer - The ARPSO (2002), Department of Computer Science, University of Aarhus
[39] P.N. Suganthan et al., Problem definitions and evaluation criteria for the CEC 2005, Technical Report, Nanyang Technological University, Singapore, 2005.; P.N. Suganthan et al., Problem definitions and evaluation criteria for the CEC 2005, Technical Report, Nanyang Technological University, Singapore, 2005.
[40] J.J. Liang, P.N. Suganthan, Dynamic multi-swarm particle swarm optimizer, in: Proceedings of the 2005 IEEE Swarm Intelligence Symposium, 2005, pp. 124-129.; J.J. Liang, P.N. Suganthan, Dynamic multi-swarm particle swarm optimizer, in: Proceedings of the 2005 IEEE Swarm Intelligence Symposium, 2005, pp. 124-129.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.