Premium
Comparison of linear and classical velocity update rules in particle swarm optimization: notes on scale and frame invariance
Author(s) -
Wilke Daniel N.,
Kok Schalk,
Groenwold Albert A.
Publication year - 2006
Publication title -
international journal for numerical methods in engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.421
H-Index - 168
eISSN - 1097-0207
pISSN - 0029-5981
DOI - 10.1002/nme.1914
Subject(s) - invariant (physics) , particle swarm optimization , mathematics , scaling , perturbation (astronomy) , scale invariance , linear scale , rotation (mathematics) , algorithm , mathematical optimization , geometry , physics , statistics , geodesy , quantum mechanics , mathematical physics , geography
In this paper we investigate whether the particle swarm optimization (PSO) algorithm is invariant of the scale and frame (i.e. translation and rotation) in which an objective function is posed. To do so, we study the linear and classical velocity update rules. We will show that the linear velocity update rule is scale and frame invariant , but that the classical velocity update rule lacks rotational invariance . It is known that the linear velocity update rule lacks diversity, resulting in particle trajectories that collapse to line searches. In contrast, the classical velocity update rule maintains diverse (space filling) particle trajectories. To illustrate that diversity and invariance are not necessarily exclusive, we propose a new velocity update rule. This update rule, which is just one example of many possible formulations, is rotationally invariant and at the same time directionally diverse. This is achieved through consistent perturbation of the search directions. We quantify the (in)variance and performance of the three different implementations using a popular test set. The test problems are evaluated in both unrotated and arbitrarily rotated reference frames. Copyright © 2006 John Wiley & Sons, Ltd.