List of metaphor-based metaheuristics
This is a chronologically ordered list of metaphor-based metaheuristics and swarm intelligence algorithms.
Contents
- 1 Algorithms
- 1.1 Simulated annealing (Kirkpatrick et al. 1983)
- 1.2 Ant colony optimization (Dorigo, 1992)
- 1.3 Particle swarm optimization (Kennedy & Eberhart 1995)
- 1.4 Harmony search (Geem, Kim & Loganathan 2001)
- 1.5 Artificial bee colony algorithm (Karaboga 2005)
- 1.6 Bees algorithm (Pham 2005)
- 1.7 Glowworm swarm optimization (Krishnanand & Ghose 2005)
- 1.8 Shuffled frog leaping algorithm (Eusuff, Lansey & Pasha 2006)
- 1.9 Cat Swarm Optimization (Chu, Tsai, and Pan 2006)
- 1.10 Imperialist competitive algorithm (Atashpaz-Gargari & Lucas 2007)
- 1.11 River formation dynamics (Rabanal, Rodríguez & Rubio 2007)
- 1.12 Intelligent water drops algorithm (Shah-Hosseini 2007)
- 1.13 Gravitational search algorithm (Rashedi, Nezamabadi-pour & Saryazdi 2009)
- 1.14 Cuckoo search (Yang & Deb 2009)
- 1.15 Bat algorithm (Yang 2010)
- 1.16 Spiral optimization (SPO) algorithm (Tamura & Yasuda 2011,2016-2017)
- 1.17 Flower pollination algorithm (Yang 2012)
- 1.18 Cuttlefish optimization algorithm (Eesa, Mohsin, Brifcani & Orman 2013)
- 1.19 Artificial swarm intelligence (Rosenberg 2014)
- 1.20 Colliding bodies optimization (Kaveh and Mahdavi 2014)
- 1.21 Duelist Algorithm (Biyanto 2016)
- 1.22 Killer Whale Algorithm (Biyanto 2016)
- 1.23 Rain Water Algorithm (Biyanto 2017)
- 1.24 Mass and Energy Balances Algorithm (Biyanto 2017)
- 1.25 Hydrological Cycle Algorithm (Wedyan et al. 2017)
- 2 Criticism of the metaphor methodology
- 3 See also
- 4 Notes
- 5 References
- 6 External links
Algorithms[edit]
Simulated annealing (Kirkpatrick et al. 1983)[edit]
Simulated annealing (SA) is a probabilistic technique inspired by a heat treatment method in metallurgy. It is often used when the search space is discrete (e.g., all tours that visit a given set of cities). For problems where finding the precise global optimum is less important than finding an acceptable local optimum in a fixed amount of time, simulated annealing may be preferable to alternatives such as gradient descent.
Simulated annealing interprets slow cooling as a slow decrease in the probability of accepting worse solutions as it explores the solution space. Accepting worse solutions is a fundamental property of metaheuristics because it allows for a more extensive search for the optimal solution.
Ant colony optimization (Dorigo, 1992)[edit]
The ant colony optimization algorithm (ACO) is a probabilistic technique for solving computational problems which can be reduced to finding good paths through graphs. Initially proposed by Marco Dorigo in 1992 in his PhD thesis,[1][2] the first algorithm was aiming to search for an optimal path in a graph, based on the behavior of ants seeking a path between their colony and a source of food. The original idea has since diversified to solve a wider class of numerical problems, and as a result, several problems have emerged, drawing on various aspects of the behavior of ants. From a broader perspective, ACO performs a model-based search[3] and shares some similarities with Estimation of Distribution Algorithms.
Particle swarm optimization (Kennedy & Eberhart 1995)[edit]
Particle swarm optimization (PSO) is a computational method that optimizes a problem by iteratively trying to improve a candidate solution with regard to a given measure of quality. It solves a problem by having a population of candidate solutions, here dubbed particles, and moving these particles around in the search-space according to simple mathematical formulae over the particle's position and velocity. Each particle's movement is influenced by its local best known position, but is also guided toward the best known positions in the search-space, which are updated as better positions are found by other particles. This is expected to move the swarm toward the best solutions.
PSO is originally attributed to Kennedy, Eberhart and Shi[4][5] and was first intended for simulating social behaviour,[6] as a stylized representation of the movement of organisms in a bird flock or fish school. The algorithm was simplified and it was observed to be performing optimization. The book by Kennedy and Eberhart[7] describes many philosophical aspects of PSO and swarm intelligence. An extensive survey of PSO applications is made by Poli.[8][9] Recently, a comprehensive review on theoretical and experimental works on PSO has been published by Bonyadi and Michalewicz.[10]
Harmony search (Geem, Kim & Loganathan 2001)[edit]
Harmony search is a phenomenon-mimicking metaheuristic introduced in 2001 by Zong Woo Geem, Joong Hoon Kim, and G. V. Loganathan.[11] Harmony search is inspired by the improvisation process of jazz musicians. Harmony search has been strongly criticized for being a special case of the well-established Evolution Strategies algorithm.[12]
The Harmony search (HS) is a relatively simple yet very efficient evolutionary algorithm. In HS algorithm a bunch/group of solutions is randomly generated (Called Harmony memory). A new solution is generated by using all the solutions in the Harmony memory (rather than just two as used in GA) and if this new solution is better than the Worst solution in Harmony memory, the Worst solution gets replaced by this new solution. All though HS is a relatively new meta heuristic algorithm, its effectiveness and advantages have been demonstrated in various applications like design of municipal water distribution networks,[13] structural design,[14] traffic routing,[15] load dispatch problem in electrical engineering,[16] multi objective optimization,[17] rostering problems,[18] clustering,[19] classification and feature selection[20][21] to name a few. A detailed survey on applications of HS can be found in[22] and applications of HS in data mining can be found in.[23]
Artificial bee colony algorithm (Karaboga 2005)[edit]
Artificial bee colony algorithm is a meta-heuristic algorithm introduced by Karaboga in 2005,[24] and simulates the foraging behaviour of honey bees. The ABC algorithm has three phases: employed bee, onlooker bee and scout bee. In the employed bee and the onlooker bee phases, bees exploit the sources by local searches in the neighbourhood of the solutions selected based on deterministic selection in the employed bee phase and the probabilistic selection in the onlooker bee phase. In the scout bee phase which is an analogy of abandoning exhausted food sources in the foraging process, solutions that are not beneficial anymore for search progress are abandoned, and new solutions are inserted instead of them to explore new regions in the search space. The algorithm has a well-balanced exploration and exploitation ability.
Bees algorithm (Pham 2005)[edit]
The bees algorithm in its basic formulation was created by Pham and his co-workers in 2005,[25] and further refined in the following years.[26] Modelled on the foraging behaviour of honey bees, the algorithm combines global explorative search with local exploitative search. A small number of artificial bees (scouts) explores randomly the solution space (environment) for solutions of high fitness (highly profitable food sources), whilst the bulk of the population search (harvest) the neighbourhood of the fittest solutions looking for the fitness optimum. A deterministics recruitment procedure which simulates the waggle dance of biological bees is used to communicate the scouts' findings to the foragers, and distribute the foragers depending on the fitness of the neighbourhoods selected for local search. Once the search in the neighbourhood of a solution stagnates, the local fitness optimum is considered to be found, and the site is abandoned. In summary, the Bees Algorithm searches concurrently the most promising regions of the solution space, whilst continuously sampling it in search of new favourable regions.
Glowworm swarm optimization (Krishnanand & Ghose 2005)[edit]
The glowworm swarm optimization is a swarm intelligence optimization algorithm developed based on the behaviour of glowworms (also known as fireflies or lightning bugs). The GSO algorithm was developed and introduced by K.N. Krishnanand and Debasish Ghose in 2005 at the Guidance, Control, and Decision Systems Laboratory in the Department of Aerospace Engineering at the Indian Institute of Science, Bangalore, India.[27]
The behaviour pattern of glowworms which is used for this algorithm is the apparent capability of the glowworms to change the intensity of the luciferin emission and thus appear to glow at different intensities.
- The GSO algorithm makes the agents glow at intensities approximately proportional to the function value being optimized. It is assumed that glowworms of brighter intensities attract glowworms that have lower intensity.
- The second significant part of the algorithm incorporates a dynamic decision range by which the effect of distant glowworms are discounted when a glowworm has sufficient number of neighbours or the range goes beyond the range of perception of the glowworms.
The part 2 of the algorithm makes it different from other evolutionary multimodal optimization algorithms. It is this step that allows glowworm swarms to automatically subdivide into subgroups which can then converge to multiple local optima simultaneously, This property of the algorithm allows it to be used to identify multiple peaks of a multi-modal function and makes it a part of the evolutionary multimodal optimization algorithms family.
Shuffled frog leaping algorithm (Eusuff, Lansey & Pasha 2006)[edit]
The shuffled frog leaping algorithm is an optimization algorithm used in artificial intelligence.[28] It is comparable to a genetic algorithm.
Cat Swarm Optimization (Chu, Tsai, and Pan 2006)[edit]
The cat swarm optimization algorithm which solves optimization problems and is inspired by the behavior of cats to [29] It is similar to other swarm optimization algorithms such as the Ant Colony Optimization or Particle Swarm Optimization algorithms. Seeking and Tracing, two common behavior of cats, make up the two sub-models of the algorithm. Seeking Mode is inspired by the behavior of a cat at rest, seeking where to move next. In Seeking Mode, it selects several candidate points and then selects one to move to randomly, increasing the probability of choosing points that have a higher fitness value. Tracing Mode is inspired by a cat tracing some target. In this mode, the cat will try to move towards the position with the best fitness value. Cats will continue moving in Seeking and Tracing mode until a terminating condition is met.
Imperialist competitive algorithm (Atashpaz-Gargari & Lucas 2007)[edit]
The imperialist competitive algorithm is a computational method that is used to solve optimization problems of different types.[30][31] Like most of the methods in the area of evolutionary computation, ICA does not need the gradient of the function in its optimization process. From a specific point of view, ICA can be thought of as the social counterpart of genetic algorithms (GAs). ICA is the mathematical model and the computer simulation of human social evolution, while GAs are based on the biological evolution of species.
This algorithm starts by generating a set of random candidate solutions in the search space of the optimization problem. The generated random points are called the initial Countries. Countries in this algorithm are the counterpart of Chromosomes in GAs and Particles in Particle Swarm Optimization (PSO) and it is an array of values of a candidate solution of optimization problem. The cost function of the optimization problem determines the power of each country. Based on their power, some of the best initial countries (the countries with the least cost function value), become Imperialists and start taking control of other countries (called colonies) and form the initial Empires.[30]
Two main operators of this algorithm are Assimilation and Revolution. Assimilation makes the colonies of each empire get closer to the imperialist state in the space of socio-political characteristics (optimization search space). Revolution brings about sudden random changes in the position of some of the countries in the search space. During assimilation and revolution a colony might reach a better position and has the chance to take the control of the entire empire and replace the current imperialist state of the empire.[32]
Imperialistic Competition is another part of this algorithm. All the empires try to win this game and take possession of colonies of other empires. In each step of the algorithm, based on their power, all the empires have a chance to take control of one or more of the colonies of the weakest empire.[30]
Algorithm continues with the mentioned steps (Assimilation, Revolution, Competition) until a stop condition is satisfied.
The above steps can be summarized as the below pseudocode.[31][32]
0) Define objective function:
1) Initialization of the algorithm. Generate some random solution in the search space and create initial empires.
2) Assimilation: Colonies move towards imperialist states in different in directions.
3) Revolution: Random changes occur in the characteristics of some countries.
4) Position exchange between a colony and Imperialist. A colony with a better position than the imperialist,
has the chance to take the control of empire by replacing the existing imperialist.
5) Imperialistic competition: All imperialists compete to take possession of colonies of each other.
6) Eliminate the powerless empires. Weak empires lose their power gradually and they will finally be eliminated.
7) If the stop condition is satisfied, stop, if not go to 2.
8) End
River formation dynamics (Rabanal, Rodríguez & Rubio 2007)[edit]
River formation dynamics is based on imitating how water forms rivers by eroding the ground and depositing sediments (the drops act as the swarm). After drops transform the landscape by increasing/decreasing the altitude of places, solutions are given in the form of paths of decreasing altitudes. Decreasing gradients are constructed, and these gradients are followed by subsequent drops to compose new gradients and reinforce the best ones. This heuristic optimization method was first presented in 2007 by Rabanal et al.[33] The applicability of RFD to other NP-complete problems has been studied,[34] and the algorithm has been applied to fields such as routing[35] and robot navigation.[36] The main applications of RFD can be found at a detailed survey.[37]
Intelligent water drops algorithm (Shah-Hosseini 2007)[edit]
Intelligent water drops algorithm contains a few essential elements of natural water drops and actions and reactions that occur between river's bed and the water drops that flow within. The IWD was first introduced for the traveling salesman problem in 2007.[38]
Almost every IWD algorithm is composed of two parts: a graph that plays the role of distributed memory on which soils of different edges are preserved, and the moving part of the IWD algorithm, which is a few number of Intelligent water drops. These intelligent water drops (IWDs) both compete and cooperate to find better solutions and by changing soils of the graph, the paths to better solutions become more reachable. It is mentioned that the IWD-based algorithms need at least two IWDs to work.
The IWD algorithm has two types of parameters: static and dynamic parameters. Static parameters are constant during the process of the IWD algorithm. Dynamic parameters are reinitialized after each iteration of the IWD algorithm. The pseudo-code of an IWD-based algorithm may be specified in eight steps:
- 1) Static parameter initialization
- a) Problem representation in the form of a graph
- b) Setting values for static parameters
- 2) Dynamic parameter initialization: soil and velocity of IWDs
- 3) Distribution of IWDs on the problem’s graph
- 4) Solution construction by IWDs along with soil and velocity updating
- a) Local soil updating on the graph
- b) Soil and velocity updating on the IWDs
- 5) Local search over each IWD’s solution (optional)
- 6) Global soil updating
- 7) Total-best solution updating
- 8) Go to step 2 unless termination condition is satisfied
Gravitational search algorithm (Rashedi, Nezamabadi-pour & Saryazdi 2009)[edit]
A gravitational search algorithm is based on the law of gravity and the notion of mass interactions. The GSA algorithm uses the theory of Newtonian physics and its searcher agents are the collection of masses. In GSA, there is an isolated system of masses. Using the gravitational force, every mass in the system can see the situation of other masses. The gravitational force is therefore a way of transferring information between different masses (Rashedi, Nezamabadi-pour and Saryazdi 2009).[39] In GSA, agents are considered as objects and their performance is measured by their masses. All these objects attract each other by a gravity force, and this force causes movement of all objects towards the objects with heavier masses. Heavier masses correspond to better solutions of the problem. The position of the agent corresponds to a solution of the problem, and its mass is determined using a fitness function. By lapse of time, masses are attracted by the heaviest mass, which would ideally present an optimum solution in the search space. The GSA could be considered as an isolated system of masses. It is like a small artificial world of masses obeying the Newtonian laws of gravitation and motion.[40] A multi-objective variant of GSA, called MOGSA, was first proposed by Hassanzadeh et al. in 2010.[41]
Cuckoo search (Yang & Deb 2009)[edit]
In operations research, cuckoo search is an optimization algorithm developed by Xin-she Yang and Suash Deb in 2009.[42][43] It was inspired by the obligate brood parasitism of some cuckoo species by laying their eggs in the nests of other host birds (of other species). Some host birds can engage direct conflict with the intruding cuckoos. For example, if a host bird discovers the eggs are not their own, it will either throw these alien eggs away or simply abandon its nest and build a new nest elsewhere. Some cuckoo species such as the New World brood-parasitic Tapera have evolved in such a way that female parasitic cuckoos are often very specialized in the mimicry in colors and pattern of the eggs of a few chosen host species.[44]
Bat algorithm (Yang 2010)[edit]
Bat algorithm is a swarm-intelligence-based algorithm, inspired by the echolocation behavior of microbats. BA automatically balances exploration (long-range jumps around the global search space to avoid getting stuck around one local maximum) with exploitation (searching in more detail around known good solutions to find local maxima) by controlling loudness and pulse emission rates of simulated bats in the multi-dimensional search space.[45]
Spiral optimization (SPO) algorithm (Tamura & Yasuda 2011,2016-2017)[edit]
The spiral optimization (SPO) algorithm is an uncomplicated search concept inspired by spiral phenomena in nature. The motivation for focusing on spiral phenomena was due to the insight that the dynamics that generate logarithmic spirals share the diversification and intensification behavior. The diversification behavior can work for a global search (exploration) and the intensification behavior enables an intensive search around a current found good solution (exploitation). The SPO algorithm is a multipoint search algorithm that has no objective function gradient, which uses multiple spiral models that can be described as deterministic dynamical systems. As search points follow logarithmic spiral trajectories towards the common center, defined as the current best point, better solutions can be found and the common center can be updated.[46]
Flower pollination algorithm (Yang 2012)[edit]
Flower pollination algorithm is a metaheuristic algorithm that was developed by Xin-She Yang,[47] based on the pollination process of flowering plants.
This algorithm has 4 rules or assumptions:
- Biotic and cross-pollination is considered as a global pollination process with pollen carrying pollinators performing Levy flights.
- Abiotic and self-pollination are considered as local pollination.
- Flower constancy can be considered as the reproduction probability is proportional to the similarity of two flowers involved.
- Local and global pollination are controlled by a switch probability[clarification needed] . Due to the physical proximity and other factors such as wind, local pollination can have a significant fraction q in the overall pollination activities.
These rules can be translated into the following updating equations:
where is the solution vector and is the current best found so far during iteration. The switch probability between two equations during iterations is . In addition, is a random number drawn from a uniform distribution. is a step size drawn from a Lévy distribution.
Lévy flights using Lévy steps is a powerful random walk because both global and local search capabilities can be carried out at the same time. In contrast with standard Random walks, Lévy flights have occasional long jumps, which enable the algorithm to jump out any local valleys. Lévy steps obey the following approximation:
where is the Lévy exponent.[48] It may be challenging to draw Lévy steps properly, and a simple way of generating Lévy flights is to use two normal distributions and by a transform[49]
with
where is a function of .
Cuttlefish optimization algorithm (Eesa, Mohsin, Brifcani & Orman 2013)[edit]
The cuttlefish optimization algorithm is a population-based search algorithm inspired by skin color changing behaviour of Cuttlefish which was developed in 2013 [50][51] It has two global search and two local search.
The algorithm considers two main processes: Reflection and Visibility. Reflection process simulates the light reflection mechanism, while visibility simulates the visibility of matching patterns. These two processes are used as a search strategy to find the global optimal solution. The formulation of finding the new solution (newP) by using reflection and visibility is as follows:
CFA divide the population into 4 Groups (G1, G2, G3 and G4). For G1 the algorithm applying case 1 and 2 (the interaction between chromatophores and iridophores) to produce a new solutions. These two cases are used as a global search. For G2, the algorithm uses case 3 (Iridophores reflection opaerator) and case 4 (the interaction between Iridophores and chromatophores) to produces a new solutions) as a local search. While for G3 the interaction between the leucophores and chromatophores (case 5) is used to produce solutions around the best solution (local search). Finally for G4, case 6 (reflection operator of leucophores) is used as a global search by reflecting any incoming light as it with out any modification. The main step of CFA is described as follows:
1 Initialize population (P[N]) with random solutions, Assign the values of r1, r2, v1, v2.
2 Evaluate the population and Keep the best solution.
3 Divide population into four groups (G1, G2, G3 and G4).
4 Repeat
4.1 Calculate the average value of the best solution.
4.2 for (each element in G1)
generate new solution using Case(1 and 2)
4.3 for (each element in G2)
generate new solution using Case(3 and 4)
4.4 for (each element in G3)
generate new solution using Case(5)
4.5 for (each element in G4)
generate new solution using Case(6)
4.6 Evaluate the new solutions
5. Until (stopping criterion is met)
6. Return the best solution
Equations that are used to calculate reflection and visibility for the four Groups are described below:
Case 1 and 2 for G1:
Case 3 and 4 for G2:
Case 5 for G3:
Case 6 for G4:
Where , are Group1 and Group2, i presents the element in G, j is the point of element in group G, Best is the best solution and presents the average value of the Best points. While R and V are two random numbers produced around zero such as between (-1, 1), R represents the degree of reflection, V represents the visibility degree of the final view of the pattern, upperLimit and lowerLimit are the upper limit and the lower limit of the problem domain.
Artificial swarm intelligence (Rosenberg 2014)[edit]
Artificial swarm intelligence refers to a real-time closed-loop system of human users connected over the internet and structured in a framework modeled after natural swarms such that it evokes the group's collective wisdom as a unified emergent intelligence.[52][53] In this way, human swarms can answer questions, make predictions, reach decisions, and solve problems by collectively exploring a diverse set of options and converging on preferred solutions in synchrony. Invented by Dr. Louis Rosenberg in 2014, the ASI methodology has become notable for its ability to make accurate collective predictions that outperform the individual members of the swarm.[54] In 2016 an Artificial Swarm Intelligence from Unanimous A.I. was challenged by a reporter to predict the winners of the Kentucky Derby, and successfully picked the first four horses, in order, beating 540 to 1 odds.[55][56]
Colliding bodies optimization (Kaveh and Mahdavi 2014)[edit]
The Colliding bodies optimization (CBO) [57] algorithm was created by Kaveh and Mahdavi in 2014 based on laws of momentum and energy. This algorithm does not depend on any internal parameter and also it is extremely simple to implement and to use and used in different types of problems in engineering [58].
Duelist Algorithm (Biyanto 2016)[edit]
Duelist algorithm refers to a gene-based optimization algorithm similar to Genetic Algorithms. Duelist Algorithm starts with an initial set of duelists. The duel is to determine the winner and loser. The loser learns from the winner, while the winner try their new skill or technique that may improve their fighting capabilities. A few duelists with highest fighting capabilities are called as champion. The champion train a new duelist such as their capabilities. The new duelist will join the tournament as a representative of each champion. All duelist are re-evaluated, and the duelists with worst fighting capabilities is eliminated to maintain the amount of duelists.[59]
Killer Whale Algorithm (Biyanto 2016)[edit]
Killer Whale Algorithm is an algorithm Inspired by the Killer Whale Life. The philosophy of algorithm is the patterns of movement Killer Whale in prey hunting and Killer whale social structure. The novelty of this algorithm is incorporating "memorize capability" of Killer Whale in the algorithm.[60]
Rain Water Algorithm (Biyanto 2017)[edit]
"Physical movements of rain drops by utilizing Newton’s Law motion" was inspired the authors to create this algorithm. Each rain drop represent as random values of optimized variables that it have vary in mass and elevation. It will fall on the ground by following "the free fall movement" with velocity is square root of gravity acceleration time elevation. The next movement is "uniformly accelerated motion" along the rain drop travel to reach the lowest place on the ground. The lowest place in the ground is an objective function of this algorithm.[61]
Mass and Energy Balances Algorithm (Biyanto 2017)[edit]
Mass and Energy Balances is a fundamental "laws of physics" states that mass can neither be produced nor destroyed. It is only conserved. Equally fundamental is the law of conservation of energy. Although energy can change in form, it can not be created or destroyed also. The beauty of this algorithm is the capability to reach the global optimum solution by simultaneously work either "minimize and maximize searching method".
Hydrological Cycle Algorithm (Wedyan et al. 2017)[edit]
A new nature-inspired optimization algorithm called the Hydrological Cycle Algorithm (HCA) is proposed based on the continuous movement of water in nature. In the HCA, a collection of water drops passes through various hydrological water cycle stages, such as flow, evaporation, condensation, and precipitation. Each stage plays an important role in generating solutions and avoiding premature convergence. The HCA shares information by direct and indirect communication among the water drops, which improves solution quality. HCA provides an alternative approach to tackling various types of optimization problems as well as an overall framework for water-based particle algorithms in general.[62]
Criticism of the metaphor methodology[edit]
While individual metaphor-inspired metaheuristics have produced remarkably effective solutions to specific problems,[63] metaphor-inspired metaheuristics in general have attracted criticism in the research community for hiding their lack of effectiveness or novelty behind an elaborate metaphor.[63][64] Kenneth Sörensen noted that:[65]
In recent years, the field of combinatorial optimization has witnessed a true tsunami of "novel" metaheuristic methods, most of them based on a metaphor of some natural or man-made process. The behavior of virtually any species of insects, the flow of water, musicians playing together – it seems that no idea is too far-fetched to serve as inspiration to launch yet another metaheuristic. [I] will argue that this line of research is threatening to lead the area of metaheuristics away from scientific rigor.
Sörensen and Glover stated that:[66]
A large (and increasing) number of publications focuses on the development of (supposedly) new metaheuristic frameworks based on metaphors. The list of natural or man-made processes that has been used as the basis for a metaheuristic framework now includes such diverse processes as bacterial foraging, river formation, biogeography, musicians playing together, electromagnetism, gravity, colonization by an empire, mine blasts, league championships, clouds, and so forth. An important subcategory is found in metaheuristics based on animal behavior. Ants, bees, bats, wolves, cats, fireflies, eagles, dolphins, frogs, salmon, vultures, termites, flies, and many others, have all been used to inspire a "novel" metaheuristic. [...] As a general rule, publication of papers on metaphor-based metaheuristics has been limited to second-tier journals and conferences, but some recent exceptions to this rule can be found. Sörensen (2013) states that research in this direction is fundamentally flawed. Most importantly, the author contends that the novelty of the underlying metaphor does not automatically render the resulting framework "novel". On the contrary, there is increasing evidence that very few of the metaphor-based methods are new in any interesting sense.
In response, Springer's Journal of Heuristics has updated their editorial policy to state that:[67]
Proposing new paradigms is only acceptable if they contain innovative basic ideas, such as those that are embedded in classical frameworks like genetic algorithms, tabu search, and simulated annealing. The Journal of Heuristics avoids the publication of articles that repackage and embed old ideas in methods that are claimed to be based on metaphors of natural or manmade systems and processes. These so-called "novel" methods employ analogies that range from intelligent water drops, musicians playing jazz, imperialist societies, leapfrogs, kangaroos, all types of swarms and insects and even mine blast processes (Sörensen, 2013). If a researcher uses a metaphor to stimulate his or her own ideas about a new method, the method must nevertheless be translated into metaphor-free language, so that the strategies employed can be clearly understood, and their novelty is made clearly visible. (See items 2 and 3 below.) Metaphors are cheap and easy to come by. Their use to "window dress" a method is not acceptable."
[...] Implementations should be explained by employing standard optimization terminology, where a solution is called a "solution" and not something else related to some obscure metaphor (e.g., harmony, flies, bats, countries, etc.).
[...] The Journal of Heuristics fully endorses Sörensen’s view that metaphor-based “novel” methods should not be published if they cannot demonstrate a contribution to their field. Renaming existing concepts does not count as a contribution. Even though these methods are often called “novel”, many present no new ideas, except for the occasional marginal variant of an already existing methodology. These methods should not take the journal space of truly innovative ideas and research. Since they do not use the standard optimization vocabulary, they are unnecessarily difficult to understand.
The policy of Springer's journal 4OR - A Quarterly Journal of Operations Research states[68]
The emphasis on scientific rigor and on innovation implies, in particular, that the journal does not publish articles that simply propose disguised variants of known methods without adequate validation (e.g., metaheuristics that are claimed to be "effective" on the sole basis of metaphorical comparisons with natural or artificial systems and processes). New methods must be presented in metaphor-free language by establishing their relationship with classical paradigms. Their properties must be established on the basis of scientifically compelling arguments: mathematical proofs, controlled experiments, objective comparisons, etc.
See also[edit]
Notes[edit]
- ^ Colorni, Alberto; Dorigo, Marco; Maniezzo, Vittorio (1992). "Distributed Optimization by Ant Colonies". In Varela, Francisco J.; Bourgine, Paul. Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life. pp. 134–42. ISBN 978-0-262-72019-9.
- ^ M. Dorigo, Optimization, Learning and Natural Algorithms, PhD thesis, Politecnico di Milano, Italy, 1992.[page needed]
- ^ Zlochin, Mark; Birattari, Mauro; Meuleau, Nicolas; Dorigo, Marco (2004). "Model-Based Search for Combinatorial Optimization: A Critical Survey". Annals of Operations Research. 131: 373–95. doi:10.1023/B:ANOR.0000039526.52305.af.
- ^ Kennedy, J.; Eberhart, R. (1995). "Particle swarm optimization". Proceedings of ICNN'95 - International Conference on Neural Networks. 4. pp. 1942–8. doi:10.1109/ICNN.1995.488968. ISBN 0-7803-2768-3.
- ^ Shi, Y.; Eberhart, R. (1998). "A modified particle swarm optimizer". 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360). pp. 69–73. doi:10.1109/ICEC.1998.699146. ISBN 0-7803-4869-9.
- ^ Kennedy, J. (1997). "The particle swarm: Social adaptation of knowledge". Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97). pp. 303–8. doi:10.1109/ICEC.1997.592326. ISBN 0-7803-3949-5.
- ^ Kennedy, J.; Eberhart, R.C. (2001). Swarm Intelligence. Morgan Kaufmann. ISBN 1-55860-595-9.
- ^ Poli, R. (2007). "An analysis of publications on particle swarm optimisation applications" (PDF). Technical Report CSM-469. Department of Computer Science, University of Essex, UK.
- ^ Poli, Riccardo (2008). "Analysis of the Publications on the Applications of Particle Swarm Optimisation". Journal of Artificial Evolution and Applications. 2008: 1. doi:10.1155/2008/685175.
- ^ Bonyadi, Mohammad Reza; Michalewicz, Zbigniew (2017). "Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review". Evolutionary Computation. 25 (1): 1–54. doi:10.1162/EVCO_r_00180. PMID 26953883.
- ^ Zong Woo Geem; Joong Hoon Kim; Loganathan, G.V. (2016). "A New Heuristic Optimization Algorithm: Harmony Search". Simulation. 76 (2): 60–8. doi:10.1177/003754970107600201.
- ^ Weyland, Dennis (2015). "A critical analysis of the harmony search algorithm—How not to solve sudoku". Operations Research Perspectives. 2: 97–105. doi:10.1016/j.orp.2015.04.001.
- ^ Geem, Zong Woo (2006). "Optimal cost design of water distribution networks using harmony search". Engineering Optimization. 38 (3): 259. doi:10.1080/03052150500467430.
- ^ Gholizadeh, S.; Barzegar, A. (2013). "Shape optimization of structures for frequency constraints by sequential harmony search algorithm". Engineering Optimization. 45 (6): 627. Bibcode:2013EnOp...45..627G. doi:10.1080/0305215X.2012.704028.
- ^ Geem, Zong Woo; Lee, Kang Seok; Park, Yongjin (2005). "Application of Harmony Search to Vehicle Routing". American Journal of Applied Sciences. 2 (12): 1552. doi:10.3844/ajassp.2005.1552.1557.
- ^ Wang, Ling; Li, Ling-po (2013). "An effective differential harmony search algorithm for the solving non-convex economic load dispatch problems". International Journal of Electrical Power & Energy Systems. 44: 832. doi:10.1016/j.ijepes.2012.08.021.
- ^ Nekooei, Komail; Farsangi, Malihe M.; Nezamabadi-Pour, Hossein; Lee, Kwang Y. (2013). "An Improved Multi-Objective Harmony Search for Optimal Placement of DGs in Distribution Systems". IEEE Transactions on Smart Grid. 4: 557. doi:10.1109/TSG.2012.2237420.
- ^ Hadwan, Mohammed; Ayob, Masri; Sabar, Nasser R.; Qu, Roug (2013). "A harmony search algorithm for nurse rostering problems". Information Sciences. 233: 126. doi:10.1016/j.ins.2012.12.025.
- ^ Hoang, Duc Chinh; Yadav, Parikshit; Kumar, Rajesh; Panda, Sanjib Kumar (2014). "Real-Time Implementation of a Harmony Search Algorithm-Based Clustering Protocol for Energy-Efficient Wireless Sensor Networks". IEEE Transactions on Industrial Informatics. 10: 774. doi:10.1109/TII.2013.2273739.
- ^ Ren Diao; Qiang Shen (2012). "Feature Selection with Harmony Search". IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics). 42 (6): 1509. doi:10.1109/TSMCB.2012.2193613.
- ^ Fattahi, Hadi; Gholami, Amin; Amiribakhtiar, Mohammad Sadegh; Moradi, Siyamak (2014). "Estimation of asphaltene precipitation from titration data: A hybrid support vector regression with harmony search". Neural Computing and Applications. 26 (4): 789. doi:10.1007/s00521-014-1766-y.
- ^ Manjarres, D.; Landa-Torres, I.; Gil-Lopez, S.; Del Ser, J.; Bilbao, M.N.; Salcedo-Sanz, S.; Geem, Z.W. (2013). "A survey on applications of the harmony search algorithm". Engineering Applications of Artificial Intelligence. 26 (8): 1818. doi:10.1016/j.engappai.2013.05.008.
- ^ Assif Assad; Deep, Kusum (2016). "Applications of Harmony Search Algorithm in Data Mining: A Survey". Proceedings of Fifth International Conference on Soft Computing for Problem Solving. Advances in Intelligent Systems and Computing. 437. pp. 863–74. doi:10.1007/978-981-10-0451-3_77. ISBN 978-981-10-0450-6.
- ^ Karaboga, Dervis (2010). "Artificial bee colony algorithm". Scholarpedia. 5 (3): 6915. Bibcode:2010SchpJ...5.6915K. doi:10.4249/scholarpedia.6915.
- ^ Pham DT, Ghanbarzadeh A, Koc E, Otri S, Rahim S and Zaidi M. The Bees Algorithm. Technical Note, Manufacturing Engineering Centre, Cardiff University, UK, 2005.[page needed]
- ^ Pham, D T; Castellani, M (2009). "The Bees Algorithm: Modelling foraging behaviour to solve continuous optimization problems". Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science. 223 (12): 2919. doi:10.1243/09544062jmes1494.
- ^ Krishnanand, K.N.; Ghose, D. (2005). "Detection of multiple source locations using a glowworm metaphor with applications to collective robotics". Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005. pp. 84–91. doi:10.1109/SIS.2005.1501606. ISBN 0-7803-8916-6.
- ^ Eusuff, Muzaffar; Lansey, Kevin; Pasha, Fayzul (2006). "Shuffled frog-leaping algorithm: A memetic meta-heuristic for discrete optimization". Engineering Optimization. 38 (2): 129. doi:10.1080/03052150500384759.
- ^ Chu, Shu-Chuan; Tsai, Pei-wei; Pan, Jeng-Shyang (2006). "Cat Swarm Optimization". Guilin, China. doi:10.1007/11801603_94.
- ^ a b c Atashpaz-Gargari, Esmaeil; Lucas, Caro (2007). "Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition". 2007 IEEE Congress on Evolutionary Computation. pp. 4661–7. doi:10.1109/CEC.2007.4425083. ISBN 978-1-4244-1339-3.
- ^ a b Hosseini, Seyedmohsen; Al Khaled, Abdullah (2014). "A survey on the Imperialist Competitive Algorithm metaheuristic: Implementation in engineering domain and directions for future research". Applied Soft Computing. 24: 1078. doi:10.1016/j.asoc.2014.08.024.
- ^ a b Nazari-Shirkouhi, S.; Eivazy, H.; Ghodsi, R.; Rezaie, K.; Atashpaz-Gargari, E. (2010). "Solving the integrated product mix-outsourcing problem using the Imperialist Competitive Algorithm". Expert Systems with Applications. 37 (12): 7615. doi:10.1016/j.eswa.2010.04.081.
- ^ "Unconventional Computation". Lecture Notes in Computer Science. 4618. 2007. doi:10.1007/978-3-540-73554-0. ISBN 978-3-540-73553-3.
- ^ Rabanal, Pablo; Rodríguez, Ismael; Rubio, Fernando (2009). "Applying River Formation Dynamics to Solve NP-Complete Problems". Nature-Inspired Algorithms for Optimisation. Studies in Computational Intelligence. 193. pp. 333–68. doi:10.1007/978-3-642-00267-0_12. ISBN 978-3-642-00266-3.
- ^ Amin, Saman Hameed; Al-Raweshidy, H.S.; Abbas, Rafed Sabbar (2014). "Smart data packet ad hoc routing protocol". Computer Networks. 62: 162. doi:10.1016/j.bjp.2013.11.015.
- ^ Redlarski, Grzegorz; Pałkowski, Aleksander; Dąbkowski, Mariusz (2013). "Using River Formation Dynamics Algorithm in Mobile Robot Navigation". Solid State Phenomena. 198: 138. doi:10.4028/www.scientific.net/SSP.198.138.
- ^ Rabanal, Pablo; Rodríguez, Ismael; Rubio, Fernando (2017). "Applications of river formation dynamics". Journal of Computational Science. 22: 26. doi:10.1016/j.jocs.2017.08.002.
- ^ Hosseini, Hamed Shah (2009). "The intelligent water drops algorithm: A nature-inspired swarm-based optimization algorithm". International Journal of Bio-Inspired Computation. 1: 71. doi:10.1504/ijbic.2009.022775.
- ^ Rashedi, Esmat; Nezamabadi-Pour, Hossein; Saryazdi, Saeid (2009). "GSA: A Gravitational Search Algorithm". Information Sciences. 179 (13): 2232. doi:10.1016/j.ins.2009.03.004.
- ^ Rashedi, Nezamabadi-pour and Saryazdi 2009
- ^ Hassanzadeh, Hamid Reza; Rouhani, Modjtaba (2010). "A Multi-objective Gravitational Search Algorithm". 2010 2nd International Conference on Computational Intelligence, Communication Systems and Networks. pp. 7–12. doi:10.1109/CICSyN.2010.32. ISBN 978-1-4244-7837-8.
- ^ Yang, Xin-She; Suash Deb (2009). "Cuckoo Search via Lévy flights". 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC). pp. 210–4. doi:10.1109/NABIC.2009.5393690. ISBN 978-1-4244-5053-4.
- ^ Inderscience (27 May 2010). "Cuckoo designs spring". Alphagalileo.org. Retrieved 2010-05-27.
- ^ R. B. Payne, M. D. Sorenson, and K. Klitz, The Cuckoos, Oxford University Press, (2005).[page needed]
- ^ Yang, Xin-She (2010). "A New Metaheuristic Bat-Inspired Algorithm". Nature Inspired Cooperative Strategies for Optimization (NICSO 2010). Studies in Computational Intelligence. 284. pp. 65–74. doi:10.1007/978-3-642-12538-6_6. ISBN 978-3-642-12537-9.
- ^ Tamura, Kenichi; Yasuda, Keiichiro (2016). "Spiral Optimization Algorithm Using Periodic Descent Directions". SICE Journal of Control, Measurement, and System Integration. 9 (3): 134–43. Bibcode:2016JCMSI...9..134T. doi:10.9746/jcmsi.9.134.
- ^ Yang, Xin-She (2012). "Flower Pollination Algorithm for Global Optimization". Unconventional Computation and Natural Computation. Lecture Notes in Computer Science. 7445. pp. 240–9. doi:10.1007/978-3-642-32894-7_27. ISBN 978-3-642-32893-0.
- ^ Pavlyukevich, Ilya (2007). "Lévy flights, non-local search and simulated annealing". Journal of Computational Physics. 226 (2): 1830. arXiv:cond-mat/0701653. Bibcode:2007JCoPh.226.1830P. doi:10.1016/j.jcp.2007.06.008.
- ^ X. S. Yang, Nature-Inspired Optimization Algorithms, Elsevier, (2014).[page needed]
- ^ Adel Sabry Eesa, A. M. A. B., Zeynep Orman. (2013). Cuttlefish Algorithm – A Novel Bio-Inspired Optimization Algorithm. International Journal of Scientific & Engineering Research, 4(9).
- ^ Eesa, Adel Sabry; Orman, Zeynep; Brifcani, Adnan Mohsin Abdulazeez (2015). "A novel feature-selection approach based on the cuttlefish optimization algorithm for intrusion detection systems". Expert Systems with Applications. 42 (5): 2670. doi:10.1016/j.eswa.2014.11.009.
- ^ Rosenberg, Louis (February 12, 2016). "Artificial Swarm Intelligence, a Human-in-the-loop approach to A.I." Proceedings of the 13th Annual AAAI Conference on Artificial Intelligence (AAAI-16).
- ^ Reese, Hope (Jan 22, 2016). "How 'artificial swarm intelligence' uses people to make better predictions than experts".
- ^ Rosenberg, Louis B. (2015). "Human swarming, a real-time method for parallel distributed intelligence". 2015 Swarm/Human Blended Intelligence Workshop (SHBI). pp. 1–7. doi:10.1109/SHBI.2015.7321685. ISBN 978-1-4673-6522-2.
- ^ CUTHBERTSON, ANTHONY (May 10, 2016). "ARTIFICIAL INTELLIGENCE TURNS $20 INTO $11,000 IN KENTUCKY DERBY BET (Newsweek)".
- ^ Ohlheiser, Abby (June 2, 2016). "What happened when an A.I. hive mind answered Reddit's burning politics questions (Washington Post)".
- ^ Kaveh, Ali; Mahdavi, Vahid Reza. "Colliding bodies optimization : A novel meta-heuristic method". Computers and Structures. 139: 18-27.
- ^ Kaveh, Ali; Vazirinia, Yasin. "Optimization of tower crane location and material quantity between supply and demand points: A comparative study". Periodica Polytechnica Civil Engineering. 62 (3): 732-745. doi:10.3311/PPci.11816.
- ^ Biyanto, Totok Ruki; Fibrianto, Henokh Yernias; Nugroho, Gunawan; Hatta, Agus Muhamad; Listijorini, Erny; Budiati, Titik; Huda, Hairul (2016). "Duelist Algorithm: An Algorithm Inspired by How Duelist Improve Their Capabilities in a Duel". Advances in Swarm Intelligence. Lecture Notes in Computer Science. 9712. pp. 39–47. doi:10.1007/978-3-319-41000-5_4. ISBN 978-3-319-40999-3.
- ^ Biyanto, Totok R; Matradji; Irawan, Sonny; Febrianto, Henokh Y; Afdanny, Naindar; Rahman, Ahmad H; Gunawan, Kevin S; Pratama, Januar A.D; Bethiana, Titania N (2017). "Killer Whale Algorithm: An Algorithm Inspired by the Life of Killer Whale". Procedia Computer Science. 124: 151–7. doi:10.1016/j.procs.2017.12.141.
- ^ Biyanto, T R; Matradji; Syamsi, M N; Fibrianto, H Y; Afdanny, N; Rahman, A H; Gunawan, K S; Pratama, J A D; Malwindasari, A; Abdillah, A I; Bethiana, T N; Putra, Y A (2017). "Optimization of Energy Efficiency and Conservation in Green Building Design Using Duelist, Killer-Whale and Rain-Water Algorithms". IOP Conference Series: Materials Science and Engineering. 267: 012036. Bibcode:2017MS&E..267a2036B. doi:10.1088/1757-899X/267/1/012036.
- ^ Wedyan, Ahmad; Whalley, Jacqueline; Narayanan, Ajit (2017). "Hydrological Cycle Algorithm for Continuous Optimization Problems". Journal of Optimization. 2017: 3828420. doi:10.1155/2017/3828420.
- ^ a b Alexander Brownlee and John R. Woodward (2015). "Why we fell out of love with algorithms inspired by nature". The Conversation.
- ^ Jerry Swan, Steven Adriaensen, Mohamed Bishr, Edmund K. Burke, John A. Clark, Patrick De Causmaecker, Juanjo Durillo, Kevin Hammond, Emma Hart, Colin G. Johnson, Zoltan A. Kocsis, Ben Kovitz, Krzysztof Krawiec, Simon Martin, J. J. Merelo, Leandro L. Minku, Ender Özcan, Gisele L. Pappa, Erwin Pesch, Pablo Garcáa-Sánchez, Andrea Schaerf, Kevin Sim, Jim E. Smith, Thomas Stützle, Stefan Voß, Stefan Wagner, Xin Yao. "A Research Agenda for Metaheuristic Standardization". "Metaphors often inspire new metaheuristics, but without mathematical rigor, it can be hard to tell if a new metaheuristic is really distinct from a familiar one. For example, mathematically, 'Harmony search' turned out to be a simple variant of 'Evolution Strategies' even though the metaphors that inspired them were quite different. Formally describing state, representation, and operators allows genuine novelty to be distinguished from minor variation."
- ^ Sörensen, Kenneth (2015). "Metaheuristics-the metaphor exposed". International Transactions in Operational Research. 22: 3. doi:10.1111/itor.12001.
- ^ Fred Glover and Kenneth Sörensen (ed.). "Metaheuristics". Scholarpedia.
- ^ Journal of Heuristic Policies on Heuristic Search Research. Springer.
- ^ [1]
References[edit]
- Sörensen, Kenneth; Sevaux, Marc; Glover, Fred. "A History of Metaheuristics" (PDF). In Martí, Rafael; Panos, Pardalos; Resende, Mauricio. Handbook of Heuristics. Springer. ISBN 978-3-319-07123-7.
- Sörensen, Kenneth (2015). "Metaheuristics-the metaphor exposed". International Transactions in Operational Research. 22: 3. doi:10.1111/itor.12001.
- Lones, Michael A. (2014). "Metaheuristics in nature-inspired algorithms". Proceedings of the 2014 conference companion on Genetic and evolutionary computation companion - GECCO Comp '14. pp. 1419–22. doi:10.1145/2598394.2609841. ISBN 9781450328814.
- Fister, Iztok; Yang, Xin-She; Fister, Iztok; Brest, Janez; Fister, Dušan (2013). "A Brief Review of Nature-Inspired Algorithms for Optimization". Elektrotehniški vestnik. 1307 (3): arXiv:1307.4186. arXiv:1307.4186. Bibcode:2013arXiv1307.4186F.
External links[edit]
- Evolutionary Computation Bestiary — a tongue-in-cheek account of all the weird, even bizarre metaphor-based metaheuristics out there in the wide world of academic publishing
- The Science Matrix's List of Metaheuristic — a complete list of metaheuristic algorithms. The list can be easily filter by Name, Author or Year, and provides the link to the main publication of each algorithm.