Premium
A multilevel evaluation method for heuristics with an application to the VRPTW
Author(s) -
Corstjens J.,
Depaire B.,
Caris A.,
Sörensen K.
Publication year - 2020
Publication title -
international transactions in operational research
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.032
H-Index - 52
eISSN - 1475-3995
pISSN - 0969-6016
DOI - 10.1111/itor.12631
Subject(s) - heuristics , computer science , heuristic , vehicle routing problem , mathematical optimization , focus (optics) , field (mathematics) , routing (electronic design automation) , artificial intelligence , mathematics , computer network , physics , pure mathematics , optics
The field of combinatorial optimization has inspired the development of a large number of heuristic solution procedures. These methods are commonly assessed using a competitive evaluation methodology that may give an indication of which algorithm has a better performance. A next step in the experimental analysis is to uncover “why” one algorithm performs better. Which elements are responsible for good or bad performance? How does the performance of elements vary across the design space? What is the influence of the specific problem instance that is being solved? We focus on gaining a better understanding of heuristic algorithm performance and demonstrate that the application of a proper statistical methodology can provide researchers insight into how performance is affected by the different algorithm parameters and components. As an example, we apply a multilevel statistical analysis to a large neighborhood search algorithm for the vehicle routing problem with time windows.