Initial results of an MDO method evaluation study

The NASA Langley MDO method evaluation study seeks to arrive at a set of guidelines for using promising MDO methods by accumulating and analyzing computational data for such methods. The data are collected by conducting a series of reproducible experiments. In the first phase of the study, three MDO methods were implemented in the iSIGHT* framework and used to solve a set of ten relatively simple problems. In this paper, we comment on the general considerations for conducting method evaluation studies and report some initial results obtained to date. In particular, although the results are not conclusive because of the small initial test set, preliminary numbers suggest that the performance of the methods tends to be consistent with their predicted theoretical properties.