Evaluation and improvement of control vector iteration procedures for optimal control

To improve the convergence rate to the optimal policy, a simple but effective way of determining the stepping parameter for the control policy adjustment is developed. The application of the proposed approach to four systems described by ordinary differential equations shows that the existing methods are improved considerably when the proposed method is incorporated.