Real-time HIL Implementation of DDPG based Reinforcement Learning Controller for a DC servo motor with Inertia Disc and Rotary Inverted Pendulum
Author(s) -
K. Vijaya Lakshmi,
M. Manimozhi
Publication year - 2025
Publication title -
ieee access
Language(s) - English
Resource type - Magazines
SCImago Journal Rank - 0.587
H-Index - 127
eISSN - 2169-3536
DOI - 10.1109/access.2025.3638051
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
This paper presents a real-time Hardware-in-the-Loop (HIL) implementation of a Deep Deterministic Policy Gradient (DDPG) based reinforcement learning (RL) controller for the stabilization and trajectory tracking of a DC servo motor system coupled with an inertia disc and rotary inverted pendulum. The nonlinear and unstable dynamics of the system pose significant challenges to conventional control methods such as PID, which are often limited in adaptability and robustness. In this work, a model-free DDPG algorithm is trained in simulation and deployed in a real-time HIL environment to validate its performance under practical conditions. The controller learns continuous-valued control policies to maintain desired inertia disc position and balance the pendulum upright while managing the position of the rotary arm. Experimental results demonstrate that the DDPG-based controller achieves faster settling time, reduced overshoot, and improved stability compared to classical PD control, making it highly suitable for complex, safety-critical applications. This study highlights the potential of deep RL for real-time control of nonlinear electromechanical systems.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom