Cross-LSTM: Integrating Cross Attention with Long Short-Term Memory Neural Networks in Estimating Joint Moments from Wearable Sensors

Precise estimation of joint moments is essential for designing rehabilitation interventions and optimising the control of assistive devices. Current methods, including physics-based modelling and data-driven approaches, heavily depend on motion capture equipment such as bulky cameras and force plates, which limits their real-time use in real-world environments. To address these limitations, we propose the Cross-LSTM, a dual-stream neural network architecture integrating Long Short-Term Memory (LSTM) networks with Residual Connected Cross-Attention (RCCA) mechanisms to estimate joint moments using signals from wearable sensors. Cross-LSTM fuses IMU and EMG signals dynamically using a cross-attention mechanism, significantly enhancing the estimation accuracy of lower limb joint moments. Cross-LSTM achieved superior predictive performance, demonstrating significantly lower root mean squared errors (RMSE) compared to existing benchmarks. Incorporating transfer learning further improved model robustness and accuracy with limited training data, showcasing its adaptability for deployment in more challenging functional tasks such as incline walking and stair navigation. The interpretability analysis identified IMU data as the primary predictive contributor, suggesting the possibility of reducing sensor complexity and enhancing clinical usability. Comprehensive evaluations highlight Cross-LSTM’s potential as an accurate, robust, and cost-effective solution for lower limb joint moment estimation, aimed at personalised rehabilitation and low-cost assistive device development.