Open AccessEmotion Recognition Through Advanced Signal Fusion and Kolmogorov-Arnold Networks
Author(s) -
Aung Myo Thant,
Thap Panitanarak
Publication year - 2025
Publication title -
ieee access
Language(s) - English
Resource type - Magazines
SCImago Journal Rank - 0.587
H-Index - 127
eISSN - 2169-3536
DOI - 10.1109/access.2025.3572583
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
Emotion recognition is an important aspect of affective computing that has many applications including human computer interaction and mental health care. In this paper, Kolmogorov-Arnold Networks (KANs) are explored for the purpose of multimodal emotion recognition from EEG (Electroencephalogram) and eye movement signals of the SEED-V dataset. Both modalities were represented by Differential Entropy (DE) features and a two-branch KAN architecture was used which composed of seven KAN variants, namely, Efficient KAN, Jacobi KAN, Hermite KAN, Fourier KAN, Chebyshev KAN, RBF KAN, and Wavelet KAN (with different wavelet types including DOG, Morlet, Mexican hat, and Meyer). The strengths of the two modalities were combined through late fusion for the final classification. The results show that Wavelet KANs outperformed other variants and Wavelet KAN (DOG) and Wavelet KAN (Morlet) achieved accuracies higher than 96%. The KAN models effectively identified the localized and transient features in EEG and eye movement signals, which was also reflected in the smooth training convergence and nearly diagonal confusion matrices. Poor performance was observed with Fourier KAN while polynomial-based and RBF KANs gave fairly good results. Efficient KAN had good accuracy but had some problems with validation instability. This work also shows that flexible non-linear, multi scale models are needed for modeling non-stationary physiological signals. The findings also indicate that future work should consider hybrid KAN architectures and more sophisticated fusion strategies to improve the robustness of emotion recognition systems. The proposed framework emphasizes the potential of wavelet-based KANs as a foundation for more adaptive, accurate affective computing solutions.