Open AccessSkeleton‐based action recognition with JRR‐GCN
Author(s) -
Ye Fanfan,
Tang Huiming
Publication year - 2019
Publication title -
electronics letters
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.375
H-Index - 146
ISSN - 1350-911X
DOI - 10.1049/el.2019.1380
Subject(s) - adjacency list , computer science , rgb color model , artificial intelligence , graph , skeleton (computer programming) , representation (politics) , pattern recognition (psychology) , algorithm , theoretical computer science , topology (electrical circuits) , mathematics , combinatorics , politics , political science , law , programming language
A novel joints relation‐reasoning, graph convolutional network (JRR‐GCN) is proposed to solve the problem of skeleton‐based action recognition (SAR). Different from the conventional spatial convolutional network‐based methods, the adjacency matrices of JRR‐GCN is reasoned by joints relation‐reasoning network (JRR) automatically, which results in generating a more realistic representation of skeleton topology and yields better adjacency matrices for every sample. JRR is trained with the reinforcement learning with a novel state‐action mapping scheme. Extensive experiments are conducted on two public SAR datasets, NTU‐RGB+D and kinetics. Also the obtained results demonstrate the effectiveness of JRR‐GCN comparing with the state‐of‐the‐art SAR methods.