Back to articles
Articles
Volume: 33 | Article ID: art00007
Image
Graph Adversarial Learning for Noisy Skeleton-based Action Recognition
  DOI :  10.2352/ISSN.2470-1173.2021.10.IPAS-239  Published OnlineJanuary 2021
Abstract

Skeleton based action recognition is playing a critical role in computer vision research, its applications have been widely deployed in many areas. Currently, benefiting from the graph convolutional networks (GCN), the performance of this task is dramatically improved due to the powerful ability of GCN for modeling the Non-Euclidean data. However, most of these works are designed for the clean skeleton data while one unavoidable drawback is such data is usually noisy in reality, since most of such data is obtained using depth camera or even estimated from RGB camera, rather than recorded by the high quality but extremely costly Motion Capture (MoCap) [1] system. Under this circumstance, we propose a novel GCN framework with adversarial training to deal with the noisy skeleton data. With the guiding of the clean data in the semantic level, a reliable graph embedding can be extracted for noisy skeleton data. Besides, a discriminator is introduced such that the feature representation could further improved since it is learned with an adversarial learning fashion. We empirically demonstrate the proposed framework based on two current largest scale skeleton-based action recognition datasets. Comparison results show the superiority of our method when compared to the state-of-the-art methods under the noisy settings.

Subject Areas :
Views 154
Downloads 9
 articleview.views 154
 articleview.downloads 9
  Cite this article 

Henglin Shi, Wei Peng, Xin Liu, Guoying Zhao, "Graph Adversarial Learning for Noisy Skeleton-based Action Recognitionin Proc. IS&T Int’l. Symp. on Electronic Imaging: Image Processing: Algorithms and Systems XIX,  2021,  pp 239-1 - 239-7,  https://doi.org/10.2352/ISSN.2470-1173.2021.10.IPAS-239

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2021
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane Springfield, VA 22151 USA