Attention-Based Recurrent Autoencoder for Motion Capture Denoising

Yongqiong Zhu,
Fan Zhang,
Zhidong Xiao,


To resolve the problem of massive loss of MoCap data from optical motion capture, we propose a novel network architecture based on attention mechanism and recurrent network. Its advantage is that the use of encoder-decoder enables automatic human motion manifold learning, capturing the hidden spatial-temporal relationships in motion sequences. In addition, by using the multi-head attention mechanism, it is possible to identify the most relevant corrupted frames with specific position information to recovery the missing markers, which can lead to more accurate motion reconstruction. Simulation experiments demonstrate that the network model we proposed can effectively handle the large-scale missing markers problem with better robustness, smaller errors and more natural recovered motion sequence compared to the reference method.


Motion capture, Attention mechanism, Deep learning, Neural network

Citation Format:
Yongqiong Zhu, Fan Zhang, Zhidong Xiao, "Attention-Based Recurrent Autoencoder for Motion Capture Denoising ," Journal of Internet Technology, vol. 23, no. 6 , pp. 1325-1333, Nov. 2022.

Full Text:



  • There are currently no refbacks.

Published by Executive Committee, Taiwan Academic Network, Ministry of Education, Taipei, Taiwan, R.O.C
JIT Editorial Office, Office of Library and Information Services, National Dong Hwa University
No. 1, Sec. 2, Da Hsueh Rd., Shoufeng, Hualien 974301, Taiwan, R.O.C.
Tel: +886-3-931-7314  E-mail: