• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Human Action Recognition Using Pyramid Histograms of Oriented Gradients and Collaborative Multi-task Learning

Vol. 8, No.2, February 27, 2014
10.3837/tiis.2014.02.009, Download Paper (Free):

Abstract

In this paper, human action recognition using pyramid histograms of oriented gradients and collaborative multi-task learning is proposed. First, we accumulate global activities and construct motion history image (MHI) for both RGB and depth channels respectively to encode the dynamics of one action in different modalities, and then different action descriptors are extracted from depth and RGB MHI to represent global textual and structural characteristics of these actions. Specially, average value in hierarchical block, GIST and pyramid histograms of oriented gradients descriptors are employed to represent human motion. To demonstrate the superiority of the proposed method, we evaluate them by KNN, SVM with linear and RBF kernels, SRC and CRC models on DHA dataset, the well-known dataset for human action recognition. Large scale experimental results show our descriptors are robust, stable and efficient, and outperform the state-of-the-art methods. In addition, we investigate the performance of our descriptors further by combining these descriptors on DHA dataset, and observe that the performances of combined descriptors are much better than just using only sole descriptor. With multimodal features, we also propose a collaborative multi-task learning method for model learning and inference based on transfer learning theory. The main contributions lie in four aspects: 1) the proposed encoding the scheme can filter the stationary part of human body and reduce noise interference; 2) different kind of features and models are assessed, and the neighbor gradients information and pyramid layers are very helpful for representing these actions; 3) The proposed model can fuse the features from different modalities regardless of the sensor types, the ranges of the value, and the dimensions of different features; 4) The latent common knowledge among different modalities can be discovered by transfer learning to boost the performance.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Zan Gao, Hua Zhang, An-An Liu, Yan-bing Xue and Guang-ping Xu, "Human Action Recognition Using Pyramid Histograms of Oriented Gradients and Collaborative Multi-task Learning," KSII Transactions on Internet and Information Systems, vol. 8, no. 2, pp. 483-503, 2014. DOI: 10.3837/tiis.2014.02.009

[ACM Style]
Gao, Z., Zhang, H., Liu, A., Xue, Y., and Xu, G. 2014. Human Action Recognition Using Pyramid Histograms of Oriented Gradients and Collaborative Multi-task Learning. KSII Transactions on Internet and Information Systems, 8, 2, (2014), 483-503. DOI: 10.3837/tiis.2014.02.009