• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Spatio-temporal Semantic Features for Human Action Recognition

Vol. 6, No.10, October 29, 2012
10.3837/tiis.2012.10.011, Download Paper (Free):

Abstract

Most approaches to human action recognition is limited due to the use of simple action datasets under controlled environments or focus on excessively localized features without sufficiently exploring the spatio-temporal information. This paper proposed a framework for recognizing realistic human actions. Specifically, a new action representation is proposed based on computing a rich set of descriptors from keypoint trajectories. To obtain efficient and compact representations for actions, we develop a feature fusion method to combine spatial-temporal local motion descriptors by the movement of the camera which is detected by the distribution of spatio-temporal interest points in the clips. A new topic model called Markov Semantic Model is proposed for semantic feature selection which relies on the different kinds of dependencies between words produced by “syntactic ” and “semantic” constraints. The informative features are selected collaboratively based on the different types of dependencies between words produced by short range and long range constraints. Building on the nonlinear SVMs, we validate this proposed hierarchical framework on several realistic action datasets.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Jia Liu, Xiaonian Wang, Tianyu Li and Jie Yang, "Spatio-temporal Semantic Features for Human Action Recognition," KSII Transactions on Internet and Information Systems, vol. 6, no. 10, pp. 2632-2649, 2012. DOI: 10.3837/tiis.2012.10.011

[ACM Style]
Liu, J., Wang, X., Li, T., and Yang, J. 2012. Spatio-temporal Semantic Features for Human Action Recognition. KSII Transactions on Internet and Information Systems, 6, 10, (2012), 2632-2649. DOI: 10.3837/tiis.2012.10.011