Looking deeper into Time for Activities of Daily Living Recognition

Srijan Das 1 Monique Thonnat 1 Francois Bremond 1
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : In this paper, we introduce a new approach for Activities of Daily Living (ADL) recognition. In order to discriminate between activities with similar appearance and motion, we focus on their temporal structure. Actions with subtle and similar motion are hard to disambiguate since long-range temporal information is hard to encode. So, we propose an end-to-end Temporal Model to incorporate long-range temporal information without losing subtle details. The temporal structure is represented globally by different temporal granularities and locally by temporal segments. We also propose a two-level pose driven attention mechanism to take into account the relative importance of the segments and granularities. We validate our approach on 2 public datasets: a 3D human activity dataset (NTU-RGB+D) and a human action recognition dataset with object interaction dataset (Northwestern-UCLA Multiview Action 3D). Our Temporal Model can also be incorporated with any existing 3D CNN (including attention based) as a backbone which reveals its robustness.
Document type :
Conference papers
Complete list of metadatas

Cited literature [40 references]  Display  Hide  Download

https://hal.inria.fr/hal-02368366
Contributor : Srijan Das <>
Submitted on : Monday, November 18, 2019 - 3:02:20 PM
Last modification on : Tuesday, November 19, 2019 - 1:26:44 AM

File

WACV_2020.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02368366, version 1

Collections

Citation

Srijan Das, Monique Thonnat, Francois Bremond. Looking deeper into Time for Activities of Daily Living Recognition. IEEE Winter Conference on Applications of Computer Vision, WACV 2020, Mar 2020, Snowmass village, Colorado, United States. ⟨hal-02368366⟩

Share

Metrics

Record views

32

Files downloads

56