From CNNs to Transformers in Multimodal Human Action Recognition: A Survey

no code implementations • 22 May 2024 • Muhammad Bilal Shaikh, Syed Mohammed Shamsul Islam, Douglas Chai, Naveed Akhtar

We analyze the classic and emerging techniques in this regard, while also highlighting the popular trends in the adaption of CNN and Transformer building blocks for the overall problem.

Action Recognition Temporal Action Localization

MAiVAR-T: Multimodal Audio-image and Video Action Recognizer using Transformers

no code implementations • 1 Aug 2023 • Muhammad Bilal Shaikh, Douglas Chai, Syed Mohammed Shamsul Islam, Naveed Akhtar

This model employs an intuitive approach for the combination of audio-image and video modalities, with a primary aim to escalate the effectiveness of multimodal human action recognition (MHAR).

Action Recognition Temporal Action Localization

MAiVAR: Multimodal Audio-Image and Video Action Recognizer

no code implementations • IEEE International Conference on Visual Communications and Image Processing (VCIP) 2023 • Muhammad Bilal Shaikh, Douglas Chai, Syed Mohammed Shamsul Islam, Naveed Akhtar

Currently, action recognition is predominately performed on video data as processed by CNNs.

Action Recognition