MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning

no code implementations • 27 Feb 2024 • Huiyu Xiong, Lanxiao Wang, Heqian Qiu, Taijin Zhao, Benliu Qiu, Hongliang Li

Further, in order to better constrain the knowledge characteristics of old and new tasks at the specific feature level, we have created the Two-stage Knowledge Distillation (TsKD), which is able to learn the new task well while weighing the old task.

Class Incremental Learning Incremental Learning +2

GRSDet: Learning to Generate Local Reverse Samples for Few-shot Object Detection

no code implementations • 27 Dec 2023 • Hefei Mei, Taijin Zhao, Shiyuan Tang, Heqian Qiu, Lanxiao Wang, Minjian Zhang, Fanman Meng, Hongliang Li

By transferring the knowledge of IFC from the base training to fine-tuning, the IFC generates plentiful novel samples to calibrate the novel class distribution.

Few-Shot Object Detection object-detection +1

RefCrowd: Grounding the Target in Crowd with Referring Expressions

no code implementations • 16 Jun 2022 • Heqian Qiu, Hongliang Li, Taijin Zhao, Lanxiao Wang, Qingbo Wu, Fanman Meng

Unfortunately, there is no effort to explore crowd understanding in multi-modal domain that bridges natural language and computer vision.

Attribute Referring Expression +1