Exploring Graph-based Knowledge: Multi-Level Feature Distillation via Channels Relational Graph

no code implementations • 14 May 2024 • Zhiwei Wang, Jun Huang, Longhua Ma, Chengyu Wu, Hongyu Ma

In visual tasks, large teacher models capture essential features and deep information, enhancing performance.