Search Results for author: Yubin Shi

Found 2 papers, 0 papers with code

Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models

no code implementations13 May 2024 Yubin Shi, Yixuan Chen, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert P. Dick, Qin Lv, Yingying Zhao, Fan Yang, Tun Lu, Ning Gu, Li Shang

To describe such modular-level learning capabilities, we introduce a novel concept dubbed modular neural tangent kernel (mNTK), and we demonstrate that the quality of a module's learning is tightly associated with its mNTK's principal eigenvalue $\lambda_{\max}$.

Cannot find the paper you are looking for? You can Submit a new open access paper.