no code implementations • 30 May 2024 • Zhenmei Shi, Junyi Wei, Zhuoyan Xu, YIngyu Liang
This sheds light on where transformers pay attention to and how that affects ICL.
1 code implementation • 22 Feb 2024 • Zhuoyan Xu, Zhenmei Shi, Junyi Wei, Fangzhou Mu, Yin Li, YIngyu Liang
An emerging solution with recent success in vision and NLP involves finetuning a foundation model on a selection of relevant tasks, before its adaptation to a target task with limited labeled samples.
1 code implementation • 19 May 2022 • Zhuoyan Xu, Kris Sankaran
We illustrate the performance of our methods by spatial structure recovery and gene expression reconstruction in simulation.