1 code implementation • 4 Feb 2024 • Fangzhao Zhang, Mert Pilanci
In this work we study the enhancement of Low Rank Adaptation (LoRA) fine-tuning procedure by introducing a Riemannian preconditioner in its optimization step.
no code implementations • 3 Feb 2024 • Fangzhao Zhang, Mert Pilanci
Diffusion models are becoming widely used in state-of-the-art image, video and audio generation.