Search Results for author: Fangzhao Zhang

Found 2 papers, 1 papers with code

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models

1 code implementation4 Feb 2024 Fangzhao Zhang, Mert Pilanci

In this work we study the enhancement of Low Rank Adaptation (LoRA) fine-tuning procedure by introducing a Riemannian preconditioner in its optimization step.

Cannot find the paper you are looking for? You can Submit a new open access paper.