Search Results for author:
Found 2 papers, 2 papers with code
Repetition Improves Language Model Embeddings
In this work, we address an architectural limitation of autoregressive models: token embeddings cannot contain information from tokens that appear later in the input.
Understanding Catastrophic Forgetting in Language Models via Implicit Inference
We lack a systematic understanding of the effects of fine-tuning (via methods such as instruction-tuning or reinforcement learning from human feedback), particularly on tasks outside the narrow fine-tuning distribution.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
