no code implementations • 12 Dec 2023 • Mohammed Maqsood Shaik, Dietrich Klakow, Badr M. Abdullah
To address this challenge, we propose self-supervised adaptive pre-training (SAPT) to adapt the pre-trained model to the target domain and languages of the downstream task.
1 code implementation • 4 Jun 2023 • Badr M. Abdullah, Mohammed Maqsood Shaik, Bernd Möbius, Dietrich Klakow
Self-supervised representation learning for speech often involves a quantization step that transforms the acoustic input into discrete units.