no code implementations • 6 Apr 2022 • Yogesh Virkar, Marcello Federico, Robert Enyedi, Roberto Barra-Chicote
The goal of automatic dubbing is to perform speech-to-speech translation while achieving audiovisual coherence.
no code implementations • 8 Oct 2021 • Surafel M. Lakew, Marcello Federico, Yue Wang, Cuong Hoang, Yogesh Virkar, Roberto Barra-Chicote, Robert Enyedi
Automatic dubbing aims at seamlessly replacing the speech in a video document with synthetic speech in a different language.
no code implementations • WS 2020 • Marcello Federico, Robert Enyedi, Roberto Barra-Chicote, Ritwik Giri, Umut Isik, Arvindh Krishnaswamy, Hassan Sawaf
We present enhancements to a speech-to-speech translation pipeline in order to perform automatic dubbing.
no code implementations • EMNLP (IWSLT) 2019 • Mattia Antonino Di Gangi, Robert Enyedi, Alessandra Brusadin, Marcello Federico
Our experimental results on a public speech translation data set show that adapting a model on a significant amount of parallel data including ASR transcripts is beneficial with test data of the same type, but produces a small degradation when translating clean text.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +4