no code implementations • WMT (EMNLP) 2020 • Ricardo Rei, Craig Stewart, Ana C Farinha, Alon Lavie
We present the contribution of the Unbabel team to the WMT 2020 Shared Task on Metrics.
no code implementations • EAMT 2022 • Madalena Gonçalves, Marianna Buchicchio, Craig Stewart, Helena Moniz, Alon Lavie
This paper illustrates a new evaluation framework developed at Unbabel for measuring the quality of source language text and its effect on both Machine Translation (MT) and Human Post-Edition (PE) performed by non-professional post-editors.
1 code implementation • WMT (EMNLP) 2021 • Ricardo Rei, Ana C Farinha, Chrysoula Zerva, Daan van Stigt, Craig Stewart, Pedro Ramos, Taisiya Glushkova, André F. T. Martins, Alon Lavie
In this paper, we present the joint contribution of Unbabel and IST to the WMT 2021 Metrics Shared Task.
no code implementations • WMT (EMNLP) 2021 • Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George Foster, Alon Lavie, Ondřej Bojar
Contrary to previous years’ editions, this year we acquired our own human ratings based on expert-based human evaluation via Multidimensional Quality Metrics (MQM).
no code implementations • ACL 2021 • Ricardo Rei, Ana C Farinha, Craig Stewart, Luisa Coheur, Alon Lavie
We present MT-Telescope, a visualization platform designed to facilitate comparative analysis of the output quality of two Machine Translation (MT) systems.
1 code implementation • 29 Oct 2020 • Ricardo Rei, Craig Stewart, Catarina Farinha, Alon Lavie
Overall, our systems achieve strong results for all language pairs on previous test sets and in many cases set a new state-of-the-art.
1 code implementation • EMNLP 2020 • Ricardo Rei, Craig Stewart, Ana C Farinha, Alon Lavie
We present COMET, a neural framework for training multilingual machine translation evaluation models which obtains new state-of-the-art levels of correlation with human judgements.
no code implementations • 12 Aug 2020 • Ahmed Alamri, Mohammad Alshehri, Alexandra I. Cristea, Filipe D. Pereira, Elaine Oliveira, Lei Shi, Craig Stewart
While Massive Open Online Course (MOOCs) platforms provide knowledge in a new and unique way, the very high number of dropouts is a significant drawback.
1 code implementation • NAACL 2019 • Nikolai Vogler, Craig Stewart, Graham Neubig
Simultaneous interpretation, the translation of speech from one language to another in real-time, is an inherently difficult and strenuous task.
1 code implementation • NAACL 2019 • Vaibhav Vaibhav, Sumeet Singh, Craig Stewart, Graham Neubig
Modern Machine Translation (MT) systems perform consistently well on clean, in-domain text.
1 code implementation • ACL 2018 • Craig Stewart, Nikolai Vogler, Junjie Hu, Jordan Boyd-Graber, Graham Neubig
Simultaneous interpretation, translation of the spoken word in real-time, is both highly challenging and physically demanding.