IST-Unbabel Participation in the WMT20 Quality Estimation Shared Task

no code implementations • WMT (EMNLP) 2020 • João Moura, Miguel Vera, Daan van Stigt, Fabio Kepler, André F. T. Martins

We present the joint contribution of IST and Unbabel to the WMT 2020 Shared Task on Quality Estimation.

Machine Translation Translation

IST-Unbabel 2021 Submission for the Quality Estimation Shared Task

no code implementations • WMT (EMNLP) 2021 • Chrysoula Zerva, Daan van Stigt, Ricardo Rei, Ana C Farinha, Pedro Ramos, José G. C. de Souza, Taisiya Glushkova, Miguel Vera, Fabio Kepler, André F. T. Martins

We present the joint contribution of IST and Unbabel to the WMT 2021 Shared Task on Quality Estimation.

Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared Task

1 code implementation • WMT (EMNLP) 2021 • Ricardo Rei, Ana C Farinha, Chrysoula Zerva, Daan van Stigt, Craig Stewart, Pedro Ramos, Taisiya Glushkova, André F. T. Martins, Alon Lavie

In this paper, we present the joint contribution of Unbabel and IST to the WMT 2021 Metrics Shared Task.

xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection

no code implementations • 16 Oct 2023 • Nuno M. Guerreiro, Ricardo Rei, Daan van Stigt, Luisa Coheur, Pierre Colombo, André F. T. Martins

Widely used learned metrics for machine translation evaluation, such as COMET and BLEURT, estimate the quality of a translation hypothesis by providing a single sentence-level score.

Machine Translation Sentence +1

Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task

no code implementations • 21 Sep 2023 • Ricardo Rei, Nuno M. Guerreiro, José Pombal, Daan van Stigt, Marcos Treviso, Luisa Coheur, José G. C. de Souza, André F. T. Martins

Our team participated on all tasks: sentence- and word-level quality prediction (task 1) and fine-grained error span detection (task 2).

Sentence Task 2