Search Results for author: Matúš Pikuliak

Found 8 papers, 6 papers with code

Women Are Beautiful, Men Are Leaders: Gender Stereotypes in Machine Translation and Language Modeling

no code implementations30 Nov 2023 Matúš Pikuliak, Andrea Hrckova, Stefan Oresko, Marián Šimko

We present GEST -- a new dataset for measuring gender-stereotypical reasoning in masked LMs and English-to-X machine translation systems.

Language Modelling Machine Translation +1

Disinformation Capabilities of Large Language Models

1 code implementation15 Nov 2023 Ivan Vykopal, Matúš Pikuliak, Ivan Srba, Robert Moro, Dominik Macko, Maria Bielikova

Automated disinformation generation is often listed as an important risk associated with large language models (LLMs).

MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark

1 code implementation20 Oct 2023 Dominik Macko, Robert Moro, Adaku Uchendu, Jason Samuel Lucas, Michiharu Yamashita, Matúš Pikuliak, Ivan Srba, Thai Le, Dongwon Lee, Jakub Simko, Maria Bielikova

There is a lack of research into capabilities of recent LLMs to generate convincing text in languages other than English and into performance of detectors of machine-generated text in multilingual settings.

Benchmarking Text Detection

In-Depth Look at Word Filling Societal Bias Measures

1 code implementation24 Feb 2023 Matúš Pikuliak, Ivana Beňová, Viktor Bachratý

Many measures of societal bias in language models have been proposed in recent years.

Average Is Not Enough: Caveats of Multilingual Evaluation

1 code implementation3 Jan 2023 Matúš Pikuliak, Marián Šimko

This position paper discusses the problem of multilingual evaluation.

Position

Cannot find the paper you are looking for? You can Submit a new open access paper.