Search Results for author: Josh Magnus Ludan

Found 3 papers, 2 papers with code

RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors

no code implementations13 May 2024 Liam Dugan, Alyssa Hwang, Filip Trhlik, Josh Magnus Ludan, Andrew Zhu, Hainiu Xu, Daphne Ippolito, Chris Callison-Burch

However, very few of these detectors are evaluated on shared benchmark datasets and even when they are, the datasets used for evaluation are insufficiently challenging -- lacking variations in sampling strategy, adversarial attacks, and open-source generative models.

Adversarial Robustness Text Detection

Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneck

1 code implementation30 Oct 2023 Josh Magnus Ludan, Qing Lyu, Yue Yang, Liam Dugan, Mark Yatskar, Chris Callison-Burch

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability.

Language Modelling Large Language Model +2

Explanation-based Finetuning Makes Models More Robust to Spurious Cues

1 code implementation8 May 2023 Josh Magnus Ludan, Yixuan Meng, Tai Nguyen, Saurabh Shah, Qing Lyu, Marianna Apidianaki, Chris Callison-Burch

Large Language Models (LLMs) are so powerful that they sometimes learn correlations between labels and features that are irrelevant to the task, leading to poor generalization on out-of-distribution data.

Cannot find the paper you are looking for? You can Submit a new open access paper.