1 code implementation • 15 Dec 2023 • Björn Engelmann, Timo Breuer, Jana Isabelle Friese, Philipp Schaer, Norbert Fuhr
The proposed query generation methods build upon recent Large Language Model (LLM) approaches and consider the user's context throughout the simulation of a search session.
1 code implementation • 18 Oct 2023 • Björn Engelmann, Timo Breuer, Philipp Schaer
Our multi-perspective evaluation scheme reveals new insights about query strategies, the impact of modalities, and different user types in simulated WTR search sessions.
1 code implementation • 11 Oct 2023 • Timo Breuer, Norbert Fuhr, Philipp Schaer
Our setup is entirely open, and we share the code to reproduce the experiments.
no code implementations • 21 Aug 2023 • Jüri Keller, Timo Breuer, Philipp Schaer
As a result, we quantify the persistence of the submitted runs and see great potential in this evaluation method.
no code implementations • 24 Oct 2022 • Timo Breuer, Narges Tavakolpoursaleh, Johann Schaible, Daniel Hienert, Philipp Schaer, Leyla Jael Castro
Involving users in early phases of software development has become a common strategy as it enables developers to consider user needs from the beginning.
1 code implementation • 18 Jul 2022 • Timo Breuer, Jüri Keller, Philipp Schaer
Additionally, we curate a dataset with run files derived from experiments with different instantiations of PRIMAD components and annotate these with the corresponding metadata.
1 code implementation • 10 Mar 2022 • Philipp Schaer, Timo Breuer, Leyla Jael Castro, Benjamin Wolff, Johann Schaible, Narges Tavakolpoursaleh
The evaluation of results and a meta-analysis of the different tasks and submission types complement this overview.
1 code implementation • 10 Mar 2022 • Timo Breuer, Melanie Pest, Philipp Schaer
In this work, we analyze a pseudo-relevance retrieval method based on the results of web search engines.
1 code implementation • 19 Jan 2022 • Timo Breuer, Norbert Fuhr, Philipp Schaer
System-oriented IR evaluations are limited to rather abstract understandings of real user behavior.
1 code implementation • 19 Jan 2022 • Timo Breuer, Nicola Ferro, Maria Maistro, Philipp Schaer
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented information retrieval (IR) experiments.
1 code implementation • 22 Nov 2021 • Florian Fervers, Timo Breuer, Gregor Stachowiak, Sebastian Bullinger, Christoph Bodensteiner, Michael Arens
Models for semantic segmentation require a large amount of hand-labeled training data which is costly and time-consuming to produce.
1 code implementation • 26 Oct 2020 • Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, Ian Soboroff
Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception.
no code implementations • 6 Aug 2020 • Stéphane Vujasinović, Stefan Becker, Timo Breuer, Sebastian Bullinger, Norbert Scherer-Negenborn, Michael Arens
The 3D reconstruction of the scene is computed with an image-based Structure-from-Motion (SfM) component that enables us to leverage a state estimator in the corresponding 3D scene during tracking.