REASONS: A benchmark for REtrieval and Automated citationS Of scieNtific Sentences using Public and Proprietary LLMs

no code implementations • 3 May 2024 • Deepa Tilwani, Yash Saxena, Ali Mohammadi, Edward Raff, Amit Sheth, Srinivasan Parthasarathy, Manas Gaur

Automatic citation generation for sentences in a document or report is paramount for intelligence analysts, cybersecurity, news agencies, and education personnel.

Hallucination Retrieval +1

Evaluating Consistency and Reasoning Capabilities of Large Language Models

no code implementations • 25 Apr 2024 • Yash Saxena, Sarthak Chopra, Arunendra Mani Tripathi

Queries from the dataset are presented as prompts to the LLMs, and the generated responses are evaluated against the ground truth answers.

General Knowledge Text Generation