Topic: automated

A new method uses cheaper open-source language models to grade natural-language mathematical proofs, reducing costs associated with evaluating math-reasoning systems. This approach addresses the high expense of using advanced language models like LLMs for such tasks.

arxiv.org↗

The study examines whether large language models can accurately predict item difficulty, crucial for educational assessments, raising questions about their reliability in automated test generation.

arxiv.org↗

A study demonstrates that prompt chaining can improve the reliability and quality of automated scholarly report generation, addressing limitations of simpler prompting methods in handling complex synthesis tasks. This matters because it highlights potential advancements in automating information synthesis for the vast volume of scholarly publications.

arxiv.org↗

A new study proposes using large language models to help verify claims within papers during the peer review process, aiming to address the increasing volume of scientific submissions. This method could enhance the accuracy of assessing a paper's originality and significance by comparing its content directly with existing literature.

arxiv.org↗

A new system using LLMs for trace ranking and grouped reward modeling is developed to verify multilingual numerical claims, addressing the challenge of combining language understanding with quantitative reasoning. This system is part of an entry for the CLEF 2026 CheckThat! Task 2, highlighting advancements in automated claim verification.

arxiv.org↗