Topic: judges

A new method uses cheaper open-source language models to grade natural-language mathematical proofs, reducing costs associated with evaluating math-reasoning systems. This approach addresses the high expense of using advanced language models like LLMs for such tasks.

arxiv.org↗

A new method called Chain-of-Models aims to audit large language models (LLMs) used as judges to reduce bias, addressing limitations of current mitigation techniques that are either ineffective against various biases or impractical at scale due to reliance on human evaluation.

arxiv.org↗