Topic: auditing

The study audits nine public policy-based decision benchmarks, revealing that following written rules does not always lead to correct outcomes due to benchmark errors, highlighting the need for revising these benchmarks to better align with actual decision requirements.

arxiv.org↗

AI systems perpetuate harm to queer communities through biased training data, misclassification, and discrimination, but standard technical audits fail to address these issues effectively. This highlights the need for community-based auditing to better protect queer rights and prevent further marginalization.

arxiv.org↗

The study examines whether activation interventions that prompt a language model to generate a specific response also allow the model to appropriately apply intended conditions in subsequent computations, using Qwen3.5-27B for tool-use tasks involving time or permission constraints. This research is crucial for understanding how language models can be guided to use targeted information correctly across multiple steps, enhancing their reliability and utility.

arxiv.org↗