Topic: distortions

A new study called SWORD highlights hidden inconsistencies in large language models' factual accuracy across languages by introducing a method that distorts data from Wikidata, showing the limitations of current evaluation methods which focus on correct answers rather than true understanding. This matters because it reveals how existing benchmarks may not fully test the models' ability to handle complex multilingual information accurately.

arxiv.org↗