Topic: retrieval

A new benchmark called SRRM has been introduced to evaluate the long-context memory capabilities of small language models, addressing the need for better understanding and assessment of these models' abilities to retain information over extended text sequences. This is crucial as SLMs are increasingly used on consumer-grade hardware where handling longer contexts poses significant challenges.

arxiv.org↗

A new method called retrieval-augmented generation (RAG) allows large language models to answer factual questions outside their training data, but at increased storage and inference costs. To address these costs, researchers propose distilling retrieved information into parametric memories for reuse, enhancing efficiency while maintaining performance.

arxiv.org↗

The study highlights how incomplete relevance judgments in conversational Retrieval-Augmented Generation (RAG) benchmarks distort the evaluation of systems' ability to abstain from answering, as each system uses its own retrieval, making it challenging to accurately score when a retrieved context is insufficient. This matters because it affects the reliability of benchmark evaluations and could lead to misleading conclusions about system performance.

arxiv.org↗

The article describes how to create an advanced stateful engineering copilot using Letta, focusing on features like core memory, shared state, and custom tools. This matters because it enhances the capabilities of AI assistants beyond basic prompts, offering more sophisticated and collaborative support for engineers.

marktechpost.com↗