Topic: prefixes

The ggml/llama.cpp project released a new version that limits shared prefixes to the first required output position, ensuring decision output embeddings remain available. This update addresses issues with shared options in tasks and enhances the system's flexibility in handling multiple questions simultaneously.

github.com↗