Topic: asynchronous

The ggml/llama.cpp project released an update that enhances support for multi-NPU devices, making the backend fully asynchronous by default. This update is significant as it improves performance and flexibility in deploying models across multiple hardware accelerators.