Topic: fused

The ggml/llama.cpp project released version b11026, which includes a model update to skip gate_up_exps if TENSOR_SKIP is set. This update is crucial for qwen35moe when MTP tensors are fused but not loaded, ensuring compatibility and functionality across different configurations.

The ggml/llama.cpp project released a new version addressing issues with split states and granularity for fused QKV gemm operations, crucial for models like Qwen35. This update ensures correct handling of attention layers when using specific configurations, enhancing the model's performance and accuracy.

ggml/llama.cpp released an update that includes a new SYCL backend feature using radix select for top_k operations, enabling GPU-resident processing for larger k values and improving performance by parallelizing computations across devices. This update is significant as it addresses the previous limitation of the SYCL backend for large k values, previously restricted to k = 32, thereby enhancing the efficiency of top-k operations on GPUs.