Topic: top_k

The ggml/llama.cpp project updated to enable support for the TOP_K operation on the Hexagon processor, improving row partitioning and optimizing large-row selection. This update is crucial as it enhances the efficiency of operations involving top-k elements in machine learning models running on Hexagon hardware.

ggml/llama.cpp released an update that includes a new SYCL backend feature using radix select for top_k operations, enabling GPU-resident processing for larger k values and improving performance by parallelizing computations across devices. This update is significant as it addresses the previous limitation of the SYCL backend for large k values, previously restricted to k = 32, thereby enhancing the efficiency of top-k operations on GPUs.