Topic: head_dim

The ggml/llama.cpp project released an update that enables the HMX flash-attention mechanism to support head_dim values not divisible by 64, enhancing flexibility in model configurations. This update is significant as it broadens compatibility and potential optimizations for models like SigLIP with specific head_dim requirements.