Topic: gdn

The ggml/llama.cpp project updated its models to use `rsqrt` normalization for GDN instead of `max`, and implemented an L2 norm for gated delta net q/k, enhancing model performance according to changes from flash-linear-attention. These updates are significant as they improve the efficiency and accuracy of the models used in natural language processing tasks.