Topic: quantization

Ollama released version 0.34.1, which marks the full integration of MLX safetensors support in their `ollama create` command and introduces stricter conditions for detecting runaway repeat tokens. These updates enhance model handling on Apple Silicon and improve overall stability.

The ggml/llama.cpp project updated its CUDA implementation to provide more control over quantization options, allowing users to configure specific combinations and enabling runtime fallbacks for unsupported configurations. These changes enhance flexibility and usability, making the library more adaptable to various hardware setups.