Topic: eviction

ggml/llama.cpp updated its server code to apply checkpoint min-step eviction only when the checkpoint list is full, addressing how checkpoints are managed for prompts shorter than checkpoint_min_step. This change ensures more efficient management of memory and resources, particularly important for optimizing performance in scenarios with frequent or short prompts.