ggerganov/llama.cpp Released Version b12405
Release b12405 of llama.cpp introduces a fix that properly rejects out-of-range grammar trigger types instead of causing the application to abort. Additionally, it removes an invalid grammar trigger type regression test. This bug fix improves the overall stability and robustness of grammar-constrained generation in llama.cpp, preventing unexpected crashes when invalid configurations or edge cases occur. It ensures a smoother developer experience for applications relying on structured output generation. The patch addresses issue #30835 and pull request #31478 by gracefully handling out-of-range grammar trigger types in the common codebase. It also cleans up test suites by removing the obsolete regression test associated with this condition.
## BACKGROUND
llama.cpp is a widely used open-source library that enables efficient inference for large language models locally on various hardware backends. Grammar constraints in llama.cpp allow developers to strictly control the syntactic structure of the model's text generation output.