About
Python library for structured text generation. JSON mode, grammar-guided generation for LLMs.
Features
- JSON schema guided generation for arbitrary structured outputs.
- Context-free grammar (CFG) support for domain-specific languages.
- Integration with Hugging Face Transformers for local model inference.
- Lightweight and fast logit masking algorithm.
- Support for iterative generation with dynamic grammar updates.
Links
Categories
Reviews
4.1
Write a Review
Get new AI tools weekly
Subscribe to our newsletter and never miss a tool.
Get new AI tools weekly
Subscribe to our newsletter and never miss a tool.