About
run LLM backends, APIs, frontends, and services with one command
Features
- One-command deployment of LLM backends, APIs, and frontends
- Support for llama.cpp, Ollama, vLLM, and text-generation-webui
- Automatic port allocation and conflict detection
- Built-in monitoring with Prometheus and Grafana integration
- YAML-based configuration for custom model paths and parameters
Links
Categories
Reviews
0
Write a Review
Get new AI tools weekly
Subscribe to our newsletter and never miss a tool.
Get new AI tools weekly
Subscribe to our newsletter and never miss a tool.