About
Open-source platform for building and deploying ML models. Package models as production-ready APIs with containers.
Features
- Python framework to package models as 'Bentos' containing model, dependencies, and serving logic
- Auto-generated REST API with Swagger/OpenAPI documentation
- Adaptive batching for optimizing inference throughput
- Model registry for versioning, staging, and production deployment
- Distributed serving with Prometheus metrics integration
Links
Categories
Reviews
4
Write a Review
Get new AI tools weekly
Subscribe to our newsletter and never miss a tool.
Get new AI tools weekly
Subscribe to our newsletter and never miss a tool.