The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.1...v1.2.2
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.1a1...v1.2.1
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0...v1.2.1
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0...v1.2.1a1
🍱 We are excited to share with you that we have released BentoML v1.2
, the biggest release since the launch of v1.0
. This release includes improvements from all the learning and feedback from our community over the past year. We invite you to read our release blog post for a comprehensive overview of the new features and the motivations behind their development.
Here are a few key points to note before we delve into the new features:
v1.2
ensures complete backward compatibility, meaning that Bentos built with v1.1
will continue to function seamlessly with this release.v1.1
. Critical bug fixes and security updates will be backported to the v1.1
branch.v1.2
. More guides are being added every week.v1.1
and v1.2
releases of BentoML.⛏️ Introduced a simplified service SDK to empower developers with greater control and flexibility.
@bentoml.service
and @bentoml.api
decorators to customize the behaviors of services and APIs.@bentoml.service
next to the class definition.🔭 Revamped IO descriptors with more familiar input and output types.
📦 Updated model saving and loading API to be more generic to enable integration with more ML frameworks.
bentoml.models.create
API instead of framework specific APIs, e.g. bentoml.pytorch.save_model
, bentoml.tensorflow.save_model
.🚚 Streamlined the deployment workflow to allow more rapid development iterations and a faster time to production.
🎨 Improved API development experience with generated web UI and rich Python client.
🎭 We've learned that the best way to showcase what BentoML can do is not through dry, conceptual documentation but through real-world examples. Check out our current list of examples, and we'll continue to publish new ones to the gallery as exciting new models are released.
🙏 Thank you for your continued support!
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0rc1...v1.2.0
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0a7...v1.2.0rc1
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0a6...v1.2.0a7
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0a5...v1.2.0a6
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0a4...v1.2.0a5
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0a3...v1.2.0a4
Full Changelog: https://github.com/bentoml/BentoML/compare/v1.2.0a2...v1.2.0a3