Ray is a unified framework for scaling AI and Python applications. Ray c...
A flexible, high-performance serving system for machine learning models
AI + Data, online. https://vespa.ai
In this repository, I will share some useful notes and references about ...
An MLOps framework to package, deploy, monitor and manage thousands of p...
Serve, optimize and scale PyTorch models in production
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️...
Database system for AI-powered apps
TensorFlow template application for deep learning
DELTA is a deep learning based natural language and speech processing pl...
A comprehensive guide to building RAG-based LLM applications for product...
RayLLM - LLMs on Ray
A flexible, high-performance carrier for machine learning models（『飞桨...
Generic and easy-to-use serving service for machine learning models
A scalable inference server for models optimized with OpenVINO™