Serving TensorFlow models with TensorFlow Serving :orange_book:
Online Inference API for NLP Transformer models - summarization, text cl...
Kubeflow example of machine learning/model serving
A hands-on case study for demonstrating the stages involved in a machine...
Serving LLMs on heterogeneous decentralized clusters.
The easiest way to run and scale time-series machine learning in the Cloud.
MXNet Model Serving