Deployment and Serving

AirLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/lyogavin/airllm.sv...

AITemplate is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/facebookincuba...

BentoML is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/bentoml/BentoML.s...

BISHENG is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/dataelement/bishe...

DeepDetect is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/jolibrain/deep...

Dynamo is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/ai-dynamo/dynamo.s...

exo is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/exo-explore/exo.svg?c...

Genkit is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/firebase/genkit.sv...

Inference is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/roboflow/infere...

IPEX-LLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/intel/ipex-llm.s...

Jina-serve is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/jina-ai/serve....

KServe is a Kubernetes Custom Resource Definition for serving predictive and generative machine learning models. It prov...

KTransformers is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/kvcache-ai/...

Langtrace is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/Scale3-Labs/lan...

Lepton AI is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/leptonai/lepton...

LightLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/ModelTC/lightllm...

LiteLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/BerriAI/litellm.s...

LitServe is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/Lightning-AI/Lit...

LocalAI is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mudler/LocalAI.sv...

MindsDB is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mindsdb/mindsdb.s...

mini-sglang is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/sgl-project/m...

MLRun is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mlrun/mlrun.svg?cac...

MLServer is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/SeldonIO/mlserve...

Mosec is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mosecorg/mosec.svg?...

nano-vllm is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/GeeeekExplorer/...

nndeploy is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/nndeploy/nndeplo...

Nuclio is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/nuclio/nuclio.svg?...

OpenVINO is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/openvinotoolkit/...

OptiLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/algorithmicsuperi...

PowerInfer is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/SJTU-IPADS/Pow...

Prompt2Model is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/neulab/promp...

RamaLama is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/containers/ramal...

RunAnywhere is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/RunanywhereAI...

Seldon Core is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/SeldonIO/seld...

text-generation-inference is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars...

TorchServe is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/pytorch/serve....

torchtune is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/meta-pytorch/to...

Transformer Lab is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/transform...

Triton Inference Server is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/t...

Vercel AI is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/vercel/ai.svg?c...

Vespa is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/vespa-engine/vespa....