AirLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/lyogavin/airllm.svg?cacheSec…
Details
AITemplate is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/facebookincubator/AITemp…
Details
BentoML is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/bentoml/BentoML.svg?cacheSe…
Details
BISHENG is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/dataelement/bisheng.svg?cac…
Details
DeepDetect is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/jolibrain/deepdetect.svg…
Details
Dynamo is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/ai-dynamo/dynamo.svg?cacheSe…
Details
exo is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/exo-explore/exo.svg?cacheSecond…
Details
Genkit is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/firebase/genkit.svg?cacheSec…
Details
Inference is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/roboflow/inference.svg?ca…
Details
IPEX-LLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/intel/ipex-llm.svg?cacheSe…
Details
Jina-serve is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/jina-ai/serve.svg?cacheS…
Details
KServe is a Kubernetes Custom Resource Definition for serving predictive and generative machine learning models. It provides a sim…
Details
KTransformers is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/kvcache-ai/ktransform…
Details
Langtrace is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/Scale3-Labs/langtrace.svg…
Details
Lepton AI is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/leptonai/leptonai.svg?cac…
Details
LightLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/ModelTC/lightllm.svg?cache…
Details
LiteLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/BerriAI/litellm.svg?cacheSe…
Details
LiteRT-LM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/google-ai-edge/LiteRT-LM.…
Details
LiteRT is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/google-ai-edge/litert.svg?ca…
Details
LitServe is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/Lightning-AI/LitServe.svg?…
Details
Llmfit is a terminal tool that optimizes LLM models for a system's hardware configuration. It detects the system's RAM, CPU, and G…
Details
LMCache is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/lmcache/lmcache.svg?cacheSe…
Details
LocalAI is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mudler/LocalAI.svg?cacheSec…
Details
MindsDB is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mindsdb/mindsdb.svg?cacheSe…
Details
mini-sglang is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/sgl-project/mini-sglang…
Details
MLRun is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mlrun/mlrun.svg?cacheSeconds=…
Details
MLServer is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/SeldonIO/mlserver.svg?cach…
Details
Model Runner is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/docker/model-runner.sv…
Details
Mosec is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/mosecorg/mosec.svg?cacheSecon…
Details
nano-vllm is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/GeeeekExplorer/nano-vllm.…
Details
nndeploy is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/nndeploy/nndeploy.svg?cach…
Details
Nuclio is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/nuclio/nuclio.svg?cacheSecon…
Details
OpenVINO is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/openvinotoolkit/openvino.s…
Details
OptiLLM is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/algorithmicsuperintelligenc…
Details
PowerInfer is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/SJTU-IPADS/PowerInfer.sv…
Details
Prompt2Model is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/neulab/prompt2model.sv…
Details
RamaLama is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/containers/ramalama.svg?ca…
Details
RunAnywhere is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/RunanywhereAI/runanywhe…
Details
Seldon Core is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/SeldonIO/seldon-core.sv…
Details
SIE is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/superlinked/sie.svg?style=socia…
Details
text-generation-inference is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/huggingfa…
Details
TorchServe is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/pytorch/serve.svg?cacheS…
Details
torchtune is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/meta-pytorch/torchtune.sv…
Details
Transformer Lab is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/transformerlab/tran…
Details
Triton Inference Server is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/triton-infe…
Details
Vercel AI is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/vercel/ai.svg?cacheSecond…
Details
Vespa is an AI agent in the Deployment and Serving category. ![](https://img.shields.io/github/stars/vespa-engine/vespa.svg?cacheS…
Details