LLM Evaluation

Giskard is an AI agent in the LLM Evaluation category. Testing & evaluation library for LLM applications, in particular ...

HELM is an AI agent in the LLM Evaluation category. Holistic Evaluation of Language Models (HELM), a framework to increa...

instruct-eval is an AI agent in the LLM Evaluation category. This repository contains code to quantitatively evaluate in...

LangSmith is an AI agent in the LLM Evaluation category. a unified platform from LangChain framework for: evaluation, co...

lighteval is an AI agent in the LLM Evaluation category. a lightweight LLM evaluation suite that Hugging Face has been u...

lm-evaluation-harness is an AI agent in the LLM Evaluation category. A framework for few-shot evaluation of language mod...

MixEval is an AI agent in the LLM Evaluation category. A reliable click-and-go evaluation suite compatible with both ope...

OLMO-eval is an AI agent in the LLM Evaluation category. a repository for evaluating open language models.

Ragas is an AI agent in the LLM Evaluation category. a framework that helps you evaluate your Retrieval Augmented Genera...

simple-evals is an AI agent in the LLM Evaluation category. Eval tools by OpenAI.