EvalPlus

6.2easy start · #15 of 29
in LLM Evaluation Tools

Free to practise onnot on record
Free trialnot on record
Well documentedyes
Runs where you worknot on record

Runs on api, Linux, self-hosted.

Visit site Alternatives

EvalPlus is ranked #15 of 29 in LLM evaluation tools on The Geeks Club. It runs on API, Linux, Self-hosted.

Compared on LLM evaluation tools

Deployment options: self-hosted

Best EvalPlus alternatives

See all 20

Maxim AI 0 of 4 in the starter kit Lesson 17.7 Promptfoo 0 of 4 in the starter kit Lesson 27.4 DeepEval 0 of 4 in the starter kit Lesson 37.3 Giskard 0 of 4 in the starter kit Lesson 47.2 Braintrust 0 of 4 in the starter kit Lesson 57.1 Galileo 0 of 4 in the starter kit Lesson 67.1

The record

Purpose: EvalPlus is an evaluation framework for assessing code generated by large language models.
HumanEval+: HumanEval+ expands the original HumanEval benchmark with 80 times more tests.
MBPP+: MBPP+ expands the original MBPP benchmark with 35 times more tests.
Efficiency evaluation: EvalPerf evaluates the efficiency of LLM-generated code using performance-exercising tasks and test inputs.
Leaderboard: The EvalPlus site provides leaderboards for HumanEval+ and MBPP+ evaluation results.
EvalPerf leaderboard: The EvalPlus site provides a leaderboard for EvalPerf code efficiency results.
RepoQA: The EvalPlus site describes RepoQA as a project to design evaluators for long-context code understanding.
Installation: The README documents installation through pip, including optional vLLM and performance extras.
Docker: The README documents running code evaluation in Docker.
Model backends: Documented backends include Hugging Face Transformers, vLLM, OpenAI-compatible servers, OpenAI, Anthropic, Google, Amazon Bedrock, Ollama, and Intel Gaudi.
Security: The README describes Docker-based code execution as safe code execution.
Platform limit: The README labels EvalPerf code efficiency evaluation as *nix only.
License: The repository is distributed under the Apache License, Version 2.0; the license notes that files under evalplus/eval additionally comply with the MIT License.
Intended audience: The project is intended for evaluating LLM performance on code-related tasks.

Where it ranks on The Geeks Club

Best LLM Evaluation Tools in 2026#15 of 29

Is EvalPlus yours?

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.

Claim it free Promote EvalPlus

Sources

github.com/evalplus/evalplus· checked 5 Oct 2026
evalplus.github.io· checked 5 Oct 2026
github.com/evalplus/evalplus/blob/master/LICENSE· checked 5 Oct 2026