PromptEval
prompt-eval.com
- Free plan
- Web
- API
What PromptEval is
PromptEval is a web and API service for evaluating and optimizing prompts for large language models. It produces a reproducible score from 0 to 100, with diagnostics for clarity, specificity, structure and robustness. Its analysis identifies critical issues, warnings, strengths and recommendations. A token optimizer can compress prompts while preserving intent and reports the percentage reduction.
The versioned library stores prompts with score histories and diffs. The A/B Playground compares two prompts across up to seven criteria using a user-provided API key and displays radar-chart results. An official GitHub Action can fail a pull request for a score drop, contradiction or regression against production. Pro and Team users can serve a production prompt by slug through an API endpoint; changes take effect in about 60 seconds. The free plan includes three web evaluations monthly, 10 API lint calls, up to five library prompts and an 8,000-character prompt limit. Basic costs $9 a month and Pro costs $19 a month. API quotas range from 10 to 250 calls monthly by plan, with a five-requests-per-minute rate limit. PromptEval says prompts are discarded after evaluation and are not used to train AI models.
Who it suits
PromptEval is positioned for solo developers, developers using AI at work, and teams shipping or governing production prompts. The free plan may suit people evaluating prompts within its monthly and character limits.
Good to know, and what to watch
- Scores prompts across four diagnostic dimensions.
- Library keeps version history, scores and diffs.
- GitHub Action can flag prompt regressions in pull requests.
- BYOK inference consumes no managed quota.
- Free plan includes only three web evaluations monthly.
- API has a five-requests-per-minute rate limit.
- Free plan limits prompts to 8,000 characters.
Plans
Every plan and priceTeam
Free
Basic
Pro
Free plan
The verdict
PromptEval combines prompt scoring, optimization, versioning and workflow checks, with a free plan for limited use. Check the plan quotas and API rate limit against the volume and prompt size you need.
What the maker publishes
- A/B testing
- The A/B Playground tests two prompts with a user-provided API key across up to seven criteria and displays radar-chart results. source
- API limits
- The Eval API has managed monthly quotas of 10, 30, 75, and 250 calls for Free, Basic, Pro, and Team, respectively, with a 5-requests-per-minute rate limit. source
- BYOK
- An Anthropic key supplied through X-Provider-Key runs inference on the user's key, consumes no managed quota, and unlocks full mode on every plan. source
- CI integration
- The official GitHub Action can fail a pull request when a score drops, a contradiction appears, or a prompt regresses against production. source
- Optimization
- The token optimizer compresses prompts while preserving intent and reports the percentage reduction. source
- Privacy and security
- PromptEval says prompts are discarded after evaluation, never used to train AI models, protected by Row Level Security, and transmitted over HTTPS. source
- Production serving
- Pro and Team users can serve a production prompt by slug through GET /api/v1/prompts/{slug} without redeploying, with changes taking effect in about 60 seconds. source
- Product purpose
- PromptEval evaluates and optimizes prompts for large language models as a SaaS platform. source
- Prompt analysis
- The evaluator returns critical issues, warnings, strengths, and surgical recommendations for prompt improvements. source
- Scoring
- It provides a reproducible 0–100 score with diagnostics across clarity, specificity, structure, and robustness. source
- Support
- The Team plan includes priority support with a stated 24-hour response target. source
- Target users
- The product is positioned for solo developers, developers using AI at work, developers shipping prompts to production, and teams governing production prompts. source
- Versioning
- The versioned library stores prompt versions with score history and diffs. source
Checked against the maker's pages on 30 Sept 2026.