PromptLens
promptlens.io
- Free plan
- Web
What PromptLens is
PromptLens is a web platform for managing prompts, evaluating changes, and observing production LLM workflows. Teams can compare a candidate prompt with the production version on one dataset, then inspect score changes, outputs, and failures. An LLM judge checks each output against an expected answer and returns pass or fail with a short explanation. Prompt versioning lets users publish the version an application needs through a retrieval API. Observability traces production model calls, tools, and retrieval, including timing, errors, usage, and cost. Listed providers include OpenAI, Anthropic, Google, xAI, Meta, DeepSeek, Mistral, Cohere, and Amazon. Organizations may connect a provider API key or use purchased OpenRouter credits. Shared reports open without accounts or paid seats. The Free plan costs $0 per organization per month; Pro costs $99 per organization per month. Access requires early-access approval.
Who it suits
PromptLens suits teams shipping production LLM workflows that need prompt versioning, evaluations, and observability. It is also suited to organizations testing multiple model providers.
Good to know, and what to watch
- Prompt versioning with retrieval API publishing
- Evaluation compares candidate and production prompts
- Traces calls, tools, retrieval, timing, and cost
- Shared reports need no account or paid seat
- Free plan available
- Product access requires early-access approval
- Evaluations are not automatic CI release gates
- Free plan has limited members and projects
- Pro costs $99 per organization monthly
Plans
Every plan and priceTeams
Free
Pro
Free plan
The verdict
PromptLens combines prompt management, dataset evaluations, and production tracing in a web service. Its free plan provides an entry point, while larger limits and support are available on paid plans.
What the maker publishes
- Availability
- The evaluations page says product access is subject to early-access approval. source
- Cookies
- The privacy policy says PromptLens uses essential cookies for sessions and preferences and does not use tracking or advertising cookies. source
- Data retention
- Users can delete datasets, prompts, and experiments at any time; after account deletion, PromptLens says it will delete the user's data within 30 days. source
- Evaluation workflow
- Teams can compare a candidate prompt version with the production version on the same dataset, then review score changes, outputs, and failures. source
- Model access
- Organizations can connect a provider API key or use purchased credits to run models through OpenRouter without adding a key. source
- Model providers
- The homepage lists OpenAI, Anthropic, Google, xAI, Meta, DeepSeek, Mistral, Cohere, and Amazon among the model providers teams can test across. source
- Observability
- The site says its observability product traces production model calls, tools, and retrieval, including timing, errors, usage, and cost. source
- Prompt management
- PromptLens lets users version prompts and publish the version their application needs through a retrieval API. source
- Release control
- Evaluations provide evidence and warnings for release decisions, but they are not an automatic CI release gate. source
- Scoring
- An LLM judge compares each output to an expected answer and returns pass or fail with a short explanation. source
- Security
- The privacy policy says sensitive data is encrypted at rest, data is transmitted over HTTPS, and access to user data is restricted to authorized personnel. source
- Shared reports
- Anyone with a shared report link can open it without an account or paid seat, and shared report links are unlimited on every plan. source
- Support
- The Free plan includes email support, Pro includes priority email support, and Teams includes dedicated support. source
- What it does
- PromptLens provides prompt management, evaluations, and observability for teams shipping production LLM workflows. source
Checked against the maker's pages on 2 Oct 2026.