Best Promptfoo Alternatives in 2026
Taken from AI Security Testing Tools, where Promptfoo is listed too, in the same order.
- 1
8.5 Club scorePromptGuard
PromptGuard is a security layer between an application and its LLM provider that checks requests before they reach the model.
- Free plan
- Windows · macOS · Linux · Web
- 2 8.5 Club score
OpenSecureAI Scanner
OpenSecureAI Scanner checks untrusted text for patterns associated with prompt injection, jailbreaks, system-prompt leaks and data exfiltration.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 3
8.3 Club scoreAIRTA Red Team
AIRTA Red Team is a self-hosted tool for authorized adversarial assessments of LLMs and applications that use them.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 4 8.3 Club score
Project Moonshot
Project Moonshot is a free, open-source toolkit for evaluating the safety and reliability of large language models and applications.
- Free plan
- Windows · macOS · Linux · Web
- 5 8.0 Club score
CyberSecEval
CyberSecEval 4 is a benchmark suite for assessing cybersecurity vulnerabilities and defensive capabilities in large language models.
- Free plan
- Open source
- macOS · Linux · Web · API
- 6
8.0 Club scoreGiskard
Giskard provides tools for finding vulnerabilities in AI agents before they reach production.
- Free plan
- Open source
- Linux · Web · API · Self-hosted
- 7 7.6 Club score
PyRIT
PyRIT is a free, open-source framework for automated and human-led red teaming of generative AI systems.
- Free plan
- Windows · macOS · Linux · Web
- 8 7.6 Club score
Augustus
Augustus is a self-hosted, Go-based tool for security professionals who assess large language models.
- Free plan
- Windows · macOS · Linux · Self-hosted
- 9
7.6 Club scoreBasilisk
Basilisk is an open-source framework for authorized security testing, vulnerability research, and academic study of AI and large language models.
- Free plan
- Windows · macOS · Linux
- 10
7.4 Club scoreAgentScan
AgentScan is a cloud service for automated security testing of LLMs, retrieval-augmented generation pipelines, and autonomous agents through an API.
- Free plan
- Web · API
- 11 7.4 Club score
garak
garak is a free, open-source command-line scanner for probing language models and systems that use them for security weaknesses.
- Free plan
- Windows · macOS · Linux · Self-hosted
- 12 7.4 Club score
RAMPART
RAMPART is a free, MIT-licensed, open-source framework for safety testing agentic AI applications.
- Free plan
- Windows · macOS · Linux · API
- 13 7.1 Club score
PromptRAID
PromptRAID is a free, open-source command-line framework for testing prompt injection and jailbreak behavior in LLM-based agents.
- Free plan
- Windows · Linux
- 14 7.1 Club score
RedForge
RedForge is an open-source platform for red teaming and vulnerability scanning of large language models.
- Free plan
- Linux · API · Self-hosted
- 15 7.1 Club score
Red Team LLM Lab
- Free plan
- Windows · Self-hosted
- 16
7.0 Club scoreAIRTaaS
AIRTaaS is a web-based, self-serve platform for continuous security testing and validation of agentic AI applications.
- Free plan
- Web
- 17 7.0 Club score
HarmBench
- Free plan
- Linux · API · Self-hosted
- 18 6.9 Club score
Crucible
Crucible is a self-hosted security tool for stress-testing AI agents against attacks such as prompt injection, goal hijacking, and tool misuse before production.
- Free plan
- Linux · Self-hosted
- 19 6.9 Club score
SuperRed
- Free plan
- Linux
- 20 6.9 Club score
AgentDojo
- Free plan
- Linux · API · Self-hosted