Project Moonshot

7.1easy start · #7 of 29
in AI Security Testing Tools

Free to practise onyes
Free trialnot on record
Well documentedyes
Runs where you workyes

Runs on api, Linux, Mac, self-hosted, Web, Windows.

Project Moonshot is ranked #7 of 29 in AI security testing tools on The Geeks Club. It runs on API, Linux, macOS, Self-hosted, Web, Windows. There is a free plan.

Project Moonshot plans and pricing

All plans

Project Moonshot Free Open-source toolkit; requires Python 3.11; web UI requires Node.js 20.11.1 LTS or above github.com · 30 Sept 2026

Compared on AI security testing tools

Free plan: Yes
Prompt injection tests: Yes
Jailbreak tests: Yes
Data leakage tests: Yes
Unsafe output tests: Yes
Custom test cases: Yes
Deployment mode: self_hosted

Best Project Moonshot alternatives

See all 20

F5 BIG-IP APM 0 of 4 in the starter kit Lesson 17.3 OpenSecureAI Scanner 0 of 4 in the starter kit Lesson 27.3 AIRTA Red Team 0 of 4 in the starter kit Lesson 37.2 PyRIT 0 of 4 in the starter kit Lesson 47.2 Augustus 0 of 4 in the starter kit Lesson 57.1 Basilisk 0 of 4 in the starter kit Lesson 67.1

The record

Purpose: Project Moonshot is an open-source toolkit for assessing the safety and reliability of large language models and applications through benchmark testing and red teaming.
Benchmarking: It runs benchmark tests on LLMs and applications using open-source datasets and metrics for performance and trust and safety risks.
Red teaming: It generates adversarial prompts using algorithmic strategies or generative LLMs to probe potential vulnerabilities and misuse.
Custom tests: Users can build benchmark tests using custom datasets, optional prompt templates, evaluation metrics, and grading scales.
Reporting: It provides interactive HTML reports and downloadable raw JSON test results.
Interfaces: Moonshot can be used through a Web UI, an interactive command-line interface, library APIs, and Web APIs.
Integrations: Users can configure connections to their LLMs and create custom connector endpoints through the Web UI or CLI guides.
IMDA alignment: The toolkit implements benchmarks recommended in IMDA’s Starter Kit for safety testing LLM-based applications.
Requirements: The repository specifies Python 3.11 and, for the Web UI, Node.js 20.11.1 LTS or later; test assets are also required to run tests.
License and maturity: The repository identifies Moonshot as beta software released under the Apache Software License 2.0.
Intended users: The project describes its users as AI developers and compliance teams evaluating LLM-based applications and LLMs.
Maker: AI Verify Foundation is a not-for-profit wholly owned subsidiary of Singapore’s Infocommunications Media Development Authority.
Provider connections: The documentation names OpenAI, Anthropic, Together, and Hugging Face as model providers Moonshot can connect to with an API key.
Custom connectors: Users can create model connectors for other models or their own LLM applications hosted on custom servers.
Price from: Free

Where it ranks on The Geeks Club

Best AI Security Testing Tools in 2026#7 of 29

Is Project Moonshot yours?

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.

Claim it free Promote Project Moonshot

Sources

aiverifyfoundation.sg/tools/moonshot/· checked 29 Sept 2026
github.com/aiverify-foundation/moonshot· checked 29 Sept 2026
aiverify-foundation.github.io/moonshot/user_guide/web_ui/web_ui_guide· checked 29 Sept 2026
aiverifyfoundation.sg/about-aivf/about-the-foundation/· checked 29 Sept 2026
aiverify-foundation.github.io/moonshot/getting_started/overview/· checked 30 Sept 2026
aiverify-foundation.github.io/moonshot/getting_started/quick_install/· checked 30 Sept 2026
aiverify-foundation.github.io/moonshot/faq/· checked 30 Sept 2026
aiverifyfoundation.sg/project-moonshot/· checked 28 Sept 2026