AI Verify
aiverifyfoundation.sg
- Free plan
- Linux
- Web
- API
- Self-hosted
What AI Verify is
AI Verify is a free, open-source toolkit for assessing AI systems, with technical tests for fairness, explainability, and robustness in traditional machine-learning models. Users can run tests through a Portal or command line, provide tabular or image data, and create standard or customized reports. The toolkit supports plugins, and Veritas integration adds fairness and transparency tests for threshold trade-offs along with explainability plots. Its broader framework assesses responsible implementation against 11 AI-governance principles and maps to frameworks including NIST AI RMF and ISO/IEC 42001. Project Moonshot is a separate tool for testing LLM applications through benchmarks and red teaming; AI Verify's Toolkit instead focuses on traditional AI applications. It is available under the Apache 2.0 license and can be used through web, API, Linux, or self-hosted options. AI Verify does not set ethical standards or guarantee that tested systems are safe or free of risks and biases.
Who it suits
It can suit AI owners, developers, researchers, service providers, and companies integrating the toolkit into their systems. Its tests and reporting features also address data-science and compliance users.
Good to know, and what to watch
- Free and open-source under Apache 2.0
- Tests fairness, explainability, and robustness
- Accepts tabular and image data
- Offers Portal and command-line testing
- Plugins and customized reports are supported
- Toolkit focuses on traditional AI applications
- Does not guarantee systems are free of risks or biases
The verdict
AI Verify offers testing and reporting tools for teams assessing traditional AI systems, with a framework that also covers generative AI governance. It does not define ethical standards or guarantee that an assessed system is safe.
What the maker publishes
- Data support
- AIVT 2.0 currently supports tabular and image data types and can use a model file, preprocessing pipeline or model API as input. source
- Extensibility
- The toolkit supports plugins built by the AI Verify Foundation or third parties. source
- Extensibility
- Users can add testing algorithms and process checklists to existing Toolkit functions. source
- Foundation status
- AI Verify Foundation is a not-for-profit, wholly owned subsidiary of Singapore’s Infocomm Media Development Authority. source
- Foundation status
- AI Verify Foundation is a not-for-profit wholly owned subsidiary of Singapore's Infocommunications Media Development Authority. source
- Founded
- 2022 source
- Framework coverage
- The framework assesses responsible implementation against 11 internationally recognised AI-governance principles and covers traditional and generative AI. source
- Framework principles
- The framework contains 11 AI-ethics principles, including transparency, explainability, safety, security, robustness, fairness, data governance and accountability. source
- Generative AI tool
- Project Moonshot assesses LLM applications through benchmark testing and red teaming and implements benchmarks recommended in IMDA's Starter Kit. source
- Headquarters
- Singapore source
- Integration
- Veritas was integrated into AI Verify to help financial institutions meet common safety-baseline and financial-testing requirements from MAS. source
- International alignment
- The framework is aligned with internationally recognised principles and frameworks from the EU, OECD and Singapore. source
- License
- The toolkit is open-sourced under the Apache 2.0 permissive license. source
- Limitation
- AI Verify does not define AI ethical standards and does not guarantee that tested systems are free from risks or biases or completely safe. source
- Moonshot interfaces
- Project Moonshot offers a Web UI, interactive CLI, library APIs and Web APIs for MLOps integration. source
- Open source
- The Toolkit is open-sourced under the permissive Apache 2.0 license. source
- Portal and CLI
- Users can run tests through the Portal or command line, upload results, complete process checklists and generate reports. source
- Purpose
- AI Verify is an open-source, extensible toolkit that validates AI-system performance. source
- Purpose
- AI Verify is an AI governance testing framework and software toolkit that validates AI-system performance against internationally recognised principles through standardised tests. source
- Reporting
- AI Verify includes standard report templates that predefine report layouts, technical tests and process checks, while also allowing customized reports. source
- Reports
- The Toolkit creates customised reports and can combine independent developer and compliance-team work into a full report. source
- Scope limit
- Project Moonshot tests LLM-based applications, while the AI Verify Testing Toolkit tests traditional AI applications for fairness, explainability and robustness. source
- Security
- The Foundation says electronic storage and transmission of personal data are secured with appropriate security technologies. source
- Standards alignment
- The framework is mapped to NIST AI RMF, NIST AI RMF Generative AI Profile, Hiroshima Process Code of Conduct and ISO/IEC 42001. source
Checked against the maker's pages on 2 Oct 2026.