Flaky Test Detective

Flaky Test Detective is ranked #29 of 30 in test flakiness management software on The Geeks Club.

Compared on test flakiness management software

HyperExecute 0 of 4 in the starter kit Lesson 18.0 Bitbucket Pipelines 0 of 4 in the starter kit Lesson 27.9 Buildkite 0 of 4 in the starter kit Lesson 37.9 Cypress 0 of 4 in the starter kit Lesson 47.9 Qualflare 0 of 4 in the starter kit Lesson 57.9 TeamCity 0 of 4 in the starter kit Lesson 67.9

Purpose: Flaky Test Detective analyzes test results across multiple runs to identify flaky tests, explain why they fail intermittently, and quarantine the worst offenders.
Test formats: It supports Playwright JSON and JUnit XML parsers, with automatic format detection.
Detection: It detects timing variance, network errors, and order-dependent failures.
Quarantine: Quarantine mode tags tests above a threshold and outputs a pattern that can be used with Playwright’s --grep-invert option.
Reports: Reporters include colorized console, JSON, HTML with SVG charts, and GitHub pull request comment markdown.
History: It tracks trends over time using SQLite by default, with JSON available as a file-based fallback.
Minimum runs: The default configuration requires at least 3 runs before analysis.
CI integration: The README gives a GitHub Actions example that analyzes Playwright JSON results and uses the GitHub reporter.
Usage: The README documents both an npm-installed command-line interface and programmatic use through an Analyzer import.
License: The repository lists an MIT license.
Maker: The repository says it was built by Quvantic.

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.