mutator
pdonatbouillud.com
- Free plan
- Linux
What mutator is
mutator is a free mutation testing tool for the R language. It changes source code through abstract syntax tree mutations and checks whether a package's tests detect those changes. The reported mutation score is the proportion of killed mutants among all mutants. Operators cover arithmetic, comparisons, logic, constants, return values, and statement deletion. mutator supports testthat and tinytest, with a generic installed-tests fallback for other layouts. Coverage-guided selection runs tests covering each mutated line for the two named frameworks; the fallback warns and runs the full suite. Tests can run in parallel, and per-mutant timeouts are calibrated to detect hangs, with user overrides available. Developers can cap mutant counts, view surviving-mutant reports, and use a mutation quality gate. A reusable GitHub Actions workflow supports continuous integration. Equivalent-mutant detection can use an OpenAI-compatible API. The GPL (>= 3) package is installable from CRAN, GitHub, or R-universe.
Who it suits
It suits R developers assessing and improving package test suites. Teams using testthat, tinytest, or installed-test layouts can configure the matching strategy.
Good to know, and what to watch
- Free R mutation testing tool
- Supports testthat and tinytest
- Parallel test execution
- Surviving-mutant reports
- Reusable GitHub Actions workflow
- Generic fallback runs the full suite
- Coverage guidance is limited to named strategies
- Equivalent detection requires an API
The verdict
mutator gives R developers mutation scores, configurable execution, and CI support for evaluating test effectiveness. Its test-framework behavior differs between named frameworks and the generic fallback, so strategy choice matters.
What the maker publishes
- AST mutations
- mutator applies mutations at the abstract syntax tree level. source
- CI integration
- It provides a reusable GitHub Actions workflow for running mutation testing in continuous integration. source
- CI integration
- It provides a reusable GitHub Actions workflow for mutation testing, including optional mutation-score thresholds and badge publishing. source
- Developers
- The project is developed by Pierre Donat-Bouillud and Assanali Amandykov. source
- Equivalent mutants
- It can use LLMs to flag likely equivalent mutants through a configurable OpenAI-compatible API. source
- Execution speed
- It supports parallel test execution and coverage-guided selection that runs only tests covering each mutated line. source
- Installation
- The released version can be installed from CRAN with install.packages("mutator"), and development versions are available from GitHub and R-universe. source
- Intended users
- The tool is for developers seeking to assess and improve R package test suites. source
- Intended users
- The maker describes it for developers who want to assess the quality of R package test suites. source
- License
- The package is licensed under GPL (>= 3). source
- Limits and configuration
- Users can cap the number of mutants and set a per-mutant timeout; coverage-guided selection falls back to the full suite for the generic installed-tests strategy. source
- LLM integration
- Equivalent-mutant detection can use an OpenAI-compatible API. source
- Mutation method
- It uses abstract syntax tree analysis and mutation operators for arithmetic, comparisons, logic, constants, return values, and statement deletion. source
- Mutation operators
- Its operators include arithmetic, comparison and logical changes, constant and return-value replacements, and statement deletions. source
- Mutation score
- It reports the ratio of killed mutants to total mutants as a measure of test suite effectiveness. source
- Mutation score
- It reports the ratio of killed mutants to total mutants as a measure of test suite effectiveness. source
- Notable limit
- Coverage-guided selection is on by default for testthat and tinytest strategies; with the generic installed-tests fallback, it warns and runs the full suite. source
- Performance
- It supports parallel test execution and coverage-guided test selection, which runs tests covering each mutated line. source
- Purpose
- mutator is an automated mutation testing tool for the R language that checks whether a test suite detects systematic changes to source code. source
- Support
- The documentation links to a GitHub page for reporting bugs. source
- Test harnesses
- It supports testthat and tinytest, with a generic installed-tests fallback for other layouts. source
- Timeouts
- It self-calibrates per-mutant timeouts to detect hangs, and users can override the timeout. source
Checked against the maker's pages on 7 Oct 2026.