muttest
jakubsob.github.io
- Free plan
- Windows
- macOS
- Linux
What muttest is
muttest is an R package for mutation testing: it makes selected changes to code, runs tests, and measures how often the test suite catches those changes. Its mutation score reports the share of mutations caught, and file-level feedback points to places that may need stronger assertions. Users can choose which code changes to apply and where. Available mutators cover operators, boolean and NA or NULL values, function calls, strings, numbers, indexes, conditions, negation, and return values; preset collections group common types of changes. The maker’s examples use testthat and include comparison-operator changes intended to expose untested boundary cases. Reports are available in HTML and JSON. Documentation links to a CI guide covering GitHub Actions, score badges, and thresholds, and a July 2026 update describes parallel execution. The package page lists Linux, macOS, Windows, and WebAssembly build checks. The CRAN listing says muttest requires R 4.1.0 or later. It is free, licensed under MIT plus a LICENSE file, and supports R.
Who it suits
muttest suits R developers looking for weak assertions in a test suite, including suites generated with LLMs. It may be useful to teams that want mutation scores or CI checks as part of their testing workflow.
Good to know, and what to watch
- Reports the percentage of mutations caught
- Offers HTML and JSON reports
- Lets users select mutation types and locations
- Links to CI guidance for GitHub Actions and thresholds
- Describes parallel execution
- Requires R version 4.1.0 or later
- Lists testthat among its dependencies
The verdict
muttest gives R projects configurable mutations, score reporting, and CI-oriented guidance for identifying weak test assertions. Teams should account for its stated R version requirement and testthat dependency.
What the maker publishes
- CI
- The documentation index links a guide to running muttest in CI, including GitHub Actions and score badges. source
- Configurable mutations
- Users choose what code changes to make and where to make them. source
- File feedback
- The tool reports which files need stronger assertions. source
- HTML report
- The package documentation lists a CI vignette describing how to run mutation tests on every push, add a score badge, and enforce thresholds. source
- Install
- The package page provides an R install.packages command using the maker’s r-universe repository and CRAN. source
- Intended users
- The project describes mutation testing as a way to find weak assertions in test suites, including suites generated with LLMs. source
- License
- The package is licensed under MIT plus a LICENSE file. source
- Maintainer
- The CRAN package listing names Jakub Sobolewski as author and maintainer. source
- Maker
- The maker identifies himself as Jakub Sobolewski, a software engineer specializing in R and Shiny. source
- Mutation examples
- The maker’s examples include changing comparison operators to expose untested boundary cases. source
- Mutation score
- The package reports a percentage score for how often tests catch mutations. source
- Mutation score
- The mutation score is the percentage of mutants killed or errored among killed, survived, and errored mutants; mutants with no test coverage are excluded. source
- Mutators
- Available mutators include operator, boolean, NA or NULL, function-call, string, numeric, index, condition, negation, and return-value changes. source
- Package type
- muttest is an R package for mutation testing. source
- Parallel execution
- The maker’s July 2026 update describes parallel execution as a muttest capability. source
- Preset mutators
- Preset collections cover arithmetic, comparison, logical, boolean, NA, numeric, index, string, and condition mutations. source
- Purpose
- muttest mutates R code and runs tests to measure how often the tests catch those changes. source
- Purpose
- muttest measures test quality by applying small changes to code and checking whether the test suite catches them. source
- Release
- The CRAN listing shows version 0.3.0, published July 21, 2026. source
- Reporting
- The package includes HTML and JSON reporting. source
- Requirements
- The documentation index lists testthat among muttest’s dependencies. source
- R test workflow
- The maker describes muttest as mutation testing for R and shows tests under the testthat framework. source
- Runtime requirement
- The CRAN package listing states that muttest depends on R version 4.1.0 or later. source
- Supported build platforms
- The package page lists successful checks for Linux, macOS, Windows, and WebAssembly targets. source
Checked against the maker's pages on 4 Oct 2026.