Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo

muttest

jakubsob.github.io

  • Free plan
  • Windows
  • macOS
  • Linux

What muttest is

muttest is an R package for mutation testing: it makes selected changes to code, runs tests, and measures how often the test suite catches those changes. Its mutation score reports the share of mutations caught, and file-level feedback points to places that may need stronger assertions. Users can choose which code changes to apply and where. Available mutators cover operators, boolean and NA or NULL values, function calls, strings, numbers, indexes, conditions, negation, and return values; preset collections group common types of changes. The maker’s examples use testthat and include comparison-operator changes intended to expose untested boundary cases. Reports are available in HTML and JSON. Documentation links to a CI guide covering GitHub Actions, score badges, and thresholds, and a July 2026 update describes parallel execution. The package page lists Linux, macOS, Windows, and WebAssembly build checks. The CRAN listing says muttest requires R 4.1.0 or later. It is free, licensed under MIT plus a LICENSE file, and supports R.

Who it suits

muttest suits R developers looking for weak assertions in a test suite, including suites generated with LLMs. It may be useful to teams that want mutation scores or CI checks as part of their testing workflow.

Good to know, and what to watch

  • Reports the percentage of mutations caught
  • Offers HTML and JSON reports
  • Lets users select mutation types and locations
  • Links to CI guidance for GitHub Actions and thresholds
  • Describes parallel execution
  • Requires R version 4.1.0 or later
  • Lists testthat among its dependencies

The verdict

muttest gives R projects configurable mutations, score reporting, and CI-oriented guidance for identifying weak test assertions. Teams should account for its stated R version requirement and testthat dependency.

What the maker publishes

CI
The documentation index links a guide to running muttest in CI, including GitHub Actions and score badges. source
Configurable mutations
Users choose what code changes to make and where to make them. source
File feedback
The tool reports which files need stronger assertions. source
HTML report
The package documentation lists a CI vignette describing how to run mutation tests on every push, add a score badge, and enforce thresholds. source
Install
The package page provides an R install.packages command using the maker’s r-universe repository and CRAN. source
Intended users
The project describes mutation testing as a way to find weak assertions in test suites, including suites generated with LLMs. source
License
The package is licensed under MIT plus a LICENSE file. source
Maintainer
The CRAN package listing names Jakub Sobolewski as author and maintainer. source
Maker
The maker identifies himself as Jakub Sobolewski, a software engineer specializing in R and Shiny. source
Mutation examples
The maker’s examples include changing comparison operators to expose untested boundary cases. source
Mutation score
The package reports a percentage score for how often tests catch mutations. source
Mutation score
The mutation score is the percentage of mutants killed or errored among killed, survived, and errored mutants; mutants with no test coverage are excluded. source
Mutators
Available mutators include operator, boolean, NA or NULL, function-call, string, numeric, index, condition, negation, and return-value changes. source
Package type
muttest is an R package for mutation testing. source
Parallel execution
The maker’s July 2026 update describes parallel execution as a muttest capability. source
Preset mutators
Preset collections cover arithmetic, comparison, logical, boolean, NA, numeric, index, string, and condition mutations. source
Purpose
muttest mutates R code and runs tests to measure how often the tests catch those changes. source
Purpose
muttest measures test quality by applying small changes to code and checking whether the test suite catches them. source
Release
The CRAN listing shows version 0.3.0, published July 21, 2026. source
Reporting
The package includes HTML and JSON reporting. source
Requirements
The documentation index lists testthat among muttest’s dependencies. source
R test workflow
The maker describes muttest as mutation testing for R and shows tests under the testthat framework. source
Runtime requirement
The CRAN package listing states that muttest depends on R version 4.1.0 or later. source
Supported build platforms
The package page lists successful checks for Linux, macOS, Windows, and WebAssembly targets. source

Checked against the maker's pages on 4 Oct 2026.