mlr3resampling
Resampling Algorithms for 'mlr3' Framework
Description
A supervised learning algorithm inputs a train set, and outputs a prediction function, which can be used on a test set. If each data point belongs to a subset (such as geographic region, year, etc), then how do we know if subsets are similar enough so that we can get accurate predictions on one subset, after training on Other subsets? And how do we know if training on All subsets would improve prediction accuracy, relative to training on the Same subset? SOAK, Same/Other/All K-fold cross-validation, <doi:10.48550/arXiv.2410.08643> can be used to answer these questions, by fixing a test subset, training models on Same/Other/All subsets, and then comparing test error rates (Same versus Other and Same versus All). Also provides code for estimating how many train samples are required to get accurate predictions on a test set.
Downloads
370
Last 30 days
8810th
370
Last 90 days
370
Last year
CRAN Check Status
Show all 14 flavors
| Flavor | Status |
|---|---|
| r-devel-linux-x86_64-debian-clang | OK |
| r-devel-linux-x86_64-debian-gcc | OK |
| r-devel-linux-x86_64-fedora-clang | OK |
| r-devel-linux-x86_64-fedora-gcc | OK |
| r-devel-macos-arm64 | ERROR |
| r-devel-windows-x86_64 | OK |
| r-oldrel-macos-arm64 | ERROR |
| r-oldrel-macos-x86_64 | ERROR |
| r-oldrel-windows-x86_64 | OK |
| r-patched-linux-x86_64 | OK |
| r-release-linux-x86_64 | OK |
| r-release-macos-arm64 | ERROR |
| r-release-macos-x86_64 | ERROR |
| r-release-windows-x86_64 | OK |
Check details (14 non-OK)
*
*
*
*
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
*
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
*
*
*
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
*
Check History
ERROR 9 OK · 0 NOTE · 0 WARNING · 5 ERROR · 0 FAILURE Mar 9, 2026
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.
package dependencies
Package required but not available: ‘pbdMPI’ See section ‘The DESCRIPTION file’ in the ‘Writing R Extensions’ manual.