scoringutils

2.2.0

Utilities for Scoring and Assessing Predictions

4packages depend

19.6Kdownloads / year

98.0%test coverage

11/13checks pass

Overview

About

Maintained by Nikos BosseFirst published 2020-06-1413 releasesCRAN page ↗GitHub ↗

Facilitate the evaluation of forecasts in a convenient framework based on data.table. It allows user to to check their forecasts and diagnose issues, to visualise forecasts and missing data, to transform data before scoring, to handle missing forecasts, to aggregate scores, and to visualise the results of the evaluation. The package mostly focuses on the evaluation of probabilistic forecasts and allows evaluating several different forecast types and input formats. Find more information about the package in the Vignettes as well as in the accompanying paper, doi:10.48550/arXiv.2205.07090.

Install

R (CRAN)pak (dev)Ubuntu (r2u)Fedora (COPR)openSUSE (OBS)

install.packages("scoringutils", repos = "https://cloud.r-project.org/")

Installs the current CRAN release. Prebuilt binaries on Windows and macOS.

if (!requireNamespace("pak", quietly = TRUE))
  install.packages("pak", repos = "https://cloud.r-project.org/")
pak::pak("epiforecasts/scoringutils")

Development version from epiforecasts/scoringutils. Installs pak first if it is not already available.

Release

# enable cranapt (r2u) if it is not already set up, then install
grep -rqs r2u.stat.illinois.edu /etc/apt/sources.list /etc/apt/sources.list.d/ \
  || curl -fsSL https://raw.githubusercontent.com/eddelbuettel/r2u/master/inst/scripts/add_cranapt_noble.sh | sudo bash
sudo apt install -y r-cran-scoringutils

Fast Ubuntu binaries via r2u (no compilation). The cranapt setup runs once and is skipped when it is already enabled.

bspm (used by r2u) also needs make: sudo apt install make

# enable the iucar/cran COPR if it is not already present, then install
ls /etc/yum.repos.d/*iucar*cran*.repo >/dev/null 2>&1 \
  || sudo dnf copr enable -y iucar/cran
sudo dnf install -y R-CRAN-scoringutils

RPMs from the iucar/cran COPR, rebuilt from CRAN.

For install.packages() integration in R, also: sudo dnf install R-CoprManager

# add the autoCRAN OBS repo (Tumbleweed) if it is missing, then install
zypper -q lr | grep -qi autoCRAN \
  || sudo zypper addrepo https://download.opensuse.org/repositories/devel:/languages:/R:/autoCRAN/openSUSE_Tumbleweed/devel:languages:R:autoCRAN.repo
sudo zypper install -y R-scoringutils

RPMs auto-built from CRAN on openSUSE OBS (Tumbleweed).

Health

CRAN checks

2NOTE11OK

Failing flavors

NOTE r-devel-linux-x86_64-debian-clang
NOTE r-devel-linux-x86_64-debian-gcc

Slowest check: 8.2 min · r-devel-linux-x86_64-fedora-clang

Code health

Yes

Tests · ratio 1.10

98.0%

Coverage · measured lines

100%

Documentation · exports

Dependencies · direct

Check history

NOTE2026-07-11
12 OK · 1 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
OK2026-03-19
14 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE
ERROR2026-03-12
13 OK · 0 NOTE · 0 WARNING · 1 ERROR · 0 FAILURE
OK2026-03-10
14 OK · 0 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE

Documentation

READMEYes · 1,097 wordsVignettesYes · dynamicpkgdown siteNoNEWSYes · 67% structuredCode of conductNoContributing guideNo

Examples that run: 98%
Documented parameters: 99%
Return-value docs: 94%
References docs: 14%

Downloads

19.6K

CRAN downloads in the past year

Rank #3,427 · ~54/day · ~1.6K/mo

Releases R versions

Daily download trend is not available in this view yet.

98730 days

3.4K90 days

19.6K1 year

Compare downloads with other packages →

Also on181 r2u29 autocran69 c2d4u

Repository

GitHub ↗ epiforecasts/scoringutils

63Stars

25Forks

102Open issues

14Open PRs

11Releases

2,893Commits

18Contributors

forecast-evaluationforecastingr-package

2,893 commits · Last activity 2026-07-19

Issues over time

2026-07-14 · 892026-07-19 · 102

Repository practices

Upstream repositoryBeta

7 development-tooling and community-health practices detected across 6 families in the upstream repository

Checks run against github.com/epiforecasts/scoringutils on 2026-07-19.

Continuous integration (1)

GitHub Actions

Reproducibility and dev environment (1)

Dev Container

Docs source (1)

README.Rmd

Automation and maintenance (1)

Dependabot

Show all practices

Lint, format, editor (2)

lintrRStudio project

Governance and community (1)

PR template

How this is detected·Detection ruleset v1 (2026-07-18)

Dependencies

Declared dependencies

13 external dependencies (excludes base and recommended)

Depends (1)

R >= 4.1

Imports (8)

checkmate cli data.table ggplot2methodspurrr scoringRulesstats

LinkingTo (0)

none

Suggests (7)

ggdist kableExtra knitr Metrics rmarkdown testthat (>= 3.1.9)vdiffr

Enhances (0)

none

Dependency license breakdown →

Reverse dependencies

4direct

1indirect

hubEvals EpiNow2 NobBS modelimportance

Code & Tests

Code Composition

R 13,778 (60%)Rd 6,857 (30%)Vignettes 1,290 (6%)Markdown 1,064 (5%)Other 122 (1%)

Code characteristics

Object systems

S352

Cyclomatic complexity: 1.0 median / 9 max
Test cases: 271 / 1.10 per code line

Test coverage

Line coverage

98%

Expression

98.2%

Tests / Examples

98.0% / 66% ex

Functions

173 68 exported

Complexity

2.1 avg / 9 max

Call network

173 nodes / 255 edges

Call graph

Open call graph →

Loading call graph…

Lowest coverage

173 functions

Function	Cyclo	Coverage
get_pit_histogram.default	1	0%
score.forecast_ordinal	1	0%
assert_input_ordinal	2	38%
permutation_test	3	78%
get_pit_histogram.forecast_quantile	5	83%
assert_forecast.forecast_ordinal	3	85%

People & History

People (8)

Maintainer (1)

Nikos Bosse

Author, Maintainer

Authors (4)

Nikos Bosse

Author, Maintainer

Sam Abbott

Author · added in 2.0.0

Sebastian Funk

Author

Hugo Gruson

Author · added in 1.0.0

Contributors (4)

Toshiaki Asakura

Contributor · added in 2.0.0

James Mba Azam

Contributor · added in 2.0.0

Johannes Bracher

Contributor · added in 2.0.0

Michael Chirico

Contributor · added in 2.0.0

Listed in earlier versions (4)

Sophie Meakins

no longer listed · 0.1.0 to 0.1.7.2

Joel Hellewell

no longer listed · 0.1.0 to 0.1.7.2

James Munday

no longer listed · 0.1.0 to 0.1.7.2

Katharine Sherratt

no longer listed · 0.1.0 to 0.1.7.2

Package Timeline

13 releases. Pick two to compare their code metrics. R releases are shown for context.

R
R 4.6.0 released · 2026-04-24
2.2.0Latest
2026-04-06 · current release · diff ↗
2.1.2
2025-08-25 · diff ↗
2.1.1
2025-06-26 · diff ↗
R
R 4.5.0 released · 2025-04-11
2.1.0
2025-03-03 · diff ↗
2.0.0
2024-10-31 · diff ↗
R
R 4.4.0 released · 2024-04-24
1.2.2
2023-11-29 · diff ↗
R
R 4.3.0 released · 2023-04-21
1.1.0
2023-01-30 · diff ↗
1.0.1
2022-08-17 · diff ↗
1.0.0
2022-05-13 · diff ↗
R
R 4.2.0 released · 2022-04-22
0.1.7.2
2021-07-21 · diff ↗
0.1.7
2021-07-14 · diff ↗

Show 4 earlier events

R
R 4.1.0 released · 2021-05-18
0.1.4
2020-11-17 · diff ↗
0.1.0
2020-06-14
R
R 4.0.0 released · 2020-04-24

Package metadata

First published: 2020-06-14
Total releases: 13 / 6 yrs
License: MIT + file LICENSE OSI
Minimum R: ≥ 4.1
Bundled data: 683 KB / 8 files
Download size: 3.6 MB
Installed size: not tracked yet
With dependencies: not tracked yet

Appears in task views

Time Series Analysis

Report a problem with this page →