Skip to content

MDPtoolbox

Markov Decision Processes Toolbox

v4.0.3 · Mar 3, 2017 · BSD_3_clause + file LICENSE

Description

The Markov Decision Processes (MDP) toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: finite horizon, value iteration, policy iteration, linear programming algorithms with some variants and also proposes some functions related to Reinforcement Learning.

Downloads

671

Last 30 days

5260th

671

Last 90 days

671

Last year

CRAN Check Status

14 NOTE
Show all 14 flavors
Flavor Status
r-devel-linux-x86_64-debian-clang NOTE
r-devel-linux-x86_64-debian-gcc NOTE
r-devel-linux-x86_64-fedora-clang NOTE
r-devel-linux-x86_64-fedora-gcc NOTE
r-devel-macos-arm64 NOTE
r-devel-windows-x86_64 NOTE
r-oldrel-macos-arm64 NOTE
r-oldrel-macos-x86_64 NOTE
r-oldrel-windows-x86_64 NOTE
r-patched-linux-x86_64 NOTE
r-release-linux-x86_64 NOTE
r-release-macos-arm64 NOTE
r-release-macos-x86_64 NOTE
r-release-windows-x86_64 NOTE
Check details (16 non-OK)
NOTE r-devel-linux-x86_64-debian-clang

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
               person(given = "Guillaume",
                      family = "Chapron",
                      role = c("aut", "cre"),
                      email = "gchapron@carnivoreconservation.org"),
               person(given = "Marie-Josee",
                      family = "Cros",
                      role = "aut"),
               person(given = "Frederick",
                      family = "Garcia",
                      role = "aut"),
               person(given = "Regis",
                      family = "Sabbadin",
                      role = "aut"))
as necessary.
NOTE r-devel-linux-x86_64-debian-clang

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-debian-gcc

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
               person(given = "Guillaume",
                      family = "Chapron",
                      role = c("aut", "cre"),
                      email = "gchapron@carnivoreconservation.org"),
               person(given = "Marie-Josee",
                      family = "Cros",
                      role = "aut"),
               person(given = "Frederick",
                      family = "Garcia",
                      role = "aut"),
               person(given = "Regis",
                      family = "Sabbadin",
                      role = "aut"))
as necessary.
NOTE r-devel-linux-x86_64-debian-gcc

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-fedora-clang

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-fedora-gcc

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-patched-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^

Check History

NOTE 0 OK · 14 NOTE · 0 WARNING · 0 ERROR · 0 FAILURE Mar 9, 2026
NOTE r-devel-linux-x86_64-debian-clang

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
               person(given = "Guillaume",
                      family = "Chapron",
                      role = c("aut", "cre"),
                      email = "gchapron@carnivoreconservation.org"),
               person(given = "Marie-Josee",
      
NOTE r-devel-linux-x86_64-debian-gcc

CRAN incoming feasibility

Maintainer: ‘Guillaume Chapron <gchapron@carnivoreconservation.org>’

No Authors@R field in DESCRIPTION.
Please add one, modifying
  Authors@R: c(person(given = "Iadine",
                      family = "Chades",
                      role = "aut"),
               person(given = "Guillaume",
                      family = "Chapron",
                      role = c("aut", "cre"),
                      email = "gchapron@carnivoreconservation.org"),
               person(given = "Marie-Josee",
      
NOTE r-devel-linux-x86_64-fedora-clang

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-linux-x86_64-fedora-gcc

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-devel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-patched-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-linux-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-release-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-arm64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-macos-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^
NOTE r-oldrel-windows-x86_64

Rd files

checkRd: (-1) mdp_example_forest.Rd:36: Lost braces; missing escapes or markup?
    36 | Let {1, ... S} be the states of the forest. the Sth state being the oldest.
       |     ^

Dependency Network

Dependencies Reverse dependencies Matrix linprog MDPtoolbox

Version History

new 4.0.3 Mar 10, 2026