## Documentation

A QuickStart for Matlab and a documentation are provided with the toolbox. Each function is described in a Matlab style.

The functions description may be adressed:

##### Notation used in the documentation

- states: set {1, 2, ..., S}
- actions: set {1, 2, ..., A}
- transitions: P(s,s',a) is the probability to reach state s' when the system is in state s and action a is performed by the decision maker
- rewards: R(s,s',a) is the reward obtained when the system is in state s on decision epoch t and is in state s' at decision epoch t+1, with action a performed

R(s,a): reward when the system is in state s at decision epoch t and action a is performed by the decision maker

## An Ecological Modeling Example

Some toy examples (rand and forest examples) are provided with the toolbox.

A more realistic example in ecology is also provided on the Project Forge Files page in the section MDPtoolbox.

The codage in all the considered environments: MATLAB/GNU Octave, Scilab and R can be downloaded (files ReserveDesign*.zip).

For a description of this example, see:

- Costello, C. & Polasky, S. (2004) Dynamic reserve site selection. Resource and Energy Economics, 26, 157-174.
- Sabbadin, R., Spring, D. & Rabier, C.E. (2007) Dynamic reserve site selection under contagion risk of deforestation. Ecological Modelling, 201, 75-81.