Skip to main content
U.S. flag

An official website of the United States government

Markov decision processes in natural resources management: observability and uncertainty

February 14, 2009

The breadth and complexity of stochastic decision processes in natural resources presents a challenge to analysts who need to understand and use these approaches. The objective of this paper is to describe a class of decision processes that are germane to natural resources conservation and management, namely Markov decision processes, and to discuss applications and computing algorithms under different conditions of observability and uncertainty. A number of important similarities are developed in the framing and evaluation of different decision processes, which can be useful in their applications in natural resources management. The challenges attendant to partial observability are highlighted, and possible approaches for dealing with it are discussed.

Citation Information

Publication Year 2015
Title Markov decision processes in natural resources management: observability and uncertainty
DOI 10.1016/j.ecolmodel.2008.12.023
Authors Byron K. Williams
Publication Type Article
Publication Subtype Journal Article
Series Title Ecological Modelling
Series Number
Index ID 70156062
Record Source USGS Publications Warehouse
USGS Organization Coop Res Unit Leetown