<?xml version="1.0" encoding='utf-8'?>
<!DOCTYPE wml PUBLIC "-//WAPFORUM//DTD WML 1.1//EN" "http://www.wapforum.org/DTD/wml_1.1.xml">
<wml>
<card id="card1" title="Markov decision process - Page 4 - Wikipedia">
<p>
<a accesskey="1" href="page.php?w=Markov_decision_process&amp;p=3">1.Previous</a><br />
<a accesskey="3" href="page.php?w=Markov_decision_process&amp;p=5">3.Next</a>
</p>
<p>decision process" refers to the underlying structure of <a href="page.php?w=Transition_system">state transitions</a> that still follow the <a href="page.php?w=Markov_property">Markov property</a>. The process is called a "decision process" because it involves making decisions that influence these state transitions, extending the concept of a Markov chain into the realm of decision-making under uncertainty.</p>

<p><big>Definition</big></p>
<p>A Markov decision process is a 4-<a href="page.php?w=tuple">tuple</a> , where:</p>

<p>
*  is a <a href="page.php?w=set_%28mathematics%29">set</a></p><p>
<a accesskey="1" href="page.php?w=Markov_decision_process&amp;p=3">1.Previous</a><br />
<a accesskey="3" href="page.php?w=Markov_decision_process&amp;p=5">3.Next</a>
</p>

<do type="prev" label="Search">
        <go href="search.wml"/>
</do>

</card>
</wml>
