Dynamic decision-making in uncertain environments I. The principle of dynamic utility

Understanding the dynamics or sequences of animal behavior usually involves the application of either dynamic programming or stochastic control methodologies. A difficulty of dynamic programming lies in interpreting numerical output, whereas even relatively simple models of stochastic control are notoriously difficult to solve. Here we develop the theory of dynamic decision-making under probabilistic conditions and risks, assuming individual growth rates of body size are expressed as a simple stochastic process. From our analyses we then derive the optimization of dynamic utility, in which the utility of weight gain, given the current body size, is a logarithmic function: hence the fitness function of an individual varies depending on its current body size. The dynamic utility function also shows that animals are universally sensitive to risk and display risk-averse behaviors. Our result proves the traditional use of expected utility theory and game theory in behavioral studies is valid only as a static model.