Melioration theory

Melioration Theory is a theory in psychology used as an alternative to the Matching Law. Melioration theory is used as an explanation for why a being makes choices based on the rewards or reinforcers it receives. The principle of melioration states that animals will invest increasing amounts of time and/or effort into whichever alternative is better. To meliorate essentially means to "make better."

Melioration theory accounts for many of the choices that organisms make when presented with two Variable Interval Schedules. Melioration is a form of matching where the subject is constantly shifting its behavior from the poorer reinforcement schedule to the richer reinforcement schedule, until it is spending most of its time at the richest Variable Interval Schedule. By matching, the subject is equalizing the price of the reinforcer they are working for. This is also called hyperbolic discounting. In making a choice between options, living organisms need not maximize expected payoff as classical economic theory posits. Rather than being aggregated, the options compete against one another based on differences in their local reinforcement rate. The organism continuously shifts from one alternative to the other, if one is better than the other, until the other is better than the first one, regardless of the effect on overall rate of reinforcement. Melioration is capable of accounting for behavior on both concurrent ratio and concurrent interval schedules.

Melioration Equation R1/B1 = R2/B2

If this ratio is not equal, the animal will shift its behavior to the alternative that currently has the higher response ratio. When the ratio is equal, the "cost" of each reinforcer is the same for both alternatives.

Melioration theory grew out of an impersonal anonymous interest in how the matching law comes to hold on. Richard J. Herrnstein (1961) reported that on concurrent VIVIVI reinforcement schedules, the proportion of responses to one alternative was approximately equal to the proportion of reinforcer received there. This finding is summarized in the matching law, which generated a great deal of both matching research and matching theorizing. Herrnstein (1970) suggested that matching may be a basic behavioral process, whereas Rachlin et al. (1976) suggested that matching comes about because it maximizes rate of matching reinforcement.

William Vaughan, Jr. (1976) suggested that the local rate of matching reinforcement on each reinforcement matching schedule is evaluated, and if those local rates differ, the distribution of time on a schedule is shifted from the poorer to the better schedule. On concurrent VIVIVI reinforcement schedules this process gives rise to matching, whereas on concurrent VRVRVR reinforcement schedules it gives rise to exclusive preferences for the better alternative and not the worse alternative. This rule was subsequently named Melioration (Herrnstein & Vaughan, 1980). See also Herrnstein, 1982, Vaughan, 1981; Vaughan & Herrnstein, 1987)

References

• Herrnstein, R.J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267–72.
• Herrnstein, R.J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243–66.
• Herrnstein, R.J. (1982). Melioration as behavioural dynamism. In Commons, M.L.; Herrnstein, R.J. & Rachlin, H. (Eds.), Quantitative analyses of behavior, vol. II: Matching and maximizing accounts, pp. 433–58. Ballinger Publishing Co., Cambridge, MA.
• Herrnstein, R.J. & Prelec, D. (1991). Melioration: A theory of distributed choice. The Journal of Economic Perspectives, 5(3), 137–56.
• Herrnstein, R.J. & Vaughan, W., Jr. (1980). Melioration and behavioral allocation. In J.E.R. Staddon (Ed.), Limits to action. New York: Academic Press.
• Rachlin, H.; Green, L.; Kagel, J.H. & Battalio, R.C. (1976). Economic demand theory and psychological studies of choice. In G.H. Bower (Ed.), The Psychology of Learning and Motivation, 10, pp. 129–54. New York: Academic Press.
• Vaughan, W., Jr. (1976). Optimization and reinforcement. Unpublished doctoral thesis, Harvard University.
• Vaughan, W., Jr. (1981). Melioration, matching, and maximization. Journal of the Experimental Analysis of Behavior, 36(2): 141–49.
• Vaughan, W., Jr. & Herrnstein, R.J. (1987). Stability, melioration, and natural selection. In L. Green & J.H. Kagel (Eds.), Advances in Behavioral Economics, Vol. 1 (pp. 185–215). Norwood, NJ: Ablex.
• Mazur, James E. Learning and Behavior. (6 ed.) Upper Saddle River NJ: 2006, p. 332-335