Research on human and animal behavior has long emphasized its hierarchical structure--the divisibility of ongoing behavior into discrete tasks, which are comprised of subtask sequences, which in turn are built of simple actions. The hierarchical structure of behavior has also been of enduring interest within neuroscience, where it has been widely…

A dynamic model of how animals learn to regulate their behavior under time-based reinforcement schedules is presented. It assumes serial activation of behavioral states during the inter-reinforcement interval, an associative process linking the states and operant response, and a rule mapping the states onto response rate. (SLD)

Explains the use of pigeons in behavioral psychology research for modeling human behavior and discusses instructional objectives for humans. Topics addressed include the relationship between response rate and reinforcer rate; resistance to alternative reinforcement; choice and matching; and persistence and reinforcement. (Contains 11 references.)…

We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalled transitions between the…

A model for the analysis of simple human conceptual behavior, based on the apparent similarities of human conceptual behavior and that of infrahuman subjects, is developed. A minimum definition of conceptual behavior is given: A single response, verbal or nonverbal, under the discriminative control of a group of stimuli whose parameters are…

The return to drug seeking, even after prolonged periods of abstinence, is a defining feature of cocaine addiction. The neural circuitry underlying relapse has been identified in neuropharmacological studies of experimental animals, typically rats, and supported in brain imaging studies of human addicts. Although the nucleus accumbens (NAcc),…

Quantitative analyses of stimulus control and reinforcer control in conditional discriminations and delayed matching-to-sample procedures often encounter a problem; it is not clear how to analyze data when subjects have not made errors. The present article examines two common methods for overcoming this problem. Monte Carlo simulations of…