Search

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena. [ABSTRACT FROM AUTHOR]

Exposure therapy is an effective intervention for anxiety-related problems. The mechanism of this intervention has been the extinction procedure in Pavlovian conditioning, and this application has provided many successful instances for the prevention of relapse. However, traditional associative theories cannot comprehensively explain many findings. In particular, it is difficult to explain the recovery-from-extinction effects, which is the reappearance of the conditioned response following extinction. In this paper, we propose an associative model that is a mathematical extension of Bouton's (1993, Psychological Bulletin, 114, 80–99) model for the extinction procedure. The core of our model is that the asymptotic strength of the inhibitory association depends on the degree of excitatory association retrieved in a context in which a conditioned stimulus (CS) is presented and that the retrieval is determined by the similarity between contexts during both reinforcement and non-reinforcement and the retrieval context. Our model provides an explanation of the recovery-from-extinction effects, and implications for exposure therapy. [ABSTRACT FROM AUTHOR]

Prior research suggests that interval timing performance is sensitive to reinforcer devaluation effects and to the rate of competing sources of reinforcement. The present study sought to replicate and account for these findings in rats. A self-paced concurrent fixed-interval (FI) random-ratio (RR) schedule of reinforcement was implemented in which the FI requirement varied across training conditions (12, 24, 48 s). The RR requirement—which imposed an opportunity cost to responding on the FI component—was adjusted so that it took about twice the FI requirement, on average, to complete it. Probe reinforcer devaluation (prefeeding) sessions were conducted at the end of each condition. To assess the effect of contextual reinforcement on timing performance, the RR requirement was removed before the end of the experiment. Consistent with prior findings, performance on the FI component tracked schedule requirement and displayed scalar invariance; the removal of the RR component yielded more premature FI responses. For some rats, prefeeding reduced the number of trials initiated without affecting timing performance; for other rats, prefeeding delayed responding on the FI component but had a weaker effect on trial initiation. These results support the notion that timing and motivational processes are separable, suggesting novel explanations for ostensible motivational effects on timing performance. [ABSTRACT FROM AUTHOR]

For humans, a distinction has been made between implicit and explicit learning. Implicit learning is thought to involve automatic processes of the kind involved in much Pavlovian conditioning, while explicit learning is thought to involve conscious hypothesis testing and rule formation, in which the subject's statement of the rule has been taken as evidence of explicit learning. Various methods have been used to determine if nonverbal animals are able to learn a task explicitly – among these is the 1-back reinforcement task in which feedback from performance on the current conditional discrimination trial is provided only after completion of the following trial. We propose that it is not whether an organism can learn the task, but whether they learn it rapidly, all-or-none, that provides a better distinction between the two kinds of learning. We had humans learn a symbolic matching, 1-back reinforcement task. Almost half of the subjects failed to learn the task, and of those who did, none described the 1-back rule. Thus, it is possible to learn this task without learning the 1-back rule. Furthermore, the backward learning functions for humans differ from those of pigeons. Human subjects who learned the task did so all-or-none, suggesting explicit learning. In earlier research with pigeons, they too showed significant learning of this task; however, backward learning functions suggested that they did so gradually over the course of several sessions of training and to a lower level of asymptotic accuracy than the humans, a result suggesting implicit learning was involved. [ABSTRACT FROM AUTHOR]

Same/different concept learning has been demonstrated in previous research in rats using matching- and non-matching-to-sample procedures with olfactory stimuli. In Experiment 1, rats were trained on the non-matching-to-sample procedure with either three-dimensional (3D plastic objects; n = 3) or olfactory (household spices, n = 5) stimuli, then tested for transfer to novel stimuli of the same, and then the alternate, modality. While all three rats trained with olfactory stimuli showed generalized non-matching to novel odors, only one rat learned the 3D relation and showed generalized transfer to novel objects. Importantly, in this rat the 3D non-matching relation then immediately transferred to odors. In contrast, rats trained with scents did not show transfer to novel 3D stimuli until after training with one or two 3D stimulus sets. In Experiment 2, four rats were trained on an incrementing non-matching-to-sample task featuring 3D plastic objects as stimuli (3D Span Task). Responses to session-novel stimuli resulted in reinforcement. Only two rats learned the 3D Span Task; one rat performed with high accuracy even with up to 17 session-novel objects in a session. While these findings emphasize the exceptional olfactory discrimination of rats relative to that with 3D/tactile/visual cues, they also show that relational learning can be demonstrated in another modality in this species. Further, the present study provides some evidence of cross-modal transfer of relational responding in rats. [ABSTRACT FROM AUTHOR]

Under certain conditions, pigeons will reliably prefer an alternative that leads to a lower probability of food over an alternative that leads to a higher probability of food (i.e., demonstrate suboptimal choice). A critical aspect of the typical procedure is that the alternative associated with less food provides differential stimuli that signal trial outcomes, but the alternative associated with more food does not. Few studies have investigated how partial signaling of an alternative influences preference. In Experiments 1–3, pigeons chose between two alternatives that each led to food 60% of the time with partially signaled trial outcomes. One alternative occasionally provided a stimulus that always preceded food (i.e., "good news") and the other alternative occasionally provided a stimulus that always preceded no food ("bad news"). Experiments 2 and 3 also assessed preference in conditions in which alternatives were either completely unsignaled (provided no differential stimuli) or always led to food. Pigeons consistently preferred the "good news" alternative over the "bad news" alternative and preferred 100% food over the "bad news" alternative. The results from conditions in which pigeons chose between the "bad news" alternative and an unsignaled alternative were inconclusive, but suggestive of a preference for bad news. The results are used to evaluate and distinguish between competing explanations of suboptimal choice. [ABSTRACT FROM AUTHOR]

Serial reversal-learning procedures are simple preparations that allow for a better understanding of how animals learn about environmental changes, including flexibly shifting responding to adapt to changing reinforcement contingencies. The present study examined serial reversal learning with humans by arranging both midsession and variable contingency reversals across two experiments. We also examined the effects of extinction by adding nonreinforced trials at the end of later sessions and provided the first evaluation of effects of win-stay/lose-shift versus counting strategies on accuracy and response latency of humans' reversal-learning performance. In each experiment, responding tracked contingency reversals, primarily with participants using either win-stay/lose-shift or counting strategies. Introducing variable reversal points in the second experiment resulted in near-exclusive win-stay/lose-shift responding among participants and eliminated counting of trials. Each experiment also revealed an immediate shift from S2 to S1 after experiencing extinction during the initial test trial, indicating resurgence of the initial response through a win-stay/lose-shift response pattern. Therefore, the present study replicates and extends prior findings of a win-stay/lose shift response pattern in situations of greater uncertainty. These findings suggest that differences in environmental certainty induce qualitatively different decision-making strategies. [ABSTRACT FROM AUTHOR]

Four experiments with rat subjects asked whether a partial reinforcement extinction effect (PREE) occurs in taste aversion learning. The question has received little attention in the literature, and to our knowledge no taste aversion experiment has previously demonstrated a PREE. In each of the present experiments, experimental groups received a taste mixed in drinking water for 20 min; such taste exposures were sometimes paired with a lithium chloride (LiCl) injection and sometimes not. Control groups received only taste-LiCl pairings. There was evidence that each reinforced and non-reinforced trial produced increments and decrements in aversion strength (respectively), and trials mattered more than accumulated time during the conditioned stimulus and during the background (as emphasized in time-accumulation models like those of Gallistel and Gibbon, Psychological Review, 107, 289-344, 2000, and Gibbon and Balsam, Autoshaping and conditioning theory, Academic Press, New York, pp. 219-235, 1981). In addition, a partial reinforcement extinction effect was observed when there was a relatively large number of conditioning trials. The results extend our understanding of extinction in taste aversion learning and provide more evidence that aversion learning might follow rules that are qualitatively similar to those of other forms of learning. [ABSTRACT FROM AUTHOR]

This article reviews recent findings from the author's laboratory that may provide new insights into how habits are made and broken. Habits are extensively practiced behaviors that are automatically evoked by antecedent cues and performed without their goal (or reinforcer) "in mind." Goal-directed actions, in contrast, are instrumental behaviors that are performed because their goal is remembered and valued. New results suggest that actions may transition to habit after extended practice when conditions encourage reduced attention to the behavior. Consistent with theories of attention and learning, a behavior may command less attention (and become habitual) as its reinforcer becomes well-predicted by cues in the environment; habit learning is prevented if presentation of the reinforcer is uncertain. Other results suggest that habits are not permanent, and that goal-direction can be restored by several environmental manipulations, including exposure to unexpected reinforcers or context change. Habits are more context-dependent than goal-directed actions are. Habit learning causes retroactive interference in a way that is reminiscent of extinction: It inhibits, but does not erase, goal-direction in a context-dependent way. The findings have implications for the understanding of habitual and goal-directed control of behavior as well as disordered behaviors like addictions. [ABSTRACT FROM AUTHOR]

In resurgence, a target behavior (R1) is acquired in an initial phase and extinguished in a second phase while an R2 behavior is reinforced. When R2 is extinguished, R1 behavior can return or resurge. Two experiments tested the effectiveness of a potential retrieval cue associated with extinction in attenuating resurgence. Experiment 1 established that a 2-s cue paired with outcome delivery in Phase 2 can attenuate resurgence when presented during testing. This effect depended on the cue being associated with the outcome, and it occurred if the cue was delivered contingently or noncontingently on responding during testing. Pairing the cue with reinforcement might be necessary to maintain attention to it during Phase 2. Experiment 2 demonstrated that the cue must be experienced in sessions that also include R1 extinction and that it does not reduce resurgence through a conditioned reinforcement mechanism. The results suggest that previously neutral stimuli can attenuate resurgence if they are first paired with alternative reinforcement and presented in sessions in which R1 is extinguished. They build on existing literature that suggests enhancing generalization between extinction and testing reduces resurgence. The results may have implications for reducing relapse following interventions in humans such as contingency management (CM), in which participants can earn vouchers contingent upon drug abstinence. A cue associated with CM might help reduce this relapse. [ABSTRACT FROM AUTHOR]

Memories for when an event has occurred are used to anticipate future occurrences of the event, but what happens when the event is equally likely to occur at two different times? In this study, one group of rats was always reinforced at 21 s on the peak-interval procedure (21-only group), whereas another group of rats was reinforced at either 8 or 21 s, which varied daily (8-21 group). At the beginning of each session, the behavior of the 8-21 group largely lacked temporal control, but by the end of the session, temporal control was reestablished. When both groups were reinforced at 21 s, the patterns of responding were indistinguishable after subjects in the 8-21 group had experienced 13 reinforcement trials. Finally, the reinforcement times of previous sessions affected the 8-21 group, such that subjects were biased depending on the reinforcement time of the prior session. These results show that when the reinforcement time is initially ambiguous, rats respond in a way that combines their expectations of both possibilities; then they incrementally adjust their responding as they receive more information, but still information from prior sessions biases their initial expectation for the reinforcement time. Combined, these results imply that rats are sensitive to the age of encoded temporal memories in an environment in which the reinforcement time is variable. How these results inform the scalar expectancy theory, the currently accepted model of interval-timing behavior, is discussed. [ABSTRACT FROM AUTHOR]

There is considerable interest in the conditions under which human subjects learn patterned information without explicit instructions to learn that information. This form of learning, termed implicit or incidental learning, can be approximated in nonhumans by exposing subjects to patterned information but delivering reinforcement randomly, thereby not requiring the subjects to learn the information in order to be reinforced. Following acquisition, nonhuman subjects are queried as to what they have learned about the patterned information. In the present experiment, we extended the study of implicit learning in nonhumans by comparing two species, cotton-top tamarins ( Saguinus oedipus) and pigeons ( Columba livia), on an implicit learning task that used an artificial grammar to generate the patterned elements for training. We equated the conditions of training and testing as much as possible between the two species. The results indicated that both species demonstrated approximately the same magnitude of implicit learning, judged both by a random test and by choice tests between pairs of training elements. This finding suggests that the ability to extract patterned information from situations in which such learning is not demanded is of longstanding origin. [ABSTRACT FROM AUTHOR]

A novel learning process that does not require stimulus associations was explored in humans. The hypothesis was that two contextual stimuli taught in separate settings, with different stimuli, become equivalent if they accomplish identical functions with regard to the relations between the stimuli presented with them. The procedure consisted of : (a) first teaching an AB conditional discrimination (e.g., match A1 to B1 and A2 to B2) and then teaching a second-order XAB conditional discrimination in which X1 indicated performing the same selections as in AB and X2 indicated selecting the alternative comparison (e.g., match A1 to B2 and A2 to B1); (b) repeating the procedure with completely new stimuli, YHJ, in which the functions of the Y stimuli were identical to those of X; and (c) conducting a final probe under extinction to verify the equivalence between the X and the Y stimuli. Three experiments were conducted to explore the process and to rule out the influence of alternative variables. Out of these, 13 of the 14 participants matched the stimuli to the same contextual functions. Thus, the hypothesis was verified. These results demonstrate that humans are able to match stimuli according to their functions in relation to other stimuli. This process may be very much involved in language; for example, understanding that words or clauses that have been learned in separate contexts and with separate stimuli share the same meaning. Understanding this process may help to identify learning or developmental problems, such as those shown by persons with autism, and help to treat them. [ABSTRACT FROM AUTHOR]

In Conditions 1 and 3 of our Experiment 1, rats pressed levers for food in a two-component multiple schedule. The first component was concurrent variable-ratio (VR) 20 variable-interval (VI) 90 s, and the second was concurrent yoked VI (its reinforcement rate equaled that of the prior component's VR) VI 90 s. In Condition 2, the VR was changed to tandem VR 20, differential reinforcement of low rates (DRL) 0.8 s. Local response rates were higher in the VR than in the yoked VI schedule, and this difference disappeared between tandem VR DRL and yoked VI. The relative time allocations to VR and yoked VI, as well as to tandem VR DRL and yoked VI, were approximately the same across conditions. In Experiment 2, rats chose in a single session between five different VI pairs, each lasting for 12 reinforcer presentations (variable-environment procedure). The across-schedule hourly reinforcement rates were 120 and 40, respectively, in Conditions 1-3 and 4-6. During Conditions 2 and 5, one lever's VI was changed to tandem VI, DRL 2 s. High covariation between relative time allocations and relative reinforcer frequencies, as well as invariance in local response rates to the schedules, was evident in all conditions. In addition, the relative local response rates were biased toward the unchanged VI in Conditions 2 and 5. These results demonstrate two-process control of choice: Inter-response-time reinforcement controls the local response rate, and relative reinforcer frequency controls relative time allocations. [ABSTRACT FROM AUTHOR]

During feature-positive operant discriminations, a conditional cue, X, signals whether responses made during a second stimulus, A, are reinforced. Few studies have examined how landmarks, which can be trained to control the spatial distribution of responses during search tasks, might operate under conditional control. We trained college students to search for a target hidden on a computer monitor. Participants learned that responses to a hidden target location signaled by a landmark (e.g., A) would be reinforced only if the landmark was preceded by a colored background display (e.g., X). In Experiment 1, participants received feature-positive training (+←YB/ XA→+/A−/B−) with the hidden target to the right of A and to left of B. Responding during nonreinforced transfer test trials (XB−/YA−) indicated conditional control by the colored background, and spatial accuracy indicated a greater weighting of spatial information provided by the landmark than by the conditional cue. In Experiments 2a and 2b, the location of the target relative to landmark A was conditional on the colored background (+←YA/ XA→+/ ZB→+/ +←C /A−/B−). At test, conditional control and a greater weighting for the landmark's spatial information were again found, but we also report evidence for spatial interference by the conditional stimulus. Overall, we found that hierarchical accounts best explain the observed differences in response magnitude, whereas spatial accuracy was best explained via spatial learning models that emphasize the reliability, stability, and proximity of landmarks to a target. [ABSTRACT FROM AUTHOR]

Stimuli associated with primary reinforcement for instrumental behavior are widely believed to acquire the capacity to function as conditioned reinforcers via Pavlovian conditioning. Some Pavlovian conditioning studies suggest that animals learn the important temporal relations between stimuli and integrate such temporal information over separate experiences to form a temporal map. The present experiment examined whether Pavlovian conditioning can establish a positive instrumental conditioned reinforcer through such temporal integration. Two groups of rats received either delay or trace appetitive conditioning in which a neutral stimulus predicted response-independent food deliveries (CS1→US). Both groups then experienced one session of backward second-order conditioning of the training CS1 and a novel CS2 (CS1-CS2 pairing). Finally, the ability of CS2 to function as a conditioned reinforcer for a new instrumental response (leverpressing) was assessed. Consistent with the previous demonstrations of temporal integration in fear conditioning, a CS2 previously trained in a trace-conditioning protocol served as a better instrumental conditioned reinforcer after backward second-order conditioning than did a CS2 previously trained in a delay protocol. These results suggest that an instrumental conditioned reinforcer can be established via temporal integration and raise challenges for existing quantitative accounts of instrumental conditioned reinforcement. [ABSTRACT FROM AUTHOR]

It is difficult for rats to acquire daily time-place (TP) learning tasks. One theory suggests that rats do not use time of day as a stimulus signaling a specific response. In the present study, we tested rats' ability to use time of day as a discriminative stimulus. A fixed-interval procedure was used in which one lever provided reinforcement on a FI-5-s schedule in morning sessions, and the same lever provided reinforcement on a FI-30-s schedule in afternoon sessions. Because only one place was used in this paradigm, the rats could only use time of day to acquire the task. Mean responses during the first 5 s of the first trial in each session indicated that the rats did not discriminate between the two sessions. In Phase II, a different lever location was used for each of the two daily sessions, which meant that both spatial and temporal information could be used to acquire the task. The rats readily acquired the task in this phase, and probe trials indicated that the rats were using a combination of spatial and temporal information to discriminate between the two different trial types. When the spatial cue was removed in Phase III, rats no longer discriminated the two sessions, suggesting that time can only be used as a discriminative stimulus when each daily session is associated with a distinct spatial location. [ABSTRACT FROM AUTHOR]

Recent research has suggested that operant responses can be weakened when they are tested in new contexts. The present experiment was therefore designed to test whether animals can learn a context-(R-O) relation. Rats were given training sessions in context A, in which one response (R1; lever pressing or chain pulling) produced one outcome (O1) and another response (R2; chain pulling or lever pressing) produced another outcome (O2) on variable interval reinforcement schedules. These sessions were intermixed with training in context B, where R1 now produced O2 and R2 produced O1. Given the arrangement, it was possible for the animal to learn two distinct R-O associations in each specific context. To test for them, rats were then given aversion conditioning with O2 by pairing its presentation with lithium-chloride-induced illness. Following the aversion conditioning, the rats were given an extinction test with both R1 and R2 available in each context. During testing, rats showed a selective suppression in each context of the response that had been paired with the reinforcer subsequently associated with illness. Rats could not have performed this way without knowledge of the R-O associations in effect in each specific context, lending support to the hypothesis that rats learn context-(R-O) associations. However, despite a complete aversion to O2, responding was not completely suppressed, leaving the possibility open that rats form context-R associations in addition to context-(R-O) associations. [ABSTRACT FROM AUTHOR]

In resurgence, an extinguished instrumental behavior (R1) recovers when a behavior that has replaced it (R2) is also extinguished. The phenomenon may be relevant to understanding relapse that can occur after the termination of 'contingency management' treatments, in which an unwanted behavior (e.g., substance abuse) is reduced by reinforcing an alternative behavior. When reinforcement is discontinued, the unwanted behavior might resurge. However, unlike most resurgence experiments, contingency management treatments also introduce a negative contingency, in which reinforcers are not delivered unless the client has abstained from the unwanted behavior. In two experiments with rats, we therefore examined the effects of adding a negative 'abstinence' contingency to the resurgence design. During response elimination, R2 was not reinforced unless R1 had not been emitted for a minimum period of time (45, 90, or 135 s). In both experiments, adding such a contingency to simple R1 extinction reduced, but did not eliminate, resurgence. In Experiment 2, we found the same effect in a yoked group that could earn reinforcers for R2 at the same points in time as the negative-contingency group, but without the requirement to abstain from R1. Thus, the negative contingency per se did not contribute to the reduction in resurgence. These results suggest that the contingency reduced resurgence by making reinforcers more difficult to earn and more widely spaced in time. This could have allowed the animal to learn that R1 was extinguished in the 'context' of infrequent reinforcement-a context more like that of resurgence testing. The results are thus consistent with a contextual (renewal) account of resurgence. The method might provide a better model of relapse after termination of a contingency management treatment. [ABSTRACT FROM AUTHOR]

The effects of reinforcement on delayed matching to sample (DMTS) have been studied in two within-subjects procedures. In one, reinforcer magnitudes or probabilities vary from trial to trial and are signaled within trials ( designated signaled DMTS trials). In the other, reinforcer probabilities are consistent for a series of trials produced by responding on variable-interval (VI) schedules within multiple-schedule components ( designated multiple VI DMTS). In both procedures, forgetting functions in rich trials or components are higher than and roughly parallel to those in lean trials or components. However, during disruption, accuracy has been found to decrease more in rich than in lean signaled DMTS trials and, conversely, to decrease more in lean than in rich multiple VI DMTS components. In the present study, we compared these procedures in two groups of pigeons. In baseline, forgetting functions in rich trials or components were higher than and roughly parallel to those in lean trials or components, and were similar between the procedures. During disruption by prefeeding or extinction, accuracy decreased more in rich signaled DMTS trials, whereas accuracy decreased more in lean multiple VI DMTS components. These results replicate earlier studies and are predicted by a model of DMTS from Nevin, Davison, Odum, and Shahan . [ABSTRACT FROM AUTHOR]

Three experiments examined the effect of response-outcome contingencies on human ratings of causal efficacy and demonstrated that such ratings transfer to novel situations through derived stimulus relations. Efficacy ratings generally followed the delta probability rule when positive response-outcome contingencies were employed (Experiment 1) and when some outcomes were not contingent on participants' responses (Experiment 2). Experiment 3 employed a negative response-outcome contingency and manipulated performance expectancies in the task. All three groups overestimated their causal efficacy ratings. A learned helplessness effect was observed when the response-outcomes were uncontrollable and in the high-expectancy group when participants' performance in the task was worse than they had expected. In all experiments, ratings transferred to a stimulus presented during the task and often generalized to novel stimuli through derived relations. These results corroborate the view that outcome probability is a determinant of causal efficacy ratings and that schedules can be employed as UCS in procedures that share characteristics of evaluative conditioning procedures. [ABSTRACT FROM AUTHOR]

The context's role in Pavlovian conditioning depends on the trial spacing during training, with massed trials revealing a function akin to that of discrete stimuli, and spaced trials revealing a modulatory function (Urcelay & Miller, Journal of Experimental Psychology. Animal Behavior Processes, 36, 268-280, ). Here we examined the contextual determinants of a common but largely ignored effect: attenuated conditioned responding with extended reinforced training (i.e., a postpeak performance deficit [PPD]). Contextual sources of PPDs were investigated in four fear-conditioning experiments with rats. In Experiment 1, as the number of reinforced trials increased, conditioned responding decreased, even when testing occurred outside the training context. Experiment 2 revealed opposing influences of context on the PPD based on trial spacing, which interacted with whether testing occurred in the training context. This finding reconciles Experiment 1's results with previous data (Bouton, Frohardt, Sunsay, Waddell, & Morris, Journal of Experimental Psychology. Animal Behavior Processes, 34, 223-236, ). Experiment 3 suggested that extended training with these parameters did not lead to habituation to conditioned or unconditioned stimuli. In Experiment 4, few or many massed training trials were followed orthogonally by context extinction or no context extinction. After many pairings, context extinction reduced the PPD (i.e., enhanced responding), suggesting a competitive role of the context. These results, together with prior data suggesting that context modulates expressions of the PPD, are consistent with the view that contexts can play two distinctly different roles. [ABSTRACT FROM AUTHOR]

Humans discount larger amounts of a delayed reinforcer less steeply than smaller amounts, but studies with pigeons and rats have yet to reveal such a magnitude effect, suggesting that the effect may be unique to humans. The present study examined whether the magnitude effect is observed in a species phylogenetically closer to humans, by comparing the rates at which rhesus monkeys discounted 10% and 20% concentrations of sucrose. There were no systematic differences in the rates at which the monkeys discounted the two sucrose concentrations, despite the fact that they strongly preferred the 20% concentration. Interestingly, the monkeys discounted delayed sucrose at a rate higher than was observed with delayed cocaine, and lower than was observed with delayed saccharin in previous studies (Freeman et al. Behavioural Processes, 82, 214-218, ; Woolverton et al. Experimental and Clinical Psychopharmacology, 15, 238-244, ). Taken together, these findings suggest that although both quantitative and qualitative differences can affect monkeys' preferences between immediate reinforcers, qualitative differences between types of reinforcers (e.g., sucrose vs. cocaine) can affect monkeys' discounting rates in a way that quantitative differences within a reinforcer (e.g., 10% vs. 20% sucrose) do not. [ABSTRACT FROM AUTHOR]

Preschool children (3-4 years old) were trained to perform two actions to gain different outcomes, in the form of video clips from different cartoons, before one of these outcomes was devalued by noncontingent exposure. The effect of outcome devaluation was subsequently assessed in an extinction test by giving children the opportunity to perform both actions in the absence of any outcomes. When the two actions were trained concurrently, performance during the test was modulated by outcome value and children showed a preference for the action trained with the currently valued outcome. By contrast, when each action was trained separately on different trials, test performance was insensitive to outcome devaluation. These effects of the training schedules are interpreted in terms of dual-process theories of action control. [ABSTRACT FROM AUTHOR]

We examined the extent to which nonhedonically different differential outcomes involving feeder location control pigeons' comparison choices in matching to sample. In Experiment 1, we showed that differential feeder location outcomes associated with each of two samples can facilitate delayed-matching accuracy. In Experiment 2, we found positive transfer following training on two matching tasks with differential feeder location outcomes when samples from one task were replaced by samples from the other task. In Experiment 3, we found that when differential-outcome expectations could no longer serve as the cues for comparison choice, sample stimuli continued to exert some control over choice of comparisons. The results indicate that differential outcomes (involving feeder location) that presumably do not differ in hedonic value are sufficient to control comparison choice. Thus, the differential hedonic value of the outcome elicited by the sample does not appear to be a requirement of the differential-outcome effect. Furthermore, these differential outcomes appear to augment matching accuracy, but they do not eliminate control by the samples. [ABSTRACT FROM AUTHOR]

Binge eating is often associated with stress- induced disruption of typical eating patterns. Three experiments were performed with the aim of developing a potential model for this effect by investigating the effect of presenting response-independent stimuli on rats' lever-pressing for food reinforcement during both fixed-interval (FI) and fixed-ratio (FR) schedules of reinforcement. In Experiment 1, a response-independent brief tone (500-ms, I05-dB, broadband, noisy signal, ranging up to 16 kHz, with spectral peaks at 3 and 500 Hz) disrupted the performance on an FI 60-s schedule. Responding with the response-independent tone was more vigorous than in the absence of the tone. This effect was replicated in Experiment 2 using a within-subject design, but no such effect was noted when a light was employed as a disrupter. In Experiment 3, a 500-ms tone, but not a light, had a similar effect on rats' performance on FR schedules. This tone-induced effect may represent a release from response-inhibition produced by an aversive event. The implications of these results for modeling binge eating are discussed. [ABSTRACT FROM AUTHOR]

In a Pavlovian conditioning situation, an initially neutral stimulus may be made excitatory by nonreinforced presentations in compound with an established conditioned excitor [i.e., second-order conditioning (SOC)]. The established excitor may be either a punctate cue or the training context. In four conditioned suppression experiments using rats, we investigated whether SOC phenomena parallel other cue interaction effects. In Experiment I, we found that the response potential of a target stimulus was directly related to the intertrial interval when SOC was mediated by a punctate cue, and inversely related to the intertrial interval when SOC was mediated by the training context. Experiment 2 demonstrated that punctate- and context- mediated SOC are oppositely affected by posttraining context extinction, and Experiments 3 and 4 demonstrated that context- and punctate-mediated SOC are differentially affected by conditioned stimulus (Experiment 3) and unconditioned stimulus (Experiment 4) preexposure treatments. These findings parallel phenomena in conditioned inhibition and cue competition situations. [ABSTRACT FROM AUTHOR]

In the first condition in Experiment 1, 6 rats were exposed to concurrent variable ratio (VR) 30, variable inter- val (VI) 30-sec schedules. In the next two conditions, the subjects were exposed to concurrent VI VI schedules and concurrent tandem VI-differential-reinforcement-of-high-rate VI schedules. For the latter conditions, the overall and relative reinforcer rates equaled those in the first condition. Only minor differences appeared in time allocation (a molar measure) across conditions. However, local response rate differences (a molecular measure) appeared between schedule types consistently with the interresponse times these schedules reinforced. In Ex- periment 2, these findings reappeared when the prior experiment was replicated with 5 subjects, except that the yR schedule was replaced by a VI plus linear feedback schedule. These results suggest that within the context tested, the molar factor of relative reinforcement rate controls preference, whereas the molecular factor of the relation between interresponse times and reinforcer probability controls the local response rate. [ABSTRACT FROM AUTHOR]

Two experiments evaluated history effects on induced and operant variability. College students typed three-digit sequences on a computer keyboard. Sequence variability was induced (by no reinforcement or variation-independent reinforcement) or reinforced (by variation- or repetition-dependent reinforcement). Conditions with induced and operant variability were presented according to a reverse between-groups de- sign. In Experiment 1, we examined transitions from the variation or repetition contingencies to no reinforce- ment, and vice versa. In Experiment 2, the variation or repetition contingencies were followed or preceded by variation-independent reinforcement. The results showed that (1) a history of no reinforcement impaired operant variability learning; (2) induced variability levels were higher and lower after a history of reinforce- ment for variation and repetition, respectively; (3) repetition was more easily disrupted by no reinforcement and independent reinforcement than was variation; and (4) response variability and stability were a function of past and current reinforcement conditions. These results indicate that reinforcement history influences both induced and operant variability levels. [ABSTRACT FROM AUTHOR]

The aim of the four present experiments was to explore how different schedules of reinforcement influence schedule-induced behavior, their impact on evaluative ratings given to conditioned stimuli associated with each schedule through evaluative conditioning, and the transfer of these evaluations through derived stimulus networks. Experiment 1 compared two contrasting response reinforcement rules (variable ratio [VR], variable interval [VI]). Experiment 2 varied the response to reinforcement rule between two schedules but equated the outcome to response rate (differential reinforcement of high rate [DRH] vs. VR). Experiment 3 compared molar and molecular aspects of contingencies of reinforcement (tandem VIVR vs. tandem VRVI). Finally, Experiment 4 employed schedules that induced low rates of responding to determine whether, under these cir- cumstances, responses were more sensitive to the molecular aspects of a schedule (differential reinforcement of low rate [DRL] vs. VI). The findings suggest that the transfer of evaluative functions is determined mainly by differences in response rate between the schedules and the molar aspects of the schedules. However, when neither schedule was based on a strong response reinforcement rule, the transfer of evaluative judgments came under the control of the molecular aspects of the schedule. [ABSTRACT FROM AUTHOR]

According to established theories of attention (e.g., Mackintosh, 1975; Sutherland & Mackintosh, 1971), simple discriminations of the form AX+ BX- result in an increase in attention to stimuli A and B, which are relevant to the outcome that follows them, at the expense of X, which is irrelevant. Experiments that have apparently shown such changes in attention have failed to determine whether attention is enhanced to both A and B, which signal reinforcement and nonreinforcement, respectively, or just to A. In Experiments I and 2, pigeons were trained with a number of discriminations of the kind AX+ BX-, before compounds that had been consistently nonreinforced were involved in a subsequent discrimination. Both experiments provided support for theories that propose that more attention is paid to stimuli that consistently signal nonreinforcement than to irrelevant stimuli in simple discriminations. [ABSTRACT FROM AUTHOR]

The present experiments, using the latent inhibition (LI) paradigm, evaluated the effect of nonreinfoeced exposure to saccharin on the acquisition of an LiC1-induced saccharin aversion as measured by conditioned disgust reactions in the taste reactivity test and conditioned taste avoidance in a consumption test. When rats were preexposed to saccharin by bottle exposure (Experiments 1 and 3), LI was evidenced only by conditioned taste avoidance (bottle testing), but not by conditioned disgust reactions (intraoral [10] testing). On the other hand, when rats were preexposed to saccharin by 10 infusion (Experiments 2 and 3), LI was evidenced only by conditioned disgust mactions, but not by conditioned taste avoidance. Experiment 4 showed that LI of conditioned disgust reactions does not appear to be affected by a context shift from preexposure to testing phases. These results show that the expression of LI of both conditioned taste avoidance and conditioned disgust reactions depends critically on a common method of flavor exposure during preexposure and testing. [ABSTRACT FROM AUTHOR]

Numerical competence has been studied in animals under a variety of conditions, but only a few experiments have reported animals' ability to detect absolute number. Capaldi and Miller (1988) tested rats' ability to detect absolute number by using biologically important events-the number of remforced runs followed by a nonreinforced run-and found that the rats ran significantly slower on the nonreinforced run. In the present experiments, we used a similar procedure. Pigeons were given a sequence of trials in which responding on the first three trials ended in reinforcement but responding on the fourth trial did not (RRRN). When the response requirement on each trial was a single peck (Experiment 1), we found no significant increase in latency to peck on the fourth trial. When the response requirement was increased to 10 pecks (Experiment 2), however, the time to complete the peck requirement was significantly longer on the nonreinforced trial than on the reinforced trials. Tests for control by time, number of responses, and amount of food consumed indicated that the pigeons were using primarily the number of reinforcements obtained in each sequence as a cue for nonreinforcement. This procedure represents a sensitive and efficient method for studying numerical competence in animals. [ABSTRACT FROM AUTHOR]

Previous experiments on behavioral momentum have shown that relative resistance to extinction of operant behavior in the presence of a stimulus depends on the rate of reinforcement associated with that stimulus, even if some of those reinforcers occur independently of the behavior. We present three experiments examining whether the rate of reinforcement in the presence of a stimulus similarly modulates the relative relapse of operant behavior produced by reinstatement, resurgence, and renewal paradigms. During baseline conditions, pigeons responded for food reinforcement on variable-interval 120-sec schedules in alternating periods of exposure to two stimuli arranged by a multiple schedule. Additional response-independent food presentations were also delivered in the presence of one of the multiple-schedule stimuli. Consistent with previous research, baseline response rates were lower in the presence of the stimulus with the added response-independent reinforcement, and relative resistance to extinction was greater in the presence of that stimulus. In addition, following extinction, the relative relapse of responding produced by reinstatement, resurgence, and renewal paradigms was greater in the presence of the stimulus associated with the higher rate of reinforcement. We suggest that a model of extinction from behavioral momentum theory may be useful for understanding these results. [ABSTRACT FROM AUTHOR]

In this study, we examined whether reward contrast influences choice between delayed and probabilistic outcomes. Specifically, we predicted that the subjective value of an intermediate reward would seem relatively larger or smaller, respectively, if it followed choices involving a smaller or larger reward and would produce corresponding changes in rates of delay and probability discounting. In Experiment 1, subjects made choices about hypothetical $5,000 or $50 outcomes and then made choices about $500 outcomes. Delay-discounting rates for the $500 outcome were larger for Group $5,000 than for Group $50, whereas the opposite result was obtained for probability-discounting rates. In Experiment 2, we used a design that allowed for contrast effects to be assessed within subjects. Two groups made choices about delayed or probabilistic rewards. After completing question blocks in which the amount was $5,000 or $50, subjects responded to questions with an intermediate amount ($475/$525). For Group Delay, the present value of the intermediate reward was greater after the $50 block than after the $5,000 block, whereas the opposite was obtained for Group Probability. The results from both experiments confirmed the predictions of reward contrast and suggested that the subjective value of a monetary reward varies inversely with the prior reward amount. [ABSTRACT FROM AUTHOR]

In the present experiments, we examined the role of within-compound associations in the interaction of the overshadowing procedure with conditioned stimulus (CS) duration, using a conditioned suppression procedure with rats. In Experiment 1, we found that, with elemental reinforced training, conditioned suppression to the target stimulus decreased as CS duration increased (i.e., the CS duration effect), whereas, with compound reinforced training (i.e., the overshadowing procedure), conditioned suppression to the target stimulus increased as CS duration increased. In subsequent experiments, we replicated these findings with sensory preconditioning and demonstrated that extinction of the overshadowing stimulus results in retrospective revaluation with short CSs and in mediated extinction with long CSs. These results highlight the role of the duration of the stimulus in behavioral control. Moreover, these results illuminate one cause (the CS duration) of whether retrospective revaluation or mediated extinction will be observed. [ABSTRACT FROM AUTHOR]

In four experiments, rats were trained on different patterning discriminations before being tested with compounds composed of novel combinations of the trained stimuli. In Experiment 1, rats were trained on a negative-patterning schedule (A+ B+ AB -) intermixed with reinforced presentations of a second compound (CD+). On a subsequent test, the rats responded more to two novel compounds, AC and BD, than to A and B, but less than to CD. In Experiment 2, rats were trained on two concurrent negative-patterning discriminations (A+ B+ AB-, C+ D+ CD-). On test, they responded more to AC and BD than to AB and CD, but less than to the single stimuli. In Experiment 3, rats were trained on two concurrent positive-patterning discriminations (A- B- AB+, C- D- CD+). On test, their response rates to AC and BD were not different from the response rates to the trained compounds (AB and CD). Finally, in Experiment 4, rats were trained on a positive- and negative- patterning discrimination concurrently. Once again, on test, response rates to AC and BD were not different from responding on reinforced trials of the trained discriminations (A+, B+, and CD+). We discuss the implications of these findings for elemental and configural models of stimulus representation. [ABSTRACT FROM AUTHOR]

The temporal generalization gradient produced by the peak-interval (PI) procedure reflects behavior under the control of positive reinforcement for responding after the criterial time, but shows negligible discouragement for early responses. The lack of consequences for premature responding may affect estimates of timing accuracy and precision in the PI procedure. In two experiments, we sought to encourage more accurate timing in pigeons by establishing an opportunity cost for such responding. Concurrent ratio and interval schedules of reinforcement reduced the dispersion of keypecking around the target time. A sequence of three response-rate states (low- high-low) characterized performance in individual trials. Opportunity cost substantially reduced the mean and standard deviation of the duration of the middle-high state that typically enveloped the target time, indicating improved temporal acuity. We suggest a model as a first-order approximation to timing with opportunity cost. [ABSTRACT FROM AUTHOR]

Four pigeons responded on a two-component multiple token-reinforcement schedule, in which tokens were produced according to a random-interval 30-sec schedule and exchanged according to a variable-ratio 4 schedule in both components. To assess the effects of contingent token loss, tokens were removed after every second response (i.e., fixed-ratio 2 loss) in one of the components. Response rates were selectively lower in the loss components relative to baseline (no-loss) conditions, as well as to the within-condition no-loss components. Response rates were decreased to a greater degree in the presence of tokens than in their absence. To control for the effects of changes in the density of token and food reinforcement, two parts consisted of additional conditions where food density and token loss were yoked to those in a previous loss condition. In the yoked-food condition, tokens were produced as usual in both components, but the overall density of food reinforcement in one of the components was yoked to that obtained during a previous token-loss condition. In the yoked token-loss condition, tokens were removed during one component of the multiple schedule at a rate that approximately matched the obtained rate of loss from a previous token-loss condition. Response rates in these yoked components were less affected than those in comparable loss components, despite similar densities of token, exchange, and food reinforcement. On the whole, the results support the conclusion that contingent token loss serves as an effective punisher with pigeons. [ABSTRACT FROM AUTHOR]

Within-trial contrast occurs when a discriminative stimulus that is preceded by a relatively aversive event is preferred over another that is preceded by a less aversive event. Recent failures to replicate (Arantes & Grace, 2008; Vasconcelos, Urcuioli, & Lionello-DeNoIf 2007) may allow us to identify factors that may be responsible. In the case of Vasconcelos et al., it is likely that insufficient training was provided (often 35-65 sessions are required). In the case of Arantes and Grace (Experiment 2), these pigeons had been involved in prior experiments involving lean schedules of reinforcement, and we find that prior experience with lean (relatively aversive) schedules appears to reduce the presumed aversiveness of the many-peck requirement, thus obviating the contrast effect. Finally, in the case of Vasconcelos and Urcuioli (2008), although the contrast effect with a simultaneous discrimination was not reliable, it was not reliably smaller than with a successive discrimination that did show a reliable effect, and the contrast effect was also similar in magnitude to a reliable effect reported by Kacelnik and Marsh (2002). Thus, although there have been several failures to replicate the original effects reported by Clement, Feltus, Kaiser, and Zentall (2000), insufficient training prior history with lean schedules of reinforcement, and low statistical power may have been responsible for those failures. [ABSTRACT FROM AUTHOR]

Rats chose between alternatives that differed in the number of reinforcers and in the delay to each reinforcer. A left leverpress led to two reinforcers, each delivered after a fixed delay. A right leverpress led to one reinforcer after an adjusting delay. The adjusting delay was increased or decreased many times in a session, depending on the rat's choices, in order to estimate an indifference point—a delay at which the two alternatives were chosen about equally often. Both the number of reinforcers and their individual delays affected the indifference points. The overall pattern of results was well described by the hyperbolic-decay model, which states that each additional reinforcer delivered by an alternative increases preference for that alternative but that a reinforcer's effect is inversely related to its delay. Two other possible delay-discounting equations, an exponential equation and a reciprocal equation, did not produce satisfactory predictions for these data. Adding an additional free parameter to the hyperbolic equation as an exponent for delay did not appreciably improve the predictions, suggesting that raising delay to some power other than 1.0 was unnecessary. The results were qualitatively similar to those from a previous experiment with pigeons (Mazur, 1986), but quantitative differences suggested that the rates of delay discounting were several times slower for rats than for pigeons. [ABSTRACT FROM AUTHOR]

Task difficulty in delayed matching-to-sample tasks (DMTS) is increased by increasing the length of a retention interval. When tasks become more difficult, choice behavior becomes more susceptible to bias produced by unequal reinforcer ratios. Delaying reinforcement from choice behavior also increases both task difficulty and the biasing effect of unequal reinforcer probability. Six pigeons completed nine DMTS conditions with retention intervals of 0, 2,4, 6, and 8 see, in which reinforcer delays of 0,2, and 4 sec were combined with ratios of reinforcer probabilities of .5/.5, .2/.8, and .8/.2 for correct red and green responses. Discriminability (log d) decreased with both increasing retention interval duration and increasing reinforcer delay. Sensitivity to reinforcement, the tendency for ratios of choice responses to follow unequal reinforcer probabilities, also increased as a function of both increasing retention interval and increasing reinforcer delay. The result is consistent with the view that remembering in DMTS tasks is a discriminated operant in which increasing task difficulty increases sensitivity to reinforcement. [ABSTRACT FROM AUTHOR]

Previously, we have shown that changes in pigeons' divided attention performance resulting from changes in relative reinforcement are well described by the generalized matching law. In the present experiment, we examined whether sensitivity of performance to variations in relative reinforcement would be dependent upon sample duration. Pigeons responded on a delayed matching-to-sample procedure with compound samples (color + line orientation) and element comparison stimuli (two colors or two line orientations). Relative reinforcement for accurate matches on the two types of comparison trials varied across conditions. Sample duration was short (i.e., 0.75 sec) for half of the trials in a session and longer (i.e., 2.25 sec) for the other half. Sensitivity of accuracy to changes in relative reinforcement was greater with the longer sample than with the shorter sample, suggesting that differential reinforcement alters the allocation of attending to the elements of compound stimuli. Continued examination of the applicability of well-established theories of goal-directed behavior to the allocation of attention may provide further insights into what is variously referred to as goal-directed, voluntary, endogenous, or top-down control of attention. [ABSTRACT FROM AUTHOR]

In two experiments, food-deprived rat subjects leverpressed for food in three successive training phases. In the first phase of both experiments, rats were exposed to a multiple schedule, one component of which produced a high rate of response, and the other of which produced a lower rate of response (multiple random ratio ERR], random interval [RI] in Experiment 1, and multiple differential reinforcement of high rate, differential reinforcement of low rate in Experiment 2). Rats were then transferred to a multiple fixed interval (FI; 60-sec, 60-sec) schedule, until the effects of the first phase on response rate were no longer apparent and their response rates did not differ from those of rats responding on a multiple FI 60-see, FI 60-sec schedule without previously experiencing a multiple RR, RI schedule. During the third stage of training, all rats were placed into extinction. During extinction, rates of responding were higher in the component previously associated with the high rate of responding in Phase I, and they were lower in the component previously associated with low rates of responding in Phase 1. These results suggest that resurgence effects, like other history effects, are controlled by previous rates of responding. [ABSTRACT FROM AUTHOR]

In four experiments with rats, we examined the persistence of behavior when reinforcement was switched from immediate to delayed. In Experiment 1, lever pressing elicited by instrumental training with immediate reinforcement continued when a 20-sec delay of reinforcement was introduced (easy-to-hard condition), whereas when the delay condition was introduced from the start (hard-to-hard condition), responding remained low throughout. A similar result was obtained in Experiment 2, in which lever pressing was elicited by a classical conditioning (autoshaping) procedure. In Experiment 3, rats initially trained with delayed reinforcement continued to respond at a low rate when switched to immediate reinforcement (hard-to-easy condition). By measuring magazine entry (goal tracking) as well as lever pressing (sign tracking) in Experiment 4, we confirmed that such transfer effects at least partly involve the persistence of whatever type of behavior was initially dominant. [ABSTRACT FROM AUTHOR]

How do animals choose between opportunities to run of different durations? Are longer durations preferred over shorter durations because they permit a greater number of revolutions? Are shorter durations preferred because they engender higher rates of running? Will longer durations be chosen because running is less constrained? The present study reports on three experiments that attempted to address these questions. In the first experiment, five male Wistar rats chose between 10-sec and 50-sec opportunities to run on modified concurrent variable-interval (VI) schedules. Across conditions, the durations associated with the alternatives were reversed. Response, time, and reinforcer proportions did not vary from indifference. In a second experiment, eight female Long-Evans rats chose between opportunities to run of equal (30 see) and unequal durations (10 sec and 50 see) on concurrent variable-ratio (VR) schedules. As in Experiment 1, between presentations of equal duration conditions, 10-sec and 50-sec durations were reversed. Results showed that response, time, and reinforcer proportions on an alternative did not vary with reinforcer duration. In a third experiment, using concurrent VR schedules, durations were systematically varied to decrease the shorter duration toward 0 sec. As the shorter duration decreased, response, time, and reinforcer proportions shifted toward the longer duration. In summary, differences in durations of opportunities to run did not affect choice behavior in a manner consistent with the assumption that a longer reinforcer is a larger reinforcer. [ABSTRACT FROM AUTHOR]

Initial-link response allocation in concurrent chains becomes less extreme as the absolute duration of the initial links increases (Fantino, 1969). The present study asked whether initial-link duration affected how quickly response allocation reached asymptote (i.e., acquisition of preference). Six pigeons were trained on a concurrent-chains procedure in which the terminal links were fixed-interval (Fl) 8 sec Fl 16 sec or FI 16 sec Fl 8 sec and were reversed every 20 sessions. Across conditions, all possible combinations of transitions between variable-interval (VI) 8-sec (short) and VI 24-sec (long) initial-link schedules were studied. Overall, the rate of acquisition was faster when the durations of the initial links preceding the reversal were short rather than long, and when the durations of the initial links following the reversal were long rather than short. By contrast, initial-link duration had no effect on acquisition or asymptotic measures of temporal control of terminal-link responding. These results support the core principle of delay-reduction theory (Fantino, 1969) that the impact of a conditioned reinforcer varies directly with initial-link duration, but also suggest that temporal learning during the terminal links proceeds independently of initial-link duration. [ABSTRACT FROM AUTHOR]

Acquisition, extinction, and transfer of facilitation were explored in a series of experiments with C57BL/6J mice. With a procedure in which an auditory target was followed by food only in the presence of a visual facilitator, Experiments 1–4 showed that the facilitator promoted magazine entries to the auditory target. This enhancement effect was eliminated by training the facilitator as a conditioned inhibitor (Experiments 1 and 3B). Enhancement was also reduced by nonreinforced presentations of the facilitator in a discrimination procedure (Experiment 1) and by simple nonreinforcement of the facilitator (Experiments 2, 3A, and 4). In contrast to the results obtained with a facilitator, simple nonreinforcement of an inhibitor, a visual cue that had signaled when an auditory target would not be reinforced, did not reduce its ability to modulate responding to that target (Experiment 4). However, both the facilitator and the inhibitor were found to transfer their modulatory effects to other targets (Experiment 4). Finally, mice demonstrated no evidence of differential responding on a biconditional discrimination procedure in which one auditory target (A1) was reinforced in the presence of one visual stimulus (L1) but not in the presence of another (L2), and a different auditory target (A2) was reinforced in L2 but not in L1 (Experiment 5). The implications of these results for analysis of the function of a facilitator are discussed. [ABSTRACT FROM AUTHOR]

Contemporary time accumulation models make the unique prediction that acquisition of a conditioned response will be equally rapid with partial and continuous reinforcement, if the time between conditioned stimuli is held constant. To investigate this, acquisition of conditioned responding was examined in pigeon autoshaping under conditions of 100% and 25% reinforcement, holding intertrial interval constant. Contrary to what was predicted, evidence for slowed acquisition in partially reinforced animals was observed with several response measures. However, asymptotic performance was superior with 25% reinforcement A switching of reinforcement contingencies after initial acquisition did not immediately affect responding. After further sessions, partial reinforcement augmented responding, whereas continuous reinforcement did not, irrespective of an animal's reinforcement history. Subsequent training with a novel stimulus maintained the response patterns. These acquisition results generally support associative, rather than time accumulation, accounts of conditioning. [ABSTRACT FROM AUTHOR]

Six hens pecked a key (Experiment 1) or pushed a door (Experiment 2) to obtain food reinforcement. In both experiments and as an analogue of price changes, the response requirements were varied in two ways: by increasing the number of responses required and by increasing the required force of each response. The two price manipulations (response number and response force) had different effects on behavior and produced different-shaped demand functions when the rates of consumption were plotted logarithmically against the price analogues. Irrespective of response topography, when the number of required responses was varied, the data paths appeared linear, with slopes close to - 1.0. When the required force of each keypeck and doorpush was varied, the data paths were clearly curved, with increasingly steep downward slopes as the force increased. Using the concept of unit price did not fully remove the different effects of the two price manipulations. Those differences are best attributed to the differing times needed in order to complete each response unit under those price manipulations. [ABSTRACT FROM AUTHOR]