Search

Conditioned reinforcement for math, or math enjoyment, may be critical for students. If so, this should be established as early as pre-kindergarten, as conditioning the components of math as reinforcement arguably leads to more complex mathematical operations thus impacting individuals' future math ability and literacy (Engel et al., 2013), A multiple probe across dyads design with a nested multiple probe across dyads design was used to determine if establishing a preference for math influenced students' rate of learning math. The intervention tested the effect of the individualized reinforcement procedures, based on a sequence of conditioning procedures proposed in Buttigieg and Greer's (2023) study, on establishing conditioned reinforcement. Three participants required learn units, two participants required the stimulus–stimulus pairing procedure, and one participant required observational conditioning-by-denial to establish conditioned reinforcement for math. The dependent variable was each participant's rate of learning as measured by the number of learn units required to meet mastery criterion for four units of the Equivalence Based Functional Math Curriculum (EBF-Math; Weber et al., 2023). Results showed an educationally significant acceleration of learning following the establishment of conditioned reinforcement for math across all six participants. Results are discussed in terms of the significance of early math instruction and literacy. [ABSTRACT FROM AUTHOR]

We evaluated the effects of a discrimination training procedure for establishing praise as a reinforcer for three children with autism spectrum disorder. After establishing two praise words as discriminative stimuli and two nonsense words as S‐deltas, we evaluated whether the stimuli then functioned as reinforcers by presenting each stimulus as a consequence for a new response. The results demonstrated that previously neutral praise words functioned as reinforcers and nonsense words did not. As in previous studies on establishing reinforcers, the effects were transitory, and praise words did not continue to function as reinforcers after repeated exposure without discrimination training. Recommendations are provided for future research and maintaining reinforcement effects. [ABSTRACT FROM AUTHOR]

Rationale: The importance of reward-associated cues in eliciting behavior is well established, with stimuliassociated with drugs of abuse known to play a crucial role in recidivism. Recently, Redish (2004) proposed that drugs,acting as unconditional stimuli (US), remain associable even after being fully predicted by a conditional stimulus (CS),meaning that they are not susceptible to the blocking effect [1]; if correct, this may represent a possible mechanism toexplain exaggerated cue-controlled drug-seeking and reinstatement in nicotine dependence and substance dependenceproblems in general.Objectives: We tested whether pairings between nicotine and an environmental CS would convey conditionedreinforcement properties onto the CS, even when nicotine’s rewarding effects were already fully predicted by another cue(whether there was an absence of the blocking effect).Methods: 134 male Long-Evans rats were implanted with jugular catheters and assigned to either food- or nicotine-reward(0.06 mg/kg/inf) conditions. Each group was exposed to paired or unpaired presentations of their respective reward withone CS in 10 daily sessions; subsequently, they were exposed to 4 more daily sessions of paired presentations of thereward paired with a compound CS composed of the original CS and a second CS. Tests of the conditioned reinforcingvalue of both CSs using the active-lever-presses to total-presses ratio as an outcome were conducted following training.Results: Pressing for a blocked second CS (µ = 0.59, SD = 0.21) was significantly lower than pressing for an unblockedsecond CS (µ = 0.69, SD = 0.14) in the food-reward condition, but not in nicotine-rewarded animals, verifying thehypothesis that nicotine, but not food, is resilient to the blocking effect.Conclusion: The absence of blocking when nicotine is the reward may explain the powerful role for cues in supportingtobacco dependenceby allowing for the extension of nicotine’s rewarding value across numerous associated cues.acting as unconditional stimuli (US), remain associable even after being fully predicted by a conditional stimulus (CS),meaning that they are not susceptible to the blocking effect [1]; if correct, this may represent a possible mechanism toexplain exaggerated cue-controlled drug-seeking and reinstatement in nicotine dependence and substance dependenceproblems in general.

We investigated the effects of a response-contingent pairing (RCP) procedure on responses to voices for preschoolers with autism spectrum disorder (ASD). The participants were 4 preschool males who attended full-day special education classes utilizing a behavior-analytic system of schooling. The participants were chosen due to (a) their low numbers of observing responses to voices during initial probe screenings for observing responses to different forms of voice stimuli, and (b) their slow rates of mastery of educational objectives in their Individualized Education Programs (IEPs). We used an iPad-based RCP voice conditioning protocol during which we taught the participants to touch a correct stimulus on a screen (a red circle) that would activate 10 s of either sung or spoken song lyrics or spoken storylines. The conditioning component involved a response-contingent pairing procedure; contingent on a correct selection response, the investigators immediately paired the voice output with preferred edibles and/or light, preferred physical contact for the entire interval. We employed a multiple probe design across participants for five observing responses to voices (OV) following the intervention. The results showed increases for all four participants' OV responses. We explore future implications of research involving increasing preferences for voices, and discuss other potential dependent variables. [ABSTRACT FROM AUTHOR]

As first reported several decades ago, pigeons (Columba livia) sometimes choose options that provide less food over options that provide more food. This behavior has been variously referred to as suboptimal, maladaptive, or paradoxical because it lowers overall food intake. A great deal of research has been directed at understanding the conditions under which animals and people make suboptimal choices and the mechanisms that drive this behavior. Here, we review the literature on suboptimal choice and the variables that play a role in this phenomenon. Suboptimal choice is most likely to occur when the outcomes following a choice are uncertain, when the outcomes are delayed after the choice, and when the outcomes are signaled only on the option that provides food less often. We propose a mathematical formalization of the signal for good news (SiGN) model which assumes that a signal for a reduction in delay to food reinforces choice. We generate predictions from the model about the effect of parameters that characterize suboptimal choice and we show that, even in the absence of free parameters, the SiGN model provides a very good fit to the choice proportions of birds from a large set of conditions across studies from numerous researchers. R code for SiGN predictions and the data set are available on the Open Science Framework (https://osf.io/39qtj). We discuss limitations of the model, propose directions for future research, and discuss the general applicability of this research to understanding how rewards and signals for reward may combine to reinforce behavior. [ABSTRACT FROM AUTHOR]

In substance use disorders, drug use as unconditioned stimulus (US) reinforces drug taking. Meanwhile, drug-associated cues (conditioned stimulus [CS]) also gain incentive salience to promote drug seeking. The basolateral amygdala (BLA) is implicated in both US- and CS-mediated responses. Here, we show that two genetically distinct BLA neuronal types, expressing Rspo2 versus Ppp1r1b, respectively, project to the nucleus accumbens (NAc) and form monosynaptic connections with both dopamine D1 and D2 receptor-expressing neurons. While intra-NAc stimulation of Rspo2 or Ppp1r1b presynaptic terminals establishes intracranial self-stimulation (ICSS), only Ppp1r1b-stimulated mice exhibit cue-induced ICSS seeking. Furthermore, increasing versus decreasing the Ppp1r1b-to-NAc, but not Rspo2-to-NAc, subprojection increases versus decreases cue-induced cocaine seeking after cocaine withdrawal. Thus, while both BLA-to-NAc subprojections contribute to US-mediated responses, the Ppp1r1b subprojection selectively encodes CS-mediated reward and drug reinforcement. Such differential circuit representations may provide insights into precise understanding and manipulation of drug- versus cue-induced drug seeking and relapse.

A primary characteristic of autism spectrum disorder includes restrictive and repetitive patterns of behavior. Because having few preferred items and activities can lead to social, communicative, and educational barriers, it is important to increase the number of preferred stimuli in the individual's environment. One way to do this is through conditioned reinforcement via observation. Such procedures involve the acquisition of a skill or change in behavior as a result of indirect contact (i.e., observation) with contingencies received by others. While conditioning through observation has been shown to be effective, one novel approach is video self‐modeling. The purpose of the current study was to assess the effects of video self‐modeling on the preference and reinforcer value of toys for children diagnosed with autism spectrum disorder. [ABSTRACT FROM AUTHOR]

Rationale: The importance of reward-associated cues in eliciting behavior is well established, with stimuliassociated with drugs of abuse known to play a crucial role in recidivism. Recently, Redish (2004) proposed that drugs,acting as unconditional stimuli (US), remain associable even after being fully predicted by a conditional stimulus (CS),meaning that they are not susceptible to the blocking effect [1]; if correct, this may represent a possible mechanism toexplain exaggerated cue-controlled drug-seeking and reinstatement in nicotine dependence and substance dependenceproblems in general.Objectives: We tested whether pairings between nicotine and an environmental CS would convey conditionedreinforcement properties onto the CS, even when nicotine’s rewarding effects were already fully predicted by another cue(whether there was an absence of the blocking effect).Methods: 134 male Long-Evans rats were implanted with jugular catheters and assigned to either food- or nicotine-reward(0.06 mg/kg/inf) conditions. Each group was exposed to paired or unpaired presentations of their respective reward withone CS in 10 daily sessions; subsequently, they were exposed to 4 more daily sessions of paired presentations of thereward paired with a compound CS composed of the original CS and a second CS. Tests of the conditioned reinforcingvalue of both CSs using the active-lever-presses to total-presses ratio as an outcome were conducted following training.Results: Pressing for a blocked second CS (µ = 0.59, SD = 0.21) was significantly lower than pressing for an unblockedsecond CS (µ = 0.69, SD = 0.14) in the food-reward condition, but not in nicotine-rewarded animals, verifying thehypothesis that nicotine, but not food, is resilient to the blocking effect.Conclusion: The absence of blocking when nicotine is the reward may explain the powerful role for cues in supportingtobacco dependenceby allowing for the extension of nicotine’s rewarding value across numerous associated cues.acting as unconditional stimuli (US), remain associable even after being fully predicted by a conditional stimulus (CS),meaning that they are not susceptible to the blocking effect [1]; if correct, this may represent a possible mechanism toexplain exaggerated cue-controlled drug-seeking and reinstatement in nicotine dependence and substance dependenceproblems in general.

Conditioned reinforcers are widely used in applied behavior analysis. Basic research evidence reveals that Pavlovian learning plays an important role in the acquisition and efficacy of new conditioned‐reinforcer functions. Thus, a better understanding of Pavlovian principles holds the promise of improving the efficacy of conditioned reinforcement in applied research and practice. This paper surveys how (and if) Pavlovian principles are presented in behavior‐analytic textbooks; imprecisions and knowledge gaps within contemporary Pavlovian empirical findings are highlighted. Thereafter, six practical principles of Pavlovian conditioning are presented along with empirical support and knowledge gaps that should be filled by applied and translational behavior‐analytic researchers. Innovative applications of these principles are outlined for research in language acquisition, token reinforcement, and self‐control. [ABSTRACT FROM AUTHOR]

Shahan et al. (2006) found that the relative rate of pigeons' pecking on two observing responses (i.e., responses that only produced an S+ or stimulus correlated with primary reinforcement) was well described by the relative rate of S+ delivery. Researchers have not evaluated the effects of S+ delivery rate in a concurrent observing response procedure with human subjects, so the necessary procedural modifications for studying the effects of conditioned reinforcement on human choice remain unclear. The purpose of the current study was to conduct an additive component analysis of modifications to the procedures of Shahan et al. (2006). We evaluated the additive effects of introducing response cost, a changeover response, and ordinal discriminative stimuli on correspondence with the results of Shahan et al. and the quality of fits of the generalized matching equation. When our procedures were most similar to those of Shahan et al., we observed low rates of observing and indifference between the two observing responses. For the group of subjects with whom all three additive components were included, we obtained the highest level of sensitivity to relative rate of S+ delivery, but the slope and R2 of our fits of the generalized matching equation were still much lower than those obtained by Shahan et al. Potential reasons for these discrepancies, methods of resolving them, and implications for future research are discussed. [ABSTRACT FROM AUTHOR]

Signals that reduce uncertainty can be valuable because well-informed decision-makers can better align their preferences to opportunities. However, some birds and mammals display an appetite for informative signals that cannot be used to increase returns. We explore the role that reward-predictive stimuli have in fostering such preferences, aiming at distinguishing between two putative underlying mechanisms. The 'information hypothesis' proposes that reducing uncertainty is reinforcing per se, somewhat consistently with the concept of curiosity: a motivation to know in the absence of tractable extrinsic benefits. In contrast, the 'conditioned reinforcement hypothesis', an associative account, proposes asymmetries in secondarily acquired reinforcement: post-choice stimuli announcing forthcoming rewards (S+) reinforce responses more than stimuli signalling no rewards (S−) inhibit responses. In three treatments, rats faced two equally profitable options delivering food probabilistically after a fixed delay. In the informative option (Info), food or no food was signalled immediately after choice, whereas in the non-informative option (NoInfo) outcomes were uncertain until the delay lapsed. Subjects preferred Info when (1) both outcomes were explicitly signalled by salient auditory cues, (2) only forthcoming food delivery was explicitly signalled, and (3) only the absence of forthcoming reward was explicitly signalled. Acquisition was slower in (3), when food was not explicitly signalled, showing that signals for positive outcomes have a greater influence on the development of preference than signals for negative ones. Our results are consistent with an elaborated conditioned reinforcement account, and with the conjecture that both uncertainty reduction and conditioned reinforcement jointly act to generate preference. [ABSTRACT FROM AUTHOR]

Background Reward-related learning, where animals form associations between rewards and stimuli (i.e. conditioned stimuli [CS]) that predict or accompany those rewards, is an essential adaptive function for survival. Methods In this study, we investigated the mechanisms underlying the acquisition and performance of conditioned approach learning with a focus on the role of muscarinic acetylcholine (mACh) and NMDA glutamate receptors in the substantia nigra (SN), a brain region implicated in reward and motor processes. Results Using RNAscope in situ hybridization assays, we found that dopamine neurons of the SN express muscarinic (mACh5), NMDA2a, NMDA2b, and NMDA2d receptor mRNA but not mACh4. NMDA, but not mACh5, receptor mRNA was also found on SN GABA neurons. In a conditioned approach paradigm, rats were exposed to 3 or 7 conditioning sessions during which light/tone (CS) presentations were paired with delivery of food pellets, followed by a test session with CS-only presentations. Intra-SN microinjections of scopolamine (a mACh receptor antagonist) or AP-5 (a NMDA receptor antagonist) were made either prior to each conditioning session (to test their effects on acquisition) or prior to the CS-only test (to test their effects on expression of the learned response). Scopolamine and AP-5 produced dose-dependent significant reductions in the acquisition, but not performance, of conditioned approach. Conclusions These results suggest that SN mACh and NMDA receptors are key players in the acquisition, but not the expression, of reward-related learning. Importantly, these findings redefine the role of the SN, which has traditionally been known for its involvement in motor processes, and suggest that the SN possesses attributes consistent with a function as a hub of integration of primary reward and CS signals. [ABSTRACT FROM AUTHOR]

Under certain conditions, pigeons will reliably prefer an alternative that leads to a lower probability of food over an alternative that leads to a higher probability of food (i.e., demonstrate suboptimal choice). A critical aspect of the typical procedure is that the alternative associated with less food provides differential stimuli that signal trial outcomes, but the alternative associated with more food does not. Few studies have investigated how partial signaling of an alternative influences preference. In Experiments 1–3, pigeons chose between two alternatives that each led to food 60% of the time with partially signaled trial outcomes. One alternative occasionally provided a stimulus that always preceded food (i.e., "good news") and the other alternative occasionally provided a stimulus that always preceded no food ("bad news"). Experiments 2 and 3 also assessed preference in conditions in which alternatives were either completely unsignaled (provided no differential stimuli) or always led to food. Pigeons consistently preferred the "good news" alternative over the "bad news" alternative and preferred 100% food over the "bad news" alternative. The results from conditions in which pigeons chose between the "bad news" alternative and an unsignaled alternative were inconclusive, but suggestive of a preference for bad news. The results are used to evaluate and distinguish between competing explanations of suboptimal choice. [ABSTRACT FROM AUTHOR]

Individuals with autism and intellectual impairments tend to be excluded from research due to their difficulties with methodological compliance. This study focuses on using Teaching with Acoustic Guidance-TAGteach-to behaviorally prepare children with autism and a IQ ≤ 80 to participate in a study on neurofeedback training (NFT). Seven children (ages 6-8) learned the prerequisite skills identified in a task analysis in an average of 5 h of TAGteach training, indicating that this is a feasible method of preparing intellectually-impaired children with autism to participate in NFT and task-dependent electroencephalography measures. TAGteach may thus have the potential to augment this population's ability to participate in less accessible treatments and behavioral neuroscientific studies.

Consensus seeking – abandoning one’s own judgment to alignwith a group majority – is a fundamental feature of humansocial interaction. Notably, such striving for majorityaffiliation often occurs in the absence of any apparenteconomic or social gain, suggesting that achieving consensusmight have intrinsic value. Here, we examine the affectiveproperties of consensus decisions by assessing the transfer ofvalence to concomitant stimuli. Specifically, in two studies,we show that contexts repeatedly paired with consensusdecisions are rated as more likable, and selected morefrequently in a two-alternative forced choice test, than arecontexts repeatedly paired with dissent from a unanimousmajority. In the second study, we rule out inferences aboutthe accuracy of the majority opinion as the basis for suchevaluative changes. Our results suggest that an intrinsic valueof consensus, or cost of dissent, may motivate and reinforcesocial conformity.

In animal training, there is disagreement regarding whether a conditioned reinforcer, such as the sound of a clicker, should always be followed by an unconditioned reinforcer, such as a treat. Proponents for clicking without always giving a treat argue that the click can substitute for the reinforcer, due to Pavlovian conditioning and the partial reinforcement effect. Those who advise always following the click with a treat argue that the clicker will become an unreliable predictor of food if it is not always followed by an unconditioned reinforcer. In this study, a within‐subject reversal design with two dogs was used to compare the behavioral effects of always following a click with food (one click condition) and only sometimes following a click with food (two clicks condition). Results showed that the two clicks condition disrupted the frequency, accuracy, and topography of the behavior and increased noncompliance and other unwanted behaviors. While the detrimental effects of this condition may seem paradoxical at first, they can be explained by the discriminative properties of the conditioned reinforcer. [ABSTRACT FROM AUTHOR]

The influence of single option or forced-exposure (FE) trials was studied in the suboptimal choice task. Pigeons chose between an optimal alternative that led to food half of the time and a suboptimal alternative that led to food 20% of the time. Choice of the suboptimal alternative was compared across groups of subjects that received different numbers of FE trials during training. In Experiment 1, subjects received 100% FE trials, 67% FE trials, or only choice trials. Pigeons in the two groups that had FE trials developed extreme preference for the signaled suboptimal alternative over the unsignaled optimal alternative, while pigeons that had no FE trials showed pronounced individual differences. Experiment 2 compared 10% and 90% FE trials. When neither alternative signaled trial outcomes, both groups of subjects strongly preferred the optimal alternative. When the suboptimal alternative provided differential signals, the subjects in the 90% FE group developed strong preference for the suboptimal alternative and subjects in the 10% FE group maintained preference for the optimal alternative. The results of both experiments demonstrate that FE trials can have substantial effects on the development of preference in the suboptimal choice task. [ABSTRACT FROM AUTHOR]

Every species possesses abilities for successfully interacting with its environment. These result from phylogeny. In the laboratory, one may arrange artificial conditions that thwart an organism's abilities. The result may be a "phenomenon." With sufficient training, however, the phenomenon may prove to be ephemeral, as the organism's basic abilities reassert themselves. Pigeons respond extremely well to differences and nondifferences in rate of obtaining food. This ability may be thwarted in a variety of ways, but the results tend to be ephemeral. An example is an experiment that pitted pigeons' preference for unimpeded responding against their ability to respond to food rate. In a concurrent-chains procedure, the terminal links were identical variable-interval schedules, but in one terminal link, every response produced a timeout. The duration of the timeout varied, and preference varied with it, but the relation vanished with training, in keeping with the equality of food rate across the 2 terminal links. Some other examples of "phenomena" that tend to disappear with sufficient training and sufficient variation in experimental parameters are behavioral contrast, conditioned reinforcement, resistance to extinction, and suboptimal choice. These "phenomena" depend on pigeons' failing to make difficult discriminations. They appear to be behavioral ephemera. [ABSTRACT FROM AUTHOR]

A change in motivational state does not guarantee a change in operant behaviour. Only after an organism has had contact with an outcome while in a relevant motivational state does behaviour change, a phenomenon called incentive learning. While ample evidence indicates that this is true for primary reinforcers, it has not been established for conditioned reinforcers. We performed an experiment with rats where lever-presses were reinforced by presentations of an audiovisual stimulus that had previously preceded food delivery; in the critical experimental groups, the audiovisual stimulus was then paired a single time with a strong electric shock. Some animals were reexposed to the audiovisual stimulus. Lever-presses yielding no outcomes were recorded in a subsequent test. Animals that had been reexposed to the audiovisual stimulus after the aversive training responded less than did those that had not received reexposure. Indeed, those animals that were not reexposed did not differ from a control group that received no aversive conditioning of the audiovisual stimulus. Moreover, these results were not mediated by a change in the food's reinforcement value, but instead reflect a change in behaviour with respect to the conditioned reinforcer itself. These are the first data to indicate that the affective value of conditioned stimuli, like that of unconditioned ones, is established when the organism comes into contact with them. [ABSTRACT FROM AUTHOR]

• Reward-associated stimuli can acquire the ability to activate dopamine cells. • VTA acetylcholine constitutes a primary reward signal. • VTA glutamate constitutes a conditioned stimulus signal. • This article bridges neuroscience with psychology of reward learning. A major goal in psychology is to understand how environmental stimuli associated with primary rewards come to function as conditioned stimuli, acquiring the capacity to elicit similar responses to those elicited by primary rewards. Our neurobiological model is predicated on the Hebbian idea that concurrent synaptic activity on the primary reward neural substrate—proposed to be ventral tegmental area (VTA) dopamine (DA) neurons—strengthens the synapses involved. We propose that VTA DA neurons receive both a strong unconditioned stimulus signal (acetylcholine stimulation of DA cells) from the primary reward capable of unconditionally activating DA cells and a weak stimulus signal (glutamate stimulation of DA cells) from the neutral stimulus. Through joint stimulation the weak signal is potentiated and capable of activating the VTA DA cells, eliciting a conditioned response. The learning occurs when this joint stimulation initiates intracellular second-messenger cascades resulting in enhanced glutamate-DA synapses. In this review we present evidence that led us to propose this model and the most recent evidence supporting it. [ABSTRACT FROM AUTHOR]

• Rats will press a lever to procure a CS that had been previously paired with food. • The number of CS-food pairings determines whether the reinforcing properties of the CS can be disrupted by extinction. • Where extinction fails to disrupt these properties, they can be disrupted by shifting rats from CS-food pairings to explicitly unpaired presentations of the CS and food. • This effect of the unpaired treatment (disruption) differs from its effect in studies of Pavlovian-to-instrumental transfer (no disruption), suggesting that it disrupts the reinforcing properties of the CS (assessed here) while sparing its other properties (assessed in PIT). • These findings are consistent with the Rescorla-Wagner (1972) model, according to which the unpaired treatment is more effective than extinction in reducing the strength of the CS-US association. This series of experiments examined the effects of extinction and an explicitly unpaired treatment on the ability of a conditioned stimulus (CS) to function as a reinforcer. Rats were trained to lever press for food, exposed to pairings of a noise CS and food, and, finally, tested for their willingness to lever press for the CS in the absence of the food. Experiment 1 provided a demonstration of conditioned reinforcement (using controls that were only exposed to unpaired presentations of the CS and food) and showed that it was equivalent after one or four sessions of CS-food pairings. Experiments 2 and 3 showed that, after one session of CS-food pairings, repeated presentations of the CS alone reduced its reinforcing properties; but after four sessions of CS-food pairings, repeated presentations of the CS alone had no effect on these properties. Experiment 4 showed that, after four sessions of CS-food pairings, explicitly unpaired presentations of the CS and food completely undermined conditioned reinforcement. Finally, Experiment 5 provided within-experiment evidence that, after four sessions of CS-food pairings, the reinforcing properties of the CS were disrupted by explicitly unpaired presentations of the CS and food but spared by repeated presentations of the CS alone. Together, these findings indicate that the effectiveness of extinction in undermining the reinforcing properties of a CS depends on its level of conditioning; and that, where extinction fails to disrupt these properties, they are successfully undermined by an explicitly unpaired treatment. They are discussed with respect to findings in the literature on Pavlovian-to-instrumental transfer; and the Rescorla-Wagner model, which anticipates that an explicitly unpaired treatment will be more effective than extinction in reversing the effects of conditioning. [ABSTRACT FROM AUTHOR]

Individuals addicted to cocaine spend much of their time foraging for the drug. Pavlovian drug-associated conditioned stimuli exert a major influence on the initiation and maintenance of drug seeking often long into abstinence, especially when presented response-contingently, acting as conditioned reinforcers that bridge delays to drug use. The acquisition of cue-controlled cocaine seeking has been shown to depend on functional interactions between the basolateral amygdala (BLA) and the nucleus accumbens core (NAcC). However, the precise neuronal circuits underlying the acquisition of cue-controlled cocaine-seeking behavior have not been elucidated. Here, we used a projection-specific Cre-dependent DREADD (designer receptor exclusively activated by designer drugs)-mediated causal approach to test the hypothesis that the direct projections from the BLA to the NAcC are required for the acquisition of cue-controlled cocaine-seeking behavior. In Sprague Dawley rats with Cre-mediated expression of the inhibitory DREADD hM4D(Gi) in the NAcC-projecting BLA neurons, treatment with clozapine N-oxide, but not vehicle, selectively prevented the impact of cocaine-associated conditioned reinforcers on cocaine seeking under a second-order schedule of reinforcement. This effect was attributable to the chemogenetic inhibition of the NAcC-projecting BLA neurons, as it was reversible, and it was absent in clozapine N-oxide–treated rats expressing an empty control virus. In contrast, chemogenetic inhibition of the anterior insula, which receives collateral projections from NAcC-projecting BLA neurons, was without effect. These data demonstrate that the acquisition of cue-controlled cocaine seeking that depends on the conditioned reinforcing effects of cocaine cues requires activity in the direct projections from the BLA to the NAcC. [ABSTRACT FROM AUTHOR]

We present a new mathematical formulation of associative learning focused on non-human animals, which we call A-learning. Building on current animal learning theory and machine learning, A-learning is composed of two learning equations, one for stimulus-response values and one for stimulus values (conditioned reinforcement). A third equation implements decision-making by mapping stimulus-response values to response probabilities. We show that A-learning can reproduce the main features of: instrumental acquisition, including the effects of signaled and unsignaled non-contingent reinforcement; Pavlovian acquisition, including higher-order conditioning, omission training, autoshaping, and differences in form between conditioned and unconditioned responses; acquisition of avoidance responses; acquisition and extinction of instrumental chains and Pavlovian higher-order conditioning; Pavlovian-to-instrumental transfer; Pavlovian and instrumental outcome revaluation effects, including insight into why these effects vary greatly with training procedures and with the proximity of a response to the reinforcer. We discuss the differences between current theory and A-learning, such as its lack of stimulus-stimulus and response-stimulus associations, and compare A-learning with other temporal-difference models from machine learning, such as Q-learning, SARSA, and the actor-critic model. We conclude that A-learning may offer a more convenient view of associative learning than current mathematical models, and point out areas that need further development. [ABSTRACT FROM AUTHOR]

Rationale: Environmental stimuli paired with alcohol can function as conditioned reinforcers (CRfs) and trigger relapse to alcohol-seeking. In animal models, pharmacological stressors can enhance alcohol consumption and reinstate alcohol-seeking, but it is unknown whether stress can potentiate the conditioned reinforcing properties of alcohol-paired stimuli. Objectives: We examined whether the pharmacological stressors, the α-2 adrenoreceptor antagonist yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) and the K-opioid receptor agonist U50,488 (vehicle, 1.25, 2.5 mg/kg; SC), increase responding for conditioned reinforcement, and if their effects interact with the nature of the reward (alcohol vs. sucrose). We subsequently examined the effects of yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) on responding for sensory reinforcement. Methods: Male Long-Evans underwent Pavlovian conditioning, wherein a tone-light conditioned stimulus (CS) was repeatedly paired with 12% EtOH or 21.7% sucrose. Next, tests of responding for a CRf were conducted. Responding on the CRf lever delivered the CS, whereas responding on the other lever had no consequences. In a separate cohort of rats, the effects of yohimbine on responding just for the sensory reinforcer were examined. Results: Both doses of yohimbine, but not U50,488, increased responding for conditioned reinforcement. This enhancement occurred independently of the nature of the reward used during Pavlovian conditioning. Yohimbine-enhanced responding for a CRf was reproducible and stable over five tests; it even persisted when the CS was omitted. Both doses of yohimbine also increased responding for sensory reinforcement. Conclusions: Yohimbine increases operant responding for a variety of sensory and conditioned reinforcers. This enhancement may be independent of its stress-like effects. [ABSTRACT FROM AUTHOR]

Decades of research show how what we know about learned reinforcers, as the selectors of behavior, constitutes a significant advancement in behavior analysis. I describe how the learning of new reinforcers results in new operants including verbal operants and verbal developmental cusps, as well as the potential to build still other reinforcers. The lack of particular types of reinforcers, or a limited community of reinforcers, is the root source of many problems in applied work and sources of complex relations in the basic science. In cases where the relevant reinforcers are present, building behavior is the solution; however, when the relevant reinforcers are not present, the use of prosthetic reinforcers does not solve the real problem. In the latter case, the solution is to build new reinforcers, behaviors will follow. I cite decades of work in food preferences, musical taste, social reinforcers, and the identification and establishment of verbal developmental cusps that shows how identifying and building new reinforcers expands what our science can do. The establishment of a rich community of socially significant positive reinforcers is life-altering. [ABSTRACT FROM AUTHOR]

Copyright of Mexican Journal of Behavioral Analysis / Revista Mexicana de Análisis de la Conducta is the property of Sociedad Mexicana de Analisis de la Conducta and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Some individuals with intellectual disabilities do not respond to praise as a reinforcer, which may limit their ability to learn. We evaluated 2 procedures (stimulus pairing and response-stimulus pairing), both of which involved pairing previously neutral praise statements with preferred edible items, to determine their usefulness in establishing praise as a reinforcer. Results of Study 1 indicated that stimulus pairing was not effective in conditioning praise as a reinforcer for 3 of 4 subjects; results were inconclusive for the 4th subject. Results of Study 2 indicated that response-stimulus pairing was effective in conditioning praise as a reinforcer for 4 of 8 subjects. After conditioning, praise also increased the occurrence of additional target responses for these 4 subjects.

The acquisition of active avoidance (AA) behavior is typically aided by the presence of two signals—the warning signal, which predicts the future occurrence of an aversive event (e.g., shocks), and the safety signal, which is presented upon successful avoidance of oncoming shocks. While the warning signal could be conceived to act as a Pavlovian fear cue, and is likely mediated by brain areas that underlie Pavlovian fear cue conditioning, the neural substrates underlying safety signaling are less clear, largely due to the unavailability of AA tasks that are devoid of an explicit warning signal. The present study sought to investigate the role of the ventral hippocampus (VH) in safety signaled AA performance acquired without an explicit warning signal, using a novel discrete trial paradigm. Adult male Long Evans rats were divided into two groups and trained to acquire AA responses with, or without a safety signal. Analysis of the acquisition and stable state performance data revealed that the availability of a safety signal alone did not improve the acquisition or performance of AA responses. Furthermore, post‐training, reversible VH inactivation did not impact stable state avoidance behavior. However, extinction of avoidance responses was facilitated in the group trained with a safety signal, and this effect was further potentiated by VH inactivation. Additional elevated plus maze (EPM), light–dark box, and locomotor tests demonstrated that VH inactivation reduced anxiety without affecting locomotor activity. Taken together, these results demonstrate the importance of VH in the extinction of persistent pathological avoidance behavior when safety is signaled. [ABSTRACT FROM AUTHOR]

Token economies are one of the most commonly used behavior‐analytic interventions. Despite literature supporting the use of tokens as tools for behavior change, little is known about the efficacy of tokens compared to that of the items for which they are exchanged. Results of previous research comparing the reinforcing efficacy of tokens and primary reinforcers have shown that both produce similar effects on responding. However, published findings have been confounded given the inclusion of primary reinforcers in the token‐reinforcer test conditions. In this study, we established novel tokens as reinforcers. We then conducted a conditioned‐reinforcer assessment using a tandem control to ensure that the tokens functioned as reinforcers. We used progressive‐ratio schedules to compare the reinforcing efficacy of the tokens to high‐ and low‐preference edibles that were also used as backup reinforcers. For both participants, we found that high‐preference primary reinforcers maintained higher response frequencies than did tokens. [ABSTRACT FROM AUTHOR]

Background and Purpose: Binge drinking is a serious problem among adolescents and young adults despite its adverse consequences on the brain and behavior. One area that remains poorly understood concerns the impact of chronic intermittent ethanol (CIE) exposure on incentive learning. Methods: Here, we examined the effects of CIE exposure during different developmental stages on conditioned approach and conditioned reward learning in rats experiencing acute or protracted withdrawal from alcohol. Two or 21 days after adolescent or adult CIE exposure, male rats were exposed to pairings of a light stimulus (CS) and food pellets for 3 consecutive daily sessions (30 CS‐food pellet pairings per session). This was followed by conditioned approach testing measuring responses (food trough head entries) to the CS‐only presentations and by conditioned reward testing measuring responses on a lever producing the CS and on another producing a tone. We then measured behavioral sensitization to repeated injections of heroin (2 mg/kg/d for 9 days). Results: Adolescent and adult alcohol‐treated rats showed significantly impaired conditioned reward learning regardless of withdrawal period (acute or prolonged). We found no evidence of changes to conditioned approach learning after adolescent or adult exposure to CIE. Finally, in addition to producing long‐term impairments in incentive learning, CIE exposure enhanced locomotor activity in response to heroin and had no effect on behavioral sensitization to heroin regardless of age and withdrawal period. Conclusions: Our work sets a framework for identifying CIE‐induced alterations in incentive learning and inducing susceptibility to subsequent opioid effects. [ABSTRACT FROM AUTHOR]

Reading interest is suggested to be integral to reading achievement, which affects later academic performance. Using whole-interval measures of silent-reading time, we recorded 34 second-grade students' durations of reading episodes as constituting their intrinsic reading interest, or reinforcement value of reading content. Assessment of relations between this measure of sustained attention to the content of the text and multiple measures of both reading comprehension and vocabulary yielded significant correlations. We simultaneously conducted a combined preintervention and postintervention design with multiple probe logic to test the effect of the establishment of conditioned reinforcement for reading content, via a collaborative shared reading intervention with a teacher, on reading comprehension and vocabulary. This procedure involved periods of reciprocal reading and related collaborative reading activities designed to increase students' reinforcement value of reading. The establishment of conditioned reinforcement for reading content for 7 participants resulted in grade-level increases from 0.1 to 2.2 grades on various measures of reading achievement in fewer than nine sessions (315 min). The results of this study suggest that it is not enough to learn the structure of reading: rather, one must learn to "love to read" in order to derive meaning from text in his or her development of comprehension and vocabulary. [ABSTRACT FROM AUTHOR]

Copyright of Mexican Journal of Behavioral Analysis / Revista Mexicana de Análisis de la Conducta is the property of Sociedad Mexicana de Analisis de la Conducta and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Praise and other forms of attention may not function as reinforcers for the behavior of children with autism. Previous research demonstrated that contingently pairing praise with reinforcers (response stimulus) can establish praise as a conditioned reinforcer. We evaluated a procedure for establishing praise as a generalized conditioned reinforcer (pair praise with four reinforcers) and compared it with a procedure to establish praise as a conditioned reinforcer (pair praise with one reinforcer). We compared the two conditions in a reversal design with "praise" and "no programmed consequence" conditions rapidly alternated after pairing phases. With three out of five participants with autism, responding in the "pair‐with‐four" condition showed higher levels of responding or more increasing trends compared with that in "pair‐with‐one" condition. We also replicated previous contingent pairing research with two participants in a multiple baseline across participants design. A limitation was the absence of manipulating motivating operations in assessing the efficacy of praise as a generalized conditioned reinforcer. Nevertheless, these data contribute to the research on establishing praise as a reinforcer, and we recommend directions for future research. [ABSTRACT FROM AUTHOR]

Behavior analysis has much to offer the study of phenomena in the area of judgement and decision making. We review several research areas that should continue to profit from a behavior-analytic approach, including the relative merit of contingency-based and rule-governed instruction of solving algebra and analogy problems, and the role of conditioned reinforcement and the inter-trial interval in a type of Prisoner's Dilemma Game. We focus on two additional areas: (1) the study of base-rate neglect, a notorious reasoning fallacy and (2) the study of the sunk-cost effect, which characterizes M-conceived investment decisions. In each of these two cases we review studies with humans and pigeons as subjects. (C) 2004 Elsevier B.V. All rights reserved.

In substance use disorders, drug use as unconditioned stimulus (US) reinforces drug taking. Meanwhile, drug-associated cues (conditioned stimulus [CS]) also gain incentive salience to promote drug seeking. The basolateral amygdala (BLA) is implicated in both US- and CS-mediated responses. Here, we show that two genetically distinct BLA neuronal types, expressing Rspo2 versus Ppp1r1b, respectively, project to the nucleus accumbens (NAc) and form monosynaptic connections with both dopamine D1 and D2 receptor-expressing neurons. While intra-NAc stimulation of Rspo2 or Ppp1r1b presynaptic terminals establishes intracranial self-stimulation (ICSS), only Ppp1r1b-stimulated mice exhibit cue-induced ICSS seeking. Furthermore, increasing versus decreasing the Ppp1r1b-to-NAc, but not Rspo2-to-NAc, subprojection increases versus decreases cue-induced cocaine seeking after cocaine withdrawal. Thus, while both BLA-to-NAc subprojections contribute to US-mediated responses, the Ppp1r1b subprojection selectively encodes CS-mediated reward and drug reinforcement. Such differential circuit representations may provide insights into precise understanding and manipulation of drug- versus cue-induced drug seeking and relapse., Competing Interests: YH, YH, OS, YD No competing interests declared, (© 2023, He et al.)

We report two experiments on the emission of questions to request the names of unfamiliar stimuli by preschoolers. In the first experiment, 19 preschoolers with and without disabilities served as participants. Experiment 1 was a descriptive analysis of whether or not the 19 participants asked questions about unfamiliar pictures and objects in one-to-one and group settings. These were dependent variables in the second experiment as well. Four participants, who did not ask any questions in the first experiment, served as participants in the second experiment. During the intervention, the participants observed the peer confederates (1) ask questions (e.g., “What is that?”), (2) receive information from the experimenter, and (3) receive praise and tokens contingent on asking a question. A multiple probe design across participants was used. The data showed that the participants increased the number of questions when we returned to baseline conditions. Results are discussed in terms of where the reinforcement exists for asking questions about unfamiliar things in one’s environment, and whether this truly measures the “need to know”.

Under fixed‐ratio schedules, transitions from more to less favorable conditions of reinforcement (rich‐to‐lean transitions) usually generate extended pausing. One possible explanation for this effect is that stimuli associated with rich‐to‐lean transitions are aversive and, thus, extended pausing functions as escape. The purpose of this study was to characterize further the aversive function of different transitions, and the stimuli associated with them, by allowing pigeons to choose to complete select ratios in the presence of either a mixed‐schedule stimulus or a transition‐specific multiple‐schedule stimulus. The mixed schedule was preferred during transitions that signaled an upcoming lean reinforcer (rich‐to‐lean and lean‐to‐lean), whereas the multiple schedule was preferred during transitions that signaled an upcoming rich reinforcer (lean‐to‐rich and rich‐to‐rich). These findings support the notion that stimuli associated with rich‐to‐lean (and to some extent lean‐to‐lean) transitions can function aversively; whereas stimuli associated with other transitions (e.g., lean‐to‐rich and rich‐to‐rich) can function as conditioned reinforcers. When the opportunity to choose between schedule‐correlated stimuli was available, however, choice latency was controlled exclusively by the multiple‐schedule stimulus. That is, the opportunity to select the mixed schedule did not attenuate rich‐to‐lean pauses, suggesting that extended pausing may be more than simply escape. [ABSTRACT FROM AUTHOR]

Prével and colleagues reported excitatory learning with a backward conditioned stimulus (CS) in a conditioned reinforcement preparation. Their results add to existing evidence of backward CSs sometimes being excitatory and were viewed as challenging the view that learning is driven by prediction error reduction, which assumes that only predictive (i.e., forward) relationships are learned. The results instead were consistent with the assumptions of both Miller's Temporal Coding Hypothesis and Wagner's Sometimes Opponent Processes (SOP) model. The present experiment extended the conditioned reinforcement preparation developed by Prével et al. to a backward second-order conditioning preparation, with the aim of discriminating between these two accounts. We tested whether a second-order CS can serve as an effective conditioned reinforcer, even when the first-order CS with which it was paired is a backward CS that elicits no responding. Evidence of conditioned reinforcement was found, despite no conditioned response (CR) being elicited by the first-order backward CS. The evidence of second-order conditioning in the absence of excitatory conditioning to the first-order CS is interpreted as a challenge to SOP. In contrast, the present results are consistent with the Temporal Coding Hypothesis and constitute a conceptual replication in humans of previous reports of excitatory second-order conditioning in rodents with a backward CS. The proposal is made that learning is driven by "discrepancy" with prior experience as opposed to " prediction error." [ABSTRACT FROM AUTHOR]

Abstract Midbrain dopamine (DA) neurons play a crucial role in the formation of conditioned associations between environmental cues and appetitive events. Activation of N-methyl- d -aspartate (NMDA) receptors is a key mechanism responsible for the generation of conditioned responses of DA neurons to reward cues. Here, we tested the effects of the cell type-specific inactivation of NMDA receptors in DA neurons in adult mice on stimulus-reward learning. Animals were trained in a Pavlovian learning paradigm in which they had to learn the predictive value of two conditioned stimuli, one of which (CS+) was paired with the delivery of a water reward. Over the course of conditioning, mutant mice learned that the CS+ predicted reward availability, and they approached the reward receptacle more frequently during CS+ trials than CS- trials. However, conditioned responses to the CS+ were weaker in the mutant mice, possibly indicating that they did not attribute incentive salience to the CS+. To further assess whether the attribution of incentive salience was impaired by the mutation, animals were tested in a conditioned reinforcement test. The test revealed that mutant mice made fewer instrumental responses paired with CS+ presentation, confirming that the CS+ had a weaker incentive value. Taken together, these results indicate that reward prediction learning does occur in the absence of NMDA receptors in DA neurons, but the ability of reward-paired cues to invigorate and reinforce behavior is attenuated. [ABSTRACT FROM AUTHOR]

Highlights • Rats were evaluated in the amount-version of the suboptimal choice procedure. • Contrary to pigeons' performance in this procedure, most of the rats behaved optimally. • Rats adequately discriminated the differential function of the stimuli. • We suggest the integration of this procedure with others evaluating gambling-like behavior. Abstract Among the different procedures that model gambling behavior in non-human animals, the "suboptimal choice procedure" has been extensively employed for analyzing the impact of environmental cues on choice behavior. It has been repeatedly demonstrated that pigeons prefer an alternative that infrequently presents a stimulus that signals a larger amount of reinforcement, than another alternative that always presents a stimulus associated with a smaller amount of reinforcement, even though the net rate of reinforcement is lower in the former. In the present study, we tested rats in the magnitude version of the suboptimal choice procedure. Eight rats were given a choice between two alternatives: a) one in which a stimulus predicting the delivery of ten pellets was presented with probability (p) = 0.2 and a stimulus predicting zero pellets was presented with p = 0.8, and b) one in which either of two stimuli predicted the delivery of three pellets with p = 1.0. Contrary to the consistent and robust suboptimal behavior of pigeons, rats preferred the optimal alternative. This effect occurred despite the high index of discrimination of the stimuli associated with the different outcomes shown by the rats. The relevance of this result to the development of animal models of gambling behavior is discussed. [ABSTRACT FROM AUTHOR]

We combined several single‐subject designs to assess the effects of contingent and noncontingent token reinforcement on moderate‐to‐vigorous physical activity (MVPA) exhibited by 4 preschool‐aged children. Higher overall levels and longer bouts of MVPA reliably occurred when tokens were delivered contingent on MVPA for 3 of the 4 children when compared to baseline (no token) and for 2 of the 4 children when compared to noncontingent‐token conditions. The present study demonstrated that the delivery of tokens contingent on MVPA can increase and maintain MVPA exhibited by preschool‐aged children, resulting in more MVPA than in baseline conditions and conditions in which tokens are awarded without respect to MVPA. These results demonstrate that token economies can be used to increase MVPA and they add to the evidence base supporting the use of token economies to address a range of behavior problems. [ABSTRACT FROM AUTHOR]

Basic research shows that token‐production and exchange‐production schedules in token economies affect each other as second‐order schedules (i.e., the exchange‐production schedule's requirements affect responding toward the token‐production schedule). This relationship has not been investigated with children in academic settings despite the widespread use of token economies in this context. This study compared the effects of fixed‐ratio (FR) and variable‐ratio (VR) exchange‐production schedules of equal ratios (2, 5, and 10) on responding toward an FR 1 token‐production schedule with a child diagnosed with autism. A concurrent chains assessment was also conducted to assess the participant's relative preference for FR and VR exchange‐production schedule arrangements within her typical discrete trial training. Results showed no difference in response rate between the two schedule types. However, the concurrent chains assessment revealed an exclusive preference for the VR arrangement. [ABSTRACT FROM AUTHOR]

Rats trained to perform a version of the rat gambling task (rGT) in which salient audiovisual cues accompany reward delivery, similar to commercial gambling products, show greater preference for risky options. Given previous demonstrations that probabilistic reinforcement schedules can enhance psychostimulant-induced increases in accumbal DA and locomotor activity, we theorized that performing this cued task could perpetuate a proaddiction phenotype. Significantly more rats developed a preference for the risky options in the cued versus uncued rGT at baseline, and this bias was further exacerbated by cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. The addition of reward-paired cues therefore increased the proportion of rats exhibiting a maladaptive cognitive response to cocaine self-administration. Risky choice was not associated with responding for conditioned reinforcement or a marker of goal/sign-tracking, suggesting that reward-concurrent cues precipitate maladaptive choice via a unique mechanism unrelated to simple approach toward, or responding for, conditioned stimuli. Although "protected" from any resulting decision-making impairment, optimal decision-makers trained on the cued rGT nevertheless self-administered more cocaine than those trained on the uncued task. Collectively, these data suggest that repeated engagement with heavily cued probabilistic reward schedules can drive addiction vulnerability through multiple behavioral mechanisms. Rats trained on the cued rGT also exhibited blunted locomotor sensitization and lower basal accumbal DA levels, yet greater cocaine-induced increases in accumbal DA efflux. Gambling in the presence of salient cues may therefore result in an adaptive downregulation of the mesolimbic DA system, rendering individuals more sensitive to the deleterious effects of taking cocaine. [ABSTRACT FROM AUTHOR]