Search

The current study examined 98 participants' preferences for five pictorial stimuli. The researchers used a verbal multiple‐stimulus‐without‐replacement (VMSWO) preference assessment with each participant to identify high‐preference and low‐preference pictorial stimuli. Next, participants viewed each pictorial stimulus in a randomized order on a computer while using a hand dynamometer that measured the amount of force they exerted to increase or maintain the visual clarity of each image. The results indicate that over 75% of participants' force response ranks corresponded with participants' VMSWO high‐preference stimuli, VMSWO low‐preference stimuli, or both. The results of the current study provide further evidence for the use of conjugate schedules in the assessment of stimulus preference with potential for use as a reinforcer assessment. Implications along with directions for future research and limitations of the findings are discussed. [ABSTRACT FROM AUTHOR]

Behavioral momentum theory (BMT) provides a theoretical and methodological framework for understanding how differentially maintained operant responding resists disruption. A common way to test operant resistance involves contingencies with suppressive effects, such as extinction or prefeeding. Other contingencies with known suppressive effects, such as response‐cost procedures arranged as point‐loss or increases in response force, remain untested as disruptive events within the BMT framework. In the present set of three experiments, responding of humans was maintained by point accumulation programmed according to a multiple variable‐interval (VI) VI schedule with different reinforcement rates in either of two components. Subsequently, subtracting a point following each response (Experiment 1) or increasing the force required for the response to be registered (Experiments 2 and 3 decreased response rates, but responding was less disrupted in the component associated with the higher reinforcement rate. The point‐loss contingency and increased response force similarly affected response rates by suppressing responding and human persistence, replicating previous findings with humans and nonhuman animals when other types of disruptive events (e.g., extinction and prefeeding) were investigated. The present findings moreover extend the generality of the effects of reinforcement rate on persistence, and thus BMT, extending the analysis of resistance to two well‐known manipulations used to reduce responding in the experimental analysis of behavior. [ABSTRACT FROM AUTHOR]

Serial reversal-learning procedures are simple preparations that allow for a better understanding of how animals learn about environmental changes, including flexibly shifting responding to adapt to changing reinforcement contingencies. The present study examined serial reversal learning with humans by arranging both midsession and variable contingency reversals across two experiments. We also examined the effects of extinction by adding nonreinforced trials at the end of later sessions and provided the first evaluation of effects of win-stay/lose-shift versus counting strategies on accuracy and response latency of humans' reversal-learning performance. In each experiment, responding tracked contingency reversals, primarily with participants using either win-stay/lose-shift or counting strategies. Introducing variable reversal points in the second experiment resulted in near-exclusive win-stay/lose-shift responding among participants and eliminated counting of trials. Each experiment also revealed an immediate shift from S2 to S1 after experiencing extinction during the initial test trial, indicating resurgence of the initial response through a win-stay/lose-shift response pattern. Therefore, the present study replicates and extends prior findings of a win-stay/lose shift response pattern in situations of greater uncertainty. These findings suggest that differences in environmental certainty induce qualitatively different decision-making strategies. [ABSTRACT FROM AUTHOR]

Copyright of Mexican Journal of Behavioral Analysis / Revista Mexicana de Análisis de la Conducta is the property of Sociedad Mexicana de Analisis de la Conducta and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

A multistage model of drug addiction in which individuals' motivations for use change as they develop problems is widely accepted; however, the evidence for this model comes mostly from animal work and cross-sectional studies. We used longitudinal data to test whether positive and negative reinforcement associated with alcohol consumption differed as a function of alcohol dependence (AD). Specifically, we tested whether (a) positive reinforcement is more strongly associated with alcohol consumption than is negative reinforcement among individuals without AD, (b) negative reinforcement is more strongly associated with AD than is positive reinforcement, and (c) in the presence of AD, the association between positive reinforcement and alcohol consumption becomes weaker, whereas the association with negative reinforcement becomes stronger. We included assessments between Ages 18 and 30 years from participants who indicated they ever had a drink (N = 2,556; 51.6% female) from the Collaborative Study on the Genetics of Alcoholism Prospective Study. Results from generalized estimating equations indicated that positive, but not negative, reinforcement was associated with alcohol consumption among individuals without AD. Both positive and negative reinforcement were associated with AD, but the association was stronger with negative reinforcement. Results from the multilevel growth model indicated that the association between negative reinforcement and alcohol consumption became stronger with the presence of AD, whereas the association between positive reinforcement and alcohol consumption did not differ as a function of AD. We provide empirical evidence that positive and negative reinforcement are differentially associated with alcohol consumption as a function of AD. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Evidence increasingly suggests that neural structures that respond to primary and secondary rewards are also implicated in the processing of social rewards. The 'Like'-a popular feature on social media-shares features with both monetary and social rewards as a means of feedback that shapes reinforcement learning. Despite the ubiquity of the Like, little is known about the neural correlates of providing this feedback to others. In this study, we mapped the neural correlates of providing Likes to others on social media. Fifty-eight adolescents and young adults completed a task in the MRI scanner designed to mimic the social photo-sharing app Instagram. We examined neural responses when participants provided positive feedback to others. The experience of providing Likes to others on social media related to activation in brain circuity implicated in reward, including the striatum and ventral tegmental area, regions also implicated in the experience of receiving Likes from others. Providing Likes was also associated with activation in brain regions involved in salience processing and executive function. We discuss the implications of these findings for our understanding of the neural processing of social rewards, as well as the neural processes underlying social media use.

The present study investigated the effects of variability requirements on learning difficult target sequences in humans. Twenty university students emitted five‐response sequences. For the experimental groups, 30 nontarget sequences were reinforced according to the Lag‐10 variation criterion or the Lag‐3 repetition criterion across conditions. For the control groups, the probability of reinforcers for nontarget sequences was yoked to that obtained by the experimental groups. In addition, for both groups, two difficult target sequences were continuously reinforced. U values were higher with the Lag‐10 variation criterion than with the Lag‐3 repetition criterion for the experimental groups and were unsystematic for the control groups. Higher U values ​​were accompanied by a random pattern in the emission of nontarget sequences for all groups. Higher levels of variability, regardless of whether they were directly produced by reinforcement or were contingency induced, facilitated learning of difficult target sequences. [ABSTRACT FROM AUTHOR]

The Iowa Gambling Task (IGT) is one of the most popular experimental paradigms for comparing complex decision-making across groups. Most commonly, IGT behavior is analyzed using frequentist tests to compare performance across groups, and to compare inferred parameters of cognitive models developed for the IGT. Here, we present a Bayesian alternative based on Bayesian repeated-measures ANOVA for comparing performance, and a suite of three complementary model-based methods for assessing the cognitive processes underlying IGT performance. The three model-based methods involve Bayesian hierarchical parameter estimation, Bayes factor model comparison, and Bayesian latent-mixture modeling. We illustrate these Bayesian methods by applying them to test the extent to which differences in intuitive versus deliberate decision style are associated with differences in IGT performance. The results show that intuitive and deliberate decision-makers behave similarly on the IGT, and the modeling analyses consistently suggest that both groups of decision-makers rely on similar cognitive processes. Our results challenge the notion that individual differences in intuitive and deliberate decision styles have a broad impact on decision-making. They also highlight the advantages of Bayesian methods, especially their ability to quantify evidence in favor of the null hypothesis, and that they allow model-based analyses to incorporate hierarchical and latent-mixture structures.

A functional analysis of prosociality considers how predispositions for prosocial behavior prompt, reinforce, and propagate kind behaviors in the real world. To examine the effects of practicing, receiving, and observing everyday prosociality-as well as the mechanisms underlying these effects-we randomly assigned employees in a Spanish corporate workplace (N = 111) to be Givers, Receivers, and Controls. Givers practiced 5 acts of kindness for a personalized list of Receivers over 4 weeks. We found that Givers and Receivers mutually benefited in well-being in both the short-term (e.g., on weekly measures of competence and autonomy) and the long-term (e.g., Receivers became happier after 2 months, and Givers became less depressed and more satisfied with their lives and jobs). In addition, Givers' prosocial acts inspired others to act: Receivers paid their acts of kindness forward with 278% more prosocial behaviors than Controls. Our results reveal that practicing everyday prosociality is both emotionally reinforcing and contagious (inspiring kindness and generating hedonic rewards in others) and that receiving everyday prosociality is an unequivocally positive experience (which may further reinforce Givers' actions). Prosociality's benefits shed light on its surprising ubiquity in humanity compared with our closest evolutionary cousins. (PsycINFO Database Record

Drug use is a choice with immediate positive outcomes, but long-term negative consequences. Thus, the repeated use of drugs in the face of negative consequences suggests dysfunction in the cognitive mechanisms underpinning decision-making. This cognitive dysfunction can be mapped into three stages: the formation of preferences involving valuation of decision options; choice implementation including motivation, self-regulation and inhibitory processes; and feedback processing implicating reinforcement learning. This article reviews behavioral studies that have examined alterations in these three stages of decision-making in people with substance use disorders. Relative to healthy individuals, those with alcohol, cannabis, stimulant and opioid use disorders value risky options more highly during the formation of preferences; have a greater appetite for superficially attractive rewards during choice implementation; and are both more efficient in learning from rewards and less efficient in learning from losses during feedback processing. These observed decision-making deficits are most likely due to both premorbid factors and drug-induced effects. Because decision-making deficits have been prospectively associated with a greater risk of drug relapse, we advocate for greater research on modulating the component stages that give rise to dysfunctional decision-making in disorders of addiction.

Copyright of Mexican Journal of Behavioral Analysis / Revista Mexicana de Análisis de la Conducta is the property of Sociedad Mexicana de Analisis de la Conducta and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

How does experience inform decisions? In episodic sampling, decisions are guided by a few episodic memories of past choices. This process can yield choice patterns similar to model-free reinforcement learning; however, samples can vary from trial to trial, causing decisions to vary. Here we show that context retrieved during episodic sampling can cause choice behavior to deviate sharply from the predictions of reinforcement learning. Specifically, we show that, when a given memory is sampled, choices (in the present) are influenced by the properties of other decisions made in the same context as the sampled event. This effect is mediated by fMRI measures of context retrieval on each trial, suggesting a mechanism whereby cues trigger retrieval of context, which then triggers retrieval of other decisions from that context. This result establishes a new avenue by which experience can guide choice and, as such, has broad implications for the study of decisions.

Social support is associated with positive health outcomes, and research has demonstrated that the presence, or even just a reminder, of a social-support figure can reduce psychological and physiological responses to threats. However, the mechanisms underlying this effect are unclear, and no previous work has examined the impact of social support on basic fear learning processes, which have implications for threat responding. This study examined whether social support inhibits the formation of fear associations. After conducting a fear-conditioning procedure in which social-support stimuli were paired with conditional stimuli during fear acquisition, we found that the threat of shock was not associated with conditional stimuli paired with images of social-support figures, but was associated with stimuli paired with images of strangers. These findings indicate that social support prevents the formation of fear associations, reducing the amount of learned fears people acquire as they navigate the world, consequently reducing threat-related stress.

Adolescents are notorious for engaging in reward-seeking behaviors, a tendency attributed to heightened activity in the brain's reward systems during adolescence. It has been suggested that reward sensitivity in adolescence might be adaptive, but evidence of an adaptive role has been scarce. Using a probabilistic reinforcement learning task combined with reinforcement learning models and fMRI, we found that adolescents showed better reinforcement learning and a stronger link between reinforcement learning and episodic memory for rewarding outcomes. This behavioral benefit was related to heightened prediction error-related BOLD activity in the hippocampus and to stronger functional connectivity between the hippocampus and the striatum at the time of reinforcement. These findings reveal an important role for the hippocampus in reinforcement learning in adolescence and suggest that reward sensitivity in adolescence is related to adaptive differences in how adolescents learn from experience.

Obese individuals develop heightened reactivity to environmental cues associated with hedonic foods through Pavlovian conditioning. This study examined differences between overweight (n = 16) and lean (n = 17) 18-26 year-olds in their acquisition of a swallowing response to visual cues paired with chocolate milk, tasteless water and no taste stimulus. We hypothesized that, compared to lean participants, overweight participants would demonstrate a heightened conditioned swallowing response to the visual cue paired with chocolate milk as well as a resistance to extinction of this response. Results showed that overweight participants swallowed more in response to the visual cue previously paired with chocolate than the cue previously paired with tasteless water (t(15) = -3.057, p = .008) while lean participants showed no cue discrimination (t(16) = -1.027, p = .320). The results evaluating the extinction hypothesis could not be evaluated, as the lean participants did not acquire a conditioned response. In evaluating the conditioned swallow response of overweight participants only, results indicated that there was not a significant decrease in swallowing to cues paired with chocolate milk or water, but overall, overweight participants swallowed more to cues paired with chocolate than cues paired with water. These are the first results to show differential acquisition of Pavlovian conditioned responding in overweight individuals compared to lean individuals, as well as differential conditioning to cues paired with hedonic food stimuli compared to cues paired with neutral stimuli.

Several hypotheses about influences on college drinking derived from the social learning theory of deviance were tested and confirmed. The effect of ethnicity on alcohol use was completely mediated by differential association and differential reinforcement, whereas the effect of biological sex on alcohol use was partially mediated. Higher net positive reinforcements to costs for alcohol use predicted increased general use, more underage use, and more frequent binge drinking. Two unexpected finding were the negative relationship between negative expectations and negative experiences, and the substantive difference between nondrinkers and general drinkers compared with illegal or binge drinkers. The discussion considers implications for future campaigns based on Akers's deterrence theory.

Opioids are the most potent analgesics in clinical use; however, their powerful rewarding properties can lead to addiction. The scientific challenge is to retain analgesic potency while limiting the development of tolerance, dependence, and addiction. Both rewarding and analgesic actions of opioids depend upon actions at the mu opioid (MOP) receptor. Systemic opioid reward requires MOP receptor function in the midbrain ventral tegmental area (VTA) which contains dopaminergic neurons. VTA dopaminergic neurons are implicated in various aspects of reward including reward prediction error, working memory, and incentive salience. It is now clear that subsets of VTA neurons have different pharmacological properties and participate in separate circuits. The degree to which MOP receptor agonists act on different VTA circuits depends upon the behavioral state of the animal, which can be altered by manipulations such as food deprivation or prior exposure to MOP receptor agonists.

Pathologists and radiologists spend years acquiring and refining their medically essential visual skills, so it is of considerable interest to understand how this process actually unfolds and what image features and properties are critical for accurate diagnostic performance. Key insights into human behavioral tasks can often be obtained by using appropriate animal models. We report here that pigeons (Columba livia)-which share many visual system properties with humans-can serve as promising surrogate observers of medical images, a capability not previously documented. The birds proved to have a remarkable ability to distinguish benign from malignant human breast histopathology after training with differential food reinforcement; even more importantly, the pigeons were able to generalize what they had learned when confronted with novel image sets. The birds' histological accuracy, like that of humans, was modestly affected by the presence or absence of color as well as by degrees of image compression, but these impacts could be ameliorated with further training. Turning to radiology, the birds proved to be similarly capable of detecting cancer-relevant microcalcifications on mammogram images. However, when given a different (and for humans quite difficult) task-namely, classification of suspicious mammographic densities (masses)-the pigeons proved to be capable only of image memorization and were unable to successfully generalize when shown novel examples. The birds' successes and difficulties suggest that pigeons are well-suited to help us better understand human medical image perception, and may also prove useful in performance assessment and development of medical imaging hardware, image processing, and image analysis tools.

Only 20-40% of U.S. women conduct breast self-examination (BSE). This Southwest Oncology Group experimental study compared the impact of three interventions on BSE compliance.Subjects were randomly assigned to one of three arms: (1) physician message; (2) physician message and BSE class; or (3) physician message, BSE class, and reinforcement (phone and postcard). Compliance (frequency and accuracy) was measured by interview at intake and at 6 months and by phone contact at 1 year. Logistic and multiple regression were employed.This analysis included 2,233 subjects from six institutions. At 1 year the percentages of women doing BSE were 59, 62, and 78% for Arms 1-3, respectively; gains over intake frequency (27% average) were significant within each arm (P < or = 0.0001). At both 6 months and 1 year the differences between Arm 1 and Arm 2 average accuracy scores and the differences between Arm 2 and Arm 3 in the percentage of women doing BSE were significant (P < or = 0.0001). Findings within institutions were consistent with the overall findings.The addition of a BSE class increased accuracy over physician message alone; physician message, BSE class, and reinforcement gave the highest percentage of women doing BSE.

Cocaine-dependent individuals show altered brain activation during decision making. It is unclear, however, whether these activation differences are related to relapse vulnerability. This study tested the hypothesis that brain-activation patterns during reinforcement learning are linked to relapse 1 year later in individuals entering treatment for cocaine dependence. Subjects performed a Paper-Scissors-Rock task during functional magnetic resonance imaging (fMRI). A year later, we examined whether subjects had remained abstinent (n=15) or relapsed (n=15). Although the groups did not differ on demographic characteristics, behavioral performance, or lifetime substance use, abstinent patients reported greater motivation to win than relapsed patients. The fMRI results indicated that compared with abstinent individuals, relapsed users exhibited lower activation in (1) bilateral inferior frontal gyrus and striatum during decision making more generally; and (2) bilateral middle frontal gyrus and anterior insula during reward contingency learning in particular. Moreover, whereas abstinent patients exhibited greater left middle frontal and striatal activation to wins than losses, relapsed users did not demonstrate modulation in these regions as a function of outcome valence. Thus, individuals at high risk for relapse relative to those who are able to abstain allocate fewer neural resources to action-outcome contingency formation and decision making, as well as having less motivation to win on a laboratory-based task.

During a smoking quit attempt, a single smoking lapse is highly predictive of future relapse. While several risk factors for a smoking lapse have been identified during clinical trials, a laboratory model of lapse was until recently unavailable and, therefore, it is unclear whether these characteristics also convey risk for lapse in a laboratory environment.The primary study goal was to examine whether real-world risk factors of lapse are also predictive of smoking behavior in a laboratory model of smoking lapse.After overnight abstinence, 77 smokers completed the McKee smoking lapse task, in which they were presented with the choice of smoking or delaying in exchange for monetary reinforcement. Primary outcome measures were the latency to initiate smoking behavior and the number of cigarettes smoked during the lapse. Several baseline measures of smoking behavior, mood, and individual traits were examined as predictive factors.Craving to relieve the discomfort of withdrawal, withdrawal severity, and tension level were negatively predictive of latency to smoke. In contrast, average number of cigarettes smoked per day, withdrawal severity, level of nicotine dependence, craving for the positive effects of smoking, and craving to relieve the discomfort of withdrawal were positively predictive of number of cigarettes smoked.The results suggest that real-world risk factors for smoking lapse are also predictive of smoking behavior in a laboratory model of lapse. Future studies using the McKee lapse task should account for between subject differences in the unique factors that independently predict each outcome measure.

The social vulnerabilities associated with young children with autism are recognized as important intervention targets due to their influence on subsequent development. Current research suggests that interventions that combine motivational and social components can create meaningful changes in social functioning. Simultaneously, it is hypothesized that parent delivery of such strategies can invoke increases in these core social behaviors and parent engagement. This study examined the effects of teaching parents to implement a social engagement intervention with their children. The results indicated that the use of this parent-delivered social intervention led to (a) increases in their children's use of eye contact, directed positive affect, and verbal initiations, (b) increases in parent positive affect and synchronous engagement, and (c) generalized increases in parent and child behaviors.

In games of chance, a near miss is said to occur when feedback for a loss approximates a win. For instance, obtaining "cherry-cherry-lemon" on a slot machine could be considered a near miss. Sixty-six years ago, B.F. Skinner first proposed the idea that near-miss events might reinforce continued play in slot machines, and despite some inconsistencies in the experimental literature, belief in this "near-miss effect" has remained strong. In the present manuscript, we will review this literature and present experimental assessments of the near-miss effect on the frequency of the gambling response. Experiment 1 used a tightly controlled resistance-to-extinction procedure in pigeons to evaluate the putative reinforcing effect of near misses relative to a control "far-miss" reel pattern. Experiment 2 extended Experiment 1's procedure to human participants. The results of both experiments failed to support the near-miss effect hypothesis. Experiment 3 used a further simplified procedure to assess the validity of the resistance-to-extinction paradigm when a probable conditional reinforcer was present on the reel stimuli. Although a clear conditional response was obtained from the reel, subsequent testing in extinction revealed no conditionally reinforcing function of this stimulus on operant response frequency. [ABSTRACT FROM AUTHOR]

One prevalent theory of learning states that dopamine neurons signal mismatches between expected and actual outcomes, called temporal difference errors (TDEs). Evidence indicates that dopamine system dysfunction is involved in negative symptoms of schizophrenia (SZ), including avolition and anhedonia. As such, we predicted that brain responses to TDEs in dopamine midbrain nuclei and target areas would be abnormal in SZ. A total of 18 clinically stable patients with chronic SZ and 18 controls participated in an fMRI study, which used a passive conditioning task. In the task, the delivery of a small amount of juice followed a light stimulus by exactly 6 s on approximately 75% of 78 total trials, and was further delayed by 4-7 s on the remaining trials. The delayed juice delivery was designed to elicit the two types of TDE signals, associated with the recognition that a reward was omitted at the expected time, and delivered at an unexpected time. Main effects of TDE valence and group differences in the positive-negative TDE contrast (unexpected juice deliveries-juice omissions) were assessed through whole-brain and regions of interest (ROI) analyses. Main effects of TDE valence were observed for the entire sample in the midbrain, left putamen, left cerebellum, and primary gustatory cortex, bilaterally. Whole-brain analyses revealed group differences in the positive-negative TDE contrast in the right putamen and left precentral gyrus, whereas ROI analyses revealed additional group differences in the midbrain, insula, and parietal operculum, on the right, the putamen and cerebellum, on the left, and the frontal operculum, bilaterally. Further, these group differences were generally driven by attenuated responses in patients to positive TDEs (unexpected juice deliveries), whereas responses to negative TDEs (unexpected juice omissions) were largely intact. Patients also showed reductions in responses to juice deliveries on standard trials, and more blunted reinforcer responses in the left putamen corresponded to higher ratings of avolition. These results provide evidence that SZ patients show abnormal brain responses associated with the processing of a primary reinforcer, which may be a source of motivational deficits.

We propose a computational model of the emergence of gaze following skills in infant-caregiver interactions. The model is based on the idea that infants learn that monitoring their caregiver's direction of gaze allows them to predict the locations of interesting objects or events in their environment (Moore & Corkum, 1994). Elaborating on this theory, we demonstrate that a specific Basic Set of structures and mechanisms is sufficient for gaze following to emerge. This Basic Set includes the infant's perceptual skills and preferences, habituation and reward-driven learning, and a structured social environment featuring a caregiver who tends to look at things the infant will find interesting. We review evidence that all elements of the Basic Set are established well before the relevant gaze following skills emerge. We evaluate the model in a series of simulations and show that it can account for typical development. We also demonstrate that plausible alterations of model parameters, motivated by findings on two different developmental disorders - autism and Williams syndrome - produce delays or deficits in the emergence of gaze following. The model makes a number of testable predictions. In addition, it opens a new perspective for theorizing about cross-species differences in gaze following.

An experiment with humans was conducted to assess the relative effects of reinforcement and punishment on choice. Point gains and losses were programmed as reinforcers and punishers, respectively. Participants used a mouse to click two buttons on a computer screen while the ratio of point gains was varied according to a concurrent variable-interval schedule. Responding was sensitive to relative point gains in baselines. When a schedule of point loss was superimposed on one button, relative to baseline, bias away from the point-loss button was observed, indicating the punishment effects of losses. Finally, a schedule arranging equal rates of both point gains and losses was superimposed on one button. One participant showed no change in bias and two showed shifts in bias away from the alternative with the superimposed schedule relative to baseline. These results suggest that punishment effects are at least equal and sometimes greater than reinforcement effects.. [ABSTRACT FROM AUTHOR]

This study presents three experiments that aimed to show the formation of stimulus equivalence relations among stimuli that had been previously related only by exclusion. In Experiment 1, participants were trained on baseline conditional discriminations to establish two 3‐member equivalence classes. Then, they were exposed to exclusion trials, without feedback, in which undefined stimuli had to be matched by rejecting the defined baseline stimuli. Finally, participants responded to test trials evaluating the emergence of symmetry and transitivity among the undefined stimuli from the exclusion trials. For half of the participants, the stimuli related by exclusion were introduced as S‐ stimuli in the baseline trials, whereas for the other half they were not. Further, half of the participants were assessed for emergent relations with stimuli from all the classes, whereas the other half was assessed for emergent relations with only the stimuli related by exclusion. In Experiment 2, the S‐ comparisons in the emergent relations test trials with stimuli only related by exclusion were stimuli from a null class. In Experiment 3, the number of exclusion trials was doubled. Across experiments, most participants showed emergence of equivalence relations among the stimuli related by exclusion. Some conditions of stimulus control associated with exclusion learning and the emergence of equivalence relations are discussed. [ABSTRACT FROM AUTHOR]

The effects of reinforcement value and social control on instruction following under a negative-reinforcement (escape) schedule were studied. Initially, responding produced timeouts from pressing a force cell under a low and a high force requirement on a fixed-ratio 1 schedule of reinforcement. Next, participants were reexposed to the low and high force requirements, but were instructed that the experimenter expected them to decrease the number of timeouts relative to the previous exposures to the procedure. Even though following the instruction led to a decrease in number of timeouts and to an increase in effort (i.e., was non-efficient), instruction following occurred consistently for each participant and was modulated by reinforcement value. That is, the decrease in the number of timeouts (i.e., instruction following) was lower under the high force requirement than under the low force requirement. These results replicate and extend previous findings that instructions interact with social and nonsocial contingencies in controlling human behavior. [ABSTRACT FROM AUTHOR]

Previously reinforced responses can reappear when reinforcement is withdrawn from current responding. This is known as resurgence. Although resurgence of response topography, spacing, and patterns over time has been demonstrated, there is no evidence of resurgence of response duration. This experiment explored resurgence of response duration in humans. In Phase 1 a multiple schedule of reinforcement with two components was used. In each component a chained variable-interval 30 s, variable-ratio 3 schedule was implemented. In the terminal link of the chained schedule, response durations between 0.1 and 0.5 s were reinforced during one component, and between 2 and 8 s in the other component. In Phase 2, response requirement during the terminal link of the chained schedule was inverted between components relative to Phase 1. In Phase 3 the chained schedule was changed to a variable-interval 30-s, extinction 30 s. Resurgence of the durations trained during Phase 1 was observed. It was concluded that duration is a response dimension that reappears during extinction. [ABSTRACT FROM AUTHOR]

The effects of instructions on the sensitivity of negatively reinforced (escape) behavior to extinction were studied. Initially, responding produced timeouts from pressing a force cell on a variable-ratio (VR) schedule, which was then discontinued (extinction). Based on extinction data, participants were distributed into two groups. Participants in the Extinction Group (for which response rates were low in extinction) were instructed that the experimenter expected them to continue responding in extinction after a second exposure to the VR schedule. Participants in the Persistence group (for which response rates were high in extinction) were instructed that the experimenter expected them to stop responding in extinction. Relative to the condition in which instructions were absent, extinction-response rates increased and decreased, respectively, for participants in the Persistence and Extinction groups. These results replicate and extend to negatively reinforced responding previous findings that showed behavioral control by instructions formulated as explicit experimenter demands or expectations. [ABSTRACT FROM AUTHOR]

Basic research on delay discounting, examining preference for smaller-sooner or larger-later reinforcers, has demonstrated a variety of findings of considerable generality. One of these, the magnitude effect, is the observation that individuals tend to exhibit greater preference for the immediate with smaller magnitude reinforcers. Delay discounting has also proved to be a useful marker of addiction, as demonstrated by the highly replicated finding of greater discounting rates in substance users compared to controls. However, some research on delay discounting rates in substance users, particularly research examining discounting of small-magnitude reinforcers, has not found significant differences compared to controls. Here, we hypothesize that the magnitude effect could produce ceiling effects at small magnitudes, thus obscuring differences in delay discounting between groups. We examined differences in discounting between high-risk substance users and controls over a broad range of magnitudes of monetary amounts ($0.10, $1.00, $10.00, $100.00, and $1000.00) in 116 Amazon Mechanical Turk workers. We found no significant differences in discounting rates between users and controls at the smallest reinforcer magnitudes ($0.10 and $1.00) and further found that differences became more pronounced as magnitudes increased. These results provide an understanding of a second form of the magnitude effect: That is, differences in discounting between populations can become more evident as a function of reinforcer magnitude. [ABSTRACT FROM AUTHOR]

In the present study, excitatory backward conditioning was assessed in a conditioned reinforcement paradigm. The experiment was conducted with human subjects and consisted of five conditions. In all conditions, US reinforcing value (i.e. time reduction of a timer) was assessed in phase 1 using a concurrent FR schedule, with one response key leading to US presentation and the other key leading to no-US. In phase 2, two discrete stimuli, S+ and S−, were paired with US and no-US respectively using an operant contingency. For three groups, backward contingencies were arranged, and two of these were designed to rule out a trace (forward) conditioning interpretation of the results. The two other groups served as control conditions (forward and neutral conditions). Finally, in phase 3 for all groups the CSs were delivered in a concurrent FR schedule similar to phase 1, but with no US. Responding during phase 3 showed conditioned reinforcement effects and hence excitatory backward conditioning. Implications of the results for conditioned reinforcement models are discussed. [ABSTRACT FROM AUTHOR]

The relation between persistence, as measured by resistance to change, and resurgence has been examined with nonhuman animals but not systematically with humans. The present study examined persistence and resurgence with undergraduate students engaging in a computer task for points exchangeable for money. In Phase 1, a target response was maintained on a multiple variable-interval (VI) 15-s (Rich) VI 60-s (Lean) schedule of reinforcement. In Phase 2, the target response was extinguished while an alternative response was reinforced at equal rates in both schedule components. In Phase 3, the target and the alternative responses were extinguished. In an additional test of persistence (Phase 4), target responding was reestablished as in Phase 1 and then disrupted by access to videos in both schedule components. In Phases 2 and 4, target responding was more persistent in the Rich than in the Lean component. Also, resurgence generally was greater in the Rich than in the Lean component in Phase 3. The present findings with humans extend the generality of those obtained with nonhuman animals showing that higher reinforcement rates produce both greater persistence and resurgence, and suggest that common processes underlie response persistence and relapse. [ABSTRACT FROM AUTHOR]

The generalized matching equation provides a good description of response allocation in concurrent schedules of positive reinforcement in nonhumans as well as in humans. The present experiment was conducted to further investigate the allocation of responding under concurrent schedules of negative reinforcement (i.e., timeouts from pressing a force cell) in humans. Each of three participants was exposed to different reinforcement ratios (9:1, 1:1 and 1:9) in the terminal links of a concurrent-chains schedule of negative reinforcement. The allocation of responding under this schedule was well described by the generalized matching equation, for each participant. These results replicate previous findings obtained with nonhumans and humans under concurrent schedules of positive reinforcement. In addition, they extend the results reported by Alessandri and Rivière (2013) showing that human behavior maintained by timeouts from an effortful response is sensitive to changes in relative reinforcement ratios as well as relative delays of reinforcement. [ABSTRACT FROM AUTHOR]

The recurrence of negatively reinforced responding of humans was studied in three experiments. In each experiment during Baseline, key-pressing produced 3-s timeouts from a requirement to exert finger pressure on a force cell according to variable- or fixed-ratio schedules of reinforcement. In Experiment 1, resurgence was studied by arranging a differential-reinforcement-of-other-behavior schedule in the second phase, and extinction in the Test phase. In Experiment 2, ABA renewal was studied by extinguishing responding in the second phase in a different context and, in the Test phase, by presenting the Baseline-phase context when extinction still was in effect. In Experiment 3, reinstatement was studied by arranging extinction in the second phase, followed by the delivery of response-independent timeouts in the Test phase. Resurgence and renewal occurred consistently for each participant in Experiments 1 and 2, respectively. In Experiment 3, reinstatement was observed less consistently in four participants. The results of these experiments replicate and extend to negatively reinforced responding previous findings of the resurgence and renewal of positively reinforced responding obtained mainly with nonhuman animals. [ABSTRACT FROM AUTHOR]

The present study investigated whether simple discrimination procedures produce emergent relations that are consistent with functional and equivalence classes. In Experiment 1, 4 normally capable adults were exposed to simple successive discrimination reversal training. Responses to the S (A1, B1, and C1) but not S (A2, B2, and C2) were reinforced. The participants were then exposed to repeated-reversal training, followed by tests of emergent equivalence relations. In Experiment 2, 4 additional adults were exposed to a simple successive discrimination training procedure using differential responses. Response 1 (R1) was reinforced only when emitted in the presence of A1, B1, or C1 (A1-R1, B1-R1, or C1-R1). Response 2 (R2) was reinforced only in the presence of A2, B2, or C2 (A2-R2, B2-R2, or C2-R2). A new response was then trained in the presence of 1 member of each class (A1-R3, A2-R4). A transfer-of-function test was then conducted to verify whether the new responses would be emitted in the presence of B1, B2, C1, and C2. In both experiments, emergent conditional relations were tested using a go/no-go procedure with compound stimuli. In Experiment 1, all of the participants showed functional classes, and 3 showed patterns that are consistent with the formation of equivalence classes. In Experiment 2, all 4 participants showed patterns that are consistent with functional and equivalence class formation. In these experiments, simple discrimination training generated a range of emergent stimulus relations that mirrored those that are indicative of equivalence class formation. [ABSTRACT FROM AUTHOR]

The present experiment demonstrated a procedure analyzing the behavior of controllers by measuring undergraduates' responses that produced consequences to other undergraduates. One member of each pair of 42 undergraduates, referred to as a learner, was asked to earn points exchangeable for money and told that touching a square shown on the screen of the display monitor may or may not change points. Unlike standard operant experiments, the point change was not determined by any computer program but by responses of another experimentally naïve undergraduate, referred to as an instructor. Response rates for 15 of 21 learners were higher than those for their yoked partners, who got and lost points independent of their responding. For 17 of 21 instructors, responses to an alternative (S key) that produced points to the learners were more than responses to another alternative (S key) that resulted in the learners' point loss. Each of 16 instructors pressed the S key more frequently after the learner responded than after the instructor pressed the S or S key. The mean interval between the learner's response and the instructor's S response was shorter than 1 s for each of 14 pairs of instructors and learners. Consistent with the behavioral principle of positive reinforcement, these results suggest that the instructors generally provided positive reinforcers depending on and immediately following the learners' responses. [ABSTRACT FROM AUTHOR]

Traditionally, near-miss events in games of skill provide feedback to an individual regarding his or her performance. However, in games of chance, like slot machine gambling, the use fails to carry over. A near miss in slot machine gambling may still be endorsed when most of the symbols falling on a payline match, though technically this arrangement provides no real measure of skill or progress. To date, attempts to study the near miss in slot machine gambling have used resistance to extinction and preference assessment preparations, both of which unsuccessfully capture any putative reinforcement properties. The current investigation introduces a new methodology to assess putative conditioned reinforcement properties of stimuli correlated with the near miss in simulated slot machine gambling by incorporating the observing response with concurrently available schedules, termed simultaneous observing. Successful tests of the methodology regarding schedule-correlated stimuli in relation to win rates demonstrate its potential use, and failure to identify a near-miss event as producing reinforcing effects for schedule-correlated stimuli adds credibility to its ability to discriminate between functions. [ABSTRACT FROM AUTHOR]

The present study assessed derived conditional relations using a within-subject sequence of training and testing with reinforcement. In Experiment 1, four undergraduates were trained on two independent arbitrary-matching tasks (A-B and C-D). Next, they were given reinforced symmetry trials for half of the baseline stimuli (B-A and D-C). To show that accuracy on symmetry trials was not a result of rapid learning due to reinforcement; novel relations were reinforced among the remaining baseline stimuli (B-C and D-A), as an experimental control. All participants acquired symmetrical relations faster than the novel, control relations. Experiment 2 assessed transitivity using a similar testing strategy. All but one participant acquired transitive relations faster than the novel, control relations. These results conform to those arising from traditional unreinforced tests and suggest the potential of the proposed strategy to study populations in which the emergence of conditional relations seems to be negatively affected by the suspension of reinforcement during tests. [ABSTRACT FROM AUTHOR]

Resurgence occurs when a previously reinforced and then extinguished target response increases due to a worsening of reinforcement conditions for an alternative response. We conducted four crowdsourcing experiments to evaluate effects of alternative-reinforcer rate and magnitude on resurgence with humans. Contingent on an alternative response, we manipulated across groups either the rate of point delivery (Experiment 1) or number of points delivered per reinforcer (Experiments 2–3). Experiment 4 arranged combinations of high- or low-rate and high- or low-magnitude alternative reinforcement across four groups. When extinguishing alternative responding across experiments, we observed resurgence of target responding with relatively high rates of alternative reinforcement but differences in reinforcer magnitude did not influence resurgence. A quantitative model based on the concatenated matching law, Resurgence as Choice in Context (RaC2), provided a poor fit to the data, generally underpredicted target responding, and could not account for data from control groups experiencing extinction of target responding in the absence of alternative reinforcement. We then fit a modified version of RaC2 borrowing an assumption from theories of choice that suggest some proportion of reinforcers are misallocated between responses – this modified version of RaC2 provided a better account of these findings. • Examined effects of reinforcer rate and magnitude on resurgence through crowdsourcing. • In four experiments, greater reinforcer rates but not magnitudes increased resurgence. • We fit a quantitative model based on matching, Resurgence as Choice in Context (RaC2). • RaC2 fits improved when assuming reinforcers are misallocated between responses. • Misallocation also allowed RaC2 to be fit for the first time to simple extinction data. [ABSTRACT FROM AUTHOR]

Two experiments were conducted to assess stimulus control and generalization of remote behavioral history effects with humans. Undergraduates first responded frequently under a fixed-ratio (FR) schedule in the presence of one line length (16 mm or 31 mm) and infrequently on a tandem FR 1 differential-reinforcement-of-low-rate (DRL) schedule when a second line length (31 mm or 16 mm) was present. Next, an FR 1 schedule in effect in the presence of either stimulus produced comparable response rates between the stimuli. Finally, a tandem FR 1 fixed-interval (FI) schedule was in effect under those same stimuli (Experiment 1) or under 12 line lengths ranging from 7 to 40 mm (Experiment 2). In both experiments, responses under the tandem FR 1 FI schedule were frequent in the presence of stimuli previously correlated with the FR schedule and infrequent in the presence of stimuli previously correlated with the tandem FR 1 DRL schedule. Short-lived but systematic generalization gradients were obtained in Experiment 2. These results show that previously established rates of behavior that disappear when the establishing contingencies are changed can subsequently not only reappear when the contingencies change, but are controlled by and generalize across antecedent stimuli. [ABSTRACT FROM AUTHOR]

Highlights: [•] Participants played a Paper Scissors Rock game against a computer or a fictitious human opponent. [•] Sensitivity to the relative reinforcer rate was higher for those in the “computer” condition than the “player” condition. [•] Perceived opponent type can alter the effect of reinforcer contingencies on human choice behaviour. [•] The generalised matching law was a good descriptor of three-alternative human choice behaviour. [Copyright &y& Elsevier]

Highlights: [•] A new procedure to study human operant conditioning is described using a rest force period as reinforcer when high force was required. [•] Experiment 1 reports evidence that the rest force period acts as a reinforcer. [•] Experiment 2 demonstrates sensitivity to delay as a parameter of choice in a self-control paradigm. [•] The results of the two experiments indicate a functional similarity between primary reinforcers used in non-human subjects and the present reinforcer. [•] So this procedure is well-suited to study operant conditioning in humans. [Copyright &y& Elsevier]

This study aimed to assess the role of reinforced behavioral variability in the learning of a 6-digit target sequence (211212) with 3 groups of human participants (n = 39). For the first group (Control), only the target sequence was reinforced. For the second group (Any), the target sequence was reinforced, and any sequence other than the target sequence could be reinforced on a variable interval 60-s schedule. For the third group (Variable), the target sequence was reinforced, and any sequence other than the target sequence could be reinforced on a variable interval 60-s schedule, if it met a variability criterion. The Control group produced the target sequence significantly more often than the Variable group by the end of the experimental sessions. These findings contradict previous studies with rats that have shown that reinforcement of behavioral variability facilitates the learning of difficult response sequences but are consistent with results from previous studies with humans. Potential reasons for this disparity are discussed. [ABSTRACT FROM AUTHOR]

A matching procedure was used to examine whether humans discriminate fixed- interval (FI) schedules. Fixed- ratio (FR), FI, or differential- reinforcement-of-low-rate (DRL) schedules were in effect during a sample schedule link. Responses meeting the schedule requirement produced a choice link in which each of three circles was presented with a unique color. The choice was reinforced depending on the schedule of the sample link. In Experiment 1, a correct response equal to or higher than 94.4% was obtained for each sample schedule in each of the four undergraduates. Post hoc analyses suggested that time spent with the sample schedule link may have functioned as a discriminative stimulus of the choices. In Experiment 2, after replicating the schedule discrimination with additional four participants, the FI value was changed to equate to the mean time spent in the FR or DRL schedule link. With this modified FI value, the accuracy was deteriorated but eventually recovered, whereas the lengths of time spent in the sample schedule links diverged across the schedules. Previous studies have shown that humans were insensitive to reinforcement schedules, especially to the FI schedule. These results demonstrate that humans discriminated the FI schedule and suggest that human schedule insensitivity is due to other than discriminative properties of the schedules. [ABSTRACT FROM AUTHOR]

The present study investigated the effects of punishing responses inconsistent with rules on instructional control during a choice task. In a procedure modeled after Hackenberg and Joker (1994), 7 adults were presented with repeated choices between progressive- and fixed-time schedules of reinforcement and were given instructions (rules) for how to respond to maximize earnings. Across sessions, the progressive-time schedule step size was manipulated so that the instructions became increasingly inaccurate, and deviating from the instructions produced greater earnings. The experiment consisted of two phases, Penalty and No Penalty. During the Penalty phase, deviating from the instructions produced a money-loss penalty (response-cost punishment). Two participants showed persistent instructional control and therefore completed only one phase (Penalty or No Penalty), and 1 participant showed little instructional control during the Penalty phase until the punishment magnitude was increased. In all 4 participants who experienced both Penalty and No Penalty phases, punishment increased the consistency of choices with the instructions, and in 2 of these participants punishment increased the progressive-schedule step size at which choices began to systematically deviate from the instructions. These results show that monetary penalties for breaking with rules may enhance instructional control, but that deviations from rules still occur under punishment when such deviations produce greater reinforcement than rule following. [ABSTRACT FROM AUTHOR]

ABSTRACT Aims The aim of this experiment was to determine the influence of acute bupropion pre-treatment on subject-rated effects and choice of intranasal cocaine versus money. Design A randomized, within-subject, placebo-controlled, double-blind experiment. Setting An out-patient research unit. Participants Eight cocaine-using adults. Measurements Subjects completed nine experimental sessions in which they were pre-treated with 0, 100 or 200 mg oral immediate release bupropion. Ninety minutes later they sampled an intranasal cocaine dose [4 (placebo), 15 or 45 mg] and made six choices between that dose and an alternative reinforcer (US$0.25), available on independent, concurrent progressive ratio schedules. Subjects also completed a battery of subject-rated, performance and physiological measures following the sample doses of cocaine. Findings After 0 mg bupropion, the high dose of cocaine (45 mg) was chosen five of six times on average compared to 2.25 of six choices for placebo cocaine (4 mg) ( P < 0.05). Active bupropion reduced choice of 45 mg cocaine to 3.13 (100 mg) or 4.00 (200 mg) out of six drug choices on average. Bupropion also consistently enhanced positive subject-rated effects of cocaine (e.g. good effects; willing to take again) while having no effects of its own. Conclusions The atypical antidepressant, bupropion, acutely appears to reduce preference for intranasal cocaine versus a small amount of money but to increase reported positive experiences of the drug. [ABSTRACT FROM AUTHOR]

Pressing a key by one undergraduate provided another undergraduate with points exchangeable for money, and vice versa. Four types of response patterns were found. Points were often delivered with a delay from the last response or with no response. When a contingency that responses lost points (punishment) was added to participants who had emitted more responses than the partner had, their response rates decreased while the rates of their partners increased. These results demonstrate that, under the contingency of mutual reinforcement: (a) response patterns that had occurred between monkeys were replicated between humans; (b) obtained response-reinforcer relations were different from those generally programmed in the basic reinforcement schedules; and (c) the behavior of the participant was controlled by changing the behavior of the partner. [ABSTRACT FROM AUTHOR]

Pressing a key by one undergraduate provided another undergraduate with points exchangeable for money, and vice versa. Four types of response patterns were found. Points were often delivered with a delay from the last response or with no response. When a contingency that responses lost points (punishment) was added to participants who had emitted more responses than the partner had, their response rates decreased while the rates of their partners increased. These results demonstrate that, under the contingency of mutual reinforcement: (a) response patterns that had occurred between monkeys were replicated between humans; (b) obtained response-reinforcer relations were different from those generally programmed in the basic reinforcement schedules; and (c) the behavior of the participant was controlled by changing the behavior of the partner. [ABSTRACT FROM AUTHOR]