Search

Serial reversal-learning procedures are simple preparations that allow for a better understanding of how animals learn about environmental changes, including flexibly shifting responding to adapt to changing reinforcement contingencies. The present study examined serial reversal learning with humans by arranging both midsession and variable contingency reversals across two experiments. We also examined the effects of extinction by adding nonreinforced trials at the end of later sessions and provided the first evaluation of effects of win-stay/lose-shift versus counting strategies on accuracy and response latency of humans' reversal-learning performance. In each experiment, responding tracked contingency reversals, primarily with participants using either win-stay/lose-shift or counting strategies. Introducing variable reversal points in the second experiment resulted in near-exclusive win-stay/lose-shift responding among participants and eliminated counting of trials. Each experiment also revealed an immediate shift from S2 to S1 after experiencing extinction during the initial test trial, indicating resurgence of the initial response through a win-stay/lose-shift response pattern. Therefore, the present study replicates and extends prior findings of a win-stay/lose shift response pattern in situations of greater uncertainty. These findings suggest that differences in environmental certainty induce qualitatively different decision-making strategies. [ABSTRACT FROM AUTHOR]

In games of chance, a near miss is said to occur when feedback for a loss approximates a win. For instance, obtaining "cherry-cherry-lemon" on a slot machine could be considered a near miss. Sixty-six years ago, B.F. Skinner first proposed the idea that near-miss events might reinforce continued play in slot machines, and despite some inconsistencies in the experimental literature, belief in this "near-miss effect" has remained strong. In the present manuscript, we will review this literature and present experimental assessments of the near-miss effect on the frequency of the gambling response. Experiment 1 used a tightly controlled resistance-to-extinction procedure in pigeons to evaluate the putative reinforcing effect of near misses relative to a control "far-miss" reel pattern. Experiment 2 extended Experiment 1's procedure to human participants. The results of both experiments failed to support the near-miss effect hypothesis. Experiment 3 used a further simplified procedure to assess the validity of the resistance-to-extinction paradigm when a probable conditional reinforcer was present on the reel stimuli. Although a clear conditional response was obtained from the reel, subsequent testing in extinction revealed no conditionally reinforcing function of this stimulus on operant response frequency. [ABSTRACT FROM AUTHOR]

Despite the success of exposure-based psychotherapies in anxiety treatment, relapse remains problematic. Resurgence, the return of previously eliminated behavior following the elimination of an alternative source of reinforcement, is a promising model of operant relapse. Nonhuman resurgence research has shown that higher rates of alternative reinforcement result in faster, more comprehensive suppression of target behavior, but also in greater resurgence when alternative reinforcement is eliminated. This study investigated rich and lean rates of alternative reinforcement on response suppression and resurgence in typically developing humans. In Phase 1, three groups (Rich, n = 18; Lean, n = 18; Control, n = 10) acquired the target response. In Phase 2, target responding was extinguished and alternative reinforcement delivered on RI 1 s, RI 3 s, and extinction schedules, respectively. Resurgence was assessed during Phase 3 under extinction conditions for all groups. Target responding was suppressed most thoroughly in Rich and partially in Lean. Target responding resurged in the Rich and Lean groups, but not in the Control group. Between groups, resurgence was more pronounced in the Rich group than the Lean and Control groups. Clinical implications of these findings, including care on the part of clinicians when identifying alternative sources of reinforcement, are discussed. [ABSTRACT FROM AUTHOR]

The recurrence of negatively reinforced responding of humans was studied in three experiments. In each experiment during Baseline, key-pressing produced 3-s timeouts from a requirement to exert finger pressure on a force cell according to variable- or fixed-ratio schedules of reinforcement. In Experiment 1, resurgence was studied by arranging a differential-reinforcement-of-other-behavior schedule in the second phase, and extinction in the Test phase. In Experiment 2, ABA renewal was studied by extinguishing responding in the second phase in a different context and, in the Test phase, by presenting the Baseline-phase context when extinction still was in effect. In Experiment 3, reinstatement was studied by arranging extinction in the second phase, followed by the delivery of response-independent timeouts in the Test phase. Resurgence and renewal occurred consistently for each participant in Experiments 1 and 2, respectively. In Experiment 3, reinstatement was observed less consistently in four participants. The results of these experiments replicate and extend to negatively reinforced responding previous findings of the resurgence and renewal of positively reinforced responding obtained mainly with nonhuman animals. [ABSTRACT FROM AUTHOR]

Resurgence occurs when a worsening of conditions for an alternative response (e.g., extinction) increases a previously reinforced and subsequently extinguished target response. In contrast, renewal is an increase in a response previously eliminated by extinction following a contextual change. Moreover, arranging contextual changes during resurgence tests has enhanced relapse compared with the absence of contextual changes. Several laboratory studies evaluating resurgence in humans have included interruptions of operant tasks by presenting instructions or "blackouts" immediately prior to phase changes in which reinforcement contingencies change. Such interruptions could enhance relapse during testing similarly to changes in contextual stimuli. We tested this possibility in the present study with human participants recruited via Amazon Mechanical Turk by interrupting the task across groups with 1-s blackouts every 12 s, 60 s, between phases, or by arranging no blackouts in a control group. We found that blackouts prior to phase changes increased resurgence effects relative to no blackouts, suggesting that blackouts between phases are a type of contextual manipulation serving to increase the salience of contingency changes. • Evaluated whether blackouts serve as contextual stimuli to enhance resurgence. • Brief blackouts between phase changes increased resurgence compared to no blackouts. • Between-phase blackouts could increase salience of contingency changes. [ABSTRACT FROM AUTHOR]

Highlights: [•] A new procedure to study human operant conditioning is described using a rest force period as reinforcer when high force was required. [•] Experiment 1 reports evidence that the rest force period acts as a reinforcer. [•] Experiment 2 demonstrates sensitivity to delay as a parameter of choice in a self-control paradigm. [•] The results of the two experiments indicate a functional similarity between primary reinforcers used in non-human subjects and the present reinforcer. [•] So this procedure is well-suited to study operant conditioning in humans. [Copyright &y& Elsevier]

Habituation has recently been addressed within the operant conditioning paradigm. While the literature on this topic is growing, the examination of dishabituation, a fundamental characteristic of habituation, remains limited. This study expanded research on habituation of operant responding in non-human animals to research involving humans. Specifically, dishabituation and stimulus specificity were examined under a variety of conditions involving changes in the reinforcer type, reinforcement schedule, reinforcer amount, and selected properties of the antecedent stimuli for a computerized task with 46 undergraduate students. An additional 3 participants were exposed to a control condition. Evaluation of within session patterns of responding indicates that the introduction of stimulus changes into the operant context reliably produced dishabituation of operant responding in humans. [ABSTRACT FROM AUTHOR]

Laboratory models of relapse provide methods for evaluating challenges to behavioral treatments with differential reinforcement of an alternative response (DRA). Resurgence occurs with the worsening of conditions of reinforcement for appropriate behavior and renewal occurs when transitioning out of a treatment context. Across five experiments, participants recruited via online crowdsourcing pressed onscreen buttons to earn points exchangeable for money and contexts sometimes changed through changes in the background image. Returning to the training context (ABA, Experiment 1) and transitioning to a novel context (ABC, Experiment 2) produced greater resurgence when removing alternative reinforcement in comparison with remaining in the treatment context (ABB). In contrast, we observed little difference in resurgence among AAA, ABB, and AAC context manipulations (Experiment 3) and ABA, ABC, and AAC context manipulations (Experiment 4). In Experiment 5, we evaluated relative contributions of the presence versus absence of context changes (ABA vs. ABB) in combination with or without the removal of alternative reinforcement. Both changing context and removing alternative reinforcement increased responding in isolation and the combination produced greater-than-additive effects. Overall, the present findings demonstrate a consistent effect of removing alternative reinforcement on relapse that, under certain conditions, can be enhanced by context change. • We evaluated effects of context changes on resurgence of a button press with humans. • ABA and ABC context changes enhanced resurgence relative to ABB context changes. • Similar levels of resurgence occurred with AAA, ABB, and AAC context changes. • Similar levels of resurgence occurred with ABA, ABC, and AAC context changes. • Context changes and extinction produced greater-than-additive response increases. [ABSTRACT FROM AUTHOR]

• Examined reinforcement and extinction using crowdsourcing across six experiments. • Adding response cost for all button presses facilitated extinction. • Demonstrated ABA renewal when changing background contexts across phases. • Demonstrated resurgence of a target when extinguishing alternative-button presses. • Crowdsourcing showed promise for examining reinforcement and extinction processes. Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace providing researchers with the opportunity to collect behavioral data from remote participants at a low cost. Recent research demonstrated reliable extinction effects, as well as renewal and resurgence of button pressing with MTurk participants. To further examine the generality of these findings, we replicated and extended these methods across six experiments arranging reinforcement and extinction of a target button press. In contrast to previous findings, we did not observe as reliable of decreases in button pressing during extinction (1) after training with VR or VI schedules of reinforcement, (2) in the presence or absence of context changes, or (3) with an added response cost for button pressing. However, we found that that a 1-point response cost for all button presses facilitated extinction to a greater extent than the absence of response cost. Nevertheless, we observed ABA renewal of button pressing when changing background contexts across phases and resurgence when extinguishing presses on an alternative button. Our findings suggest that MTurk could be a viable platform from which to ask and address questions about extinction and relapse processes, but further procedural refinements will be necessary to improve the replicability of control by experimental contingencies. [ABSTRACT FROM AUTHOR]

• Undergraduate students were assessed on a videogame task. • Using three virtual contexts during extinction reduced ABA renewal of operant performance. • Conducting extinction in multiple contexts might enhances the generalization of the extinction learning to other contexts. In one experiment with human participants, we investigated the effects of using multiple contexts during extinction on the renewal of operant responses. Undergraduate students played a videogame in which they learned to shoot at enemies in Context A. Then, all participants experienced an extinction training. For half of the participants, extinction trials were conducted in a single context, whereas the other half received extinction in three different contexts. Finally, all participants were tested in Context A. We observed that conducting extinction in multiple contexts attenuated ABA renewal. The present results suggest that conducting extinction in multiple contexts can be used as a behavioral technique to reduce operant renewal. [ABSTRACT FROM AUTHOR]

• The effects of different physical-effort requirements on resistance to change was assessed with humans. • Responding was maintained under a multiple VI VI schedule with equal reinforcement rates. • Extinction was used as disrupting operation during Test conditions. • Human operant behaviors tend to persist more in relatively low-effort conditions. The effects of different physical-effort requirements on behavioral resistance to change were examined with undergraduate students engaging in a computer task for points exchangeable for money. In Baseline, button pressing was maintained on a multiple variable interval (VI) 45-s VI 45-s schedule of reinforcement with two physical-effort requirements: 10 N in the Low-Effort Component and 50 N in the High-Effort Component. In Test, button pressing was disrupted by a multiple extinction (EXT) EXT schedule plus anagrams as a concurrent task for five participants. For other two participants, button pressing was disrupted only by a multiple EXT EXT in one test, and both disruptors were implemented together in the second test. Baseline and Test conditions were replicated in an ABAB design. Resistance to change was greater in the presence of discriminative stimuli associated with the Low-Effort Component to six participants during the first test and to four participants during the second test. The present findings suggest differences in physical-effort can contribute to differences in resistance to change. [ABSTRACT FROM AUTHOR]