Search

The effects of reinforcement value and social control on instruction following under a negative-reinforcement (escape) schedule were studied. Initially, responding produced timeouts from pressing a force cell under a low and a high force requirement on a fixed-ratio 1 schedule of reinforcement. Next, participants were reexposed to the low and high force requirements, but were instructed that the experimenter expected them to decrease the number of timeouts relative to the previous exposures to the procedure. Even though following the instruction led to a decrease in number of timeouts and to an increase in effort (i.e., was non-efficient), instruction following occurred consistently for each participant and was modulated by reinforcement value. That is, the decrease in the number of timeouts (i.e., instruction following) was lower under the high force requirement than under the low force requirement. These results replicate and extend previous findings that instructions interact with social and nonsocial contingencies in controlling human behavior. [ABSTRACT FROM AUTHOR]

Previously reinforced responses can reappear when reinforcement is withdrawn from current responding. This is known as resurgence. Although resurgence of response topography, spacing, and patterns over time has been demonstrated, there is no evidence of resurgence of response duration. This experiment explored resurgence of response duration in humans. In Phase 1 a multiple schedule of reinforcement with two components was used. In each component a chained variable-interval 30 s, variable-ratio 3 schedule was implemented. In the terminal link of the chained schedule, response durations between 0.1 and 0.5 s were reinforced during one component, and between 2 and 8 s in the other component. In Phase 2, response requirement during the terminal link of the chained schedule was inverted between components relative to Phase 1. In Phase 3 the chained schedule was changed to a variable-interval 30-s, extinction 30 s. Resurgence of the durations trained during Phase 1 was observed. It was concluded that duration is a response dimension that reappears during extinction. [ABSTRACT FROM AUTHOR]

The effects of instructions on the sensitivity of negatively reinforced (escape) behavior to extinction were studied. Initially, responding produced timeouts from pressing a force cell on a variable-ratio (VR) schedule, which was then discontinued (extinction). Based on extinction data, participants were distributed into two groups. Participants in the Extinction Group (for which response rates were low in extinction) were instructed that the experimenter expected them to continue responding in extinction after a second exposure to the VR schedule. Participants in the Persistence group (for which response rates were high in extinction) were instructed that the experimenter expected them to stop responding in extinction. Relative to the condition in which instructions were absent, extinction-response rates increased and decreased, respectively, for participants in the Persistence and Extinction groups. These results replicate and extend to negatively reinforced responding previous findings that showed behavioral control by instructions formulated as explicit experimenter demands or expectations. [ABSTRACT FROM AUTHOR]

The relation between persistence, as measured by resistance to change, and resurgence has been examined with nonhuman animals but not systematically with humans. The present study examined persistence and resurgence with undergraduate students engaging in a computer task for points exchangeable for money. In Phase 1, a target response was maintained on a multiple variable-interval (VI) 15-s (Rich) VI 60-s (Lean) schedule of reinforcement. In Phase 2, the target response was extinguished while an alternative response was reinforced at equal rates in both schedule components. In Phase 3, the target and the alternative responses were extinguished. In an additional test of persistence (Phase 4), target responding was reestablished as in Phase 1 and then disrupted by access to videos in both schedule components. In Phases 2 and 4, target responding was more persistent in the Rich than in the Lean component. Also, resurgence generally was greater in the Rich than in the Lean component in Phase 3. The present findings with humans extend the generality of those obtained with nonhuman animals showing that higher reinforcement rates produce both greater persistence and resurgence, and suggest that common processes underlie response persistence and relapse. [ABSTRACT FROM AUTHOR]

The generalized matching equation provides a good description of response allocation in concurrent schedules of positive reinforcement in nonhumans as well as in humans. The present experiment was conducted to further investigate the allocation of responding under concurrent schedules of negative reinforcement (i.e., timeouts from pressing a force cell) in humans. Each of three participants was exposed to different reinforcement ratios (9:1, 1:1 and 1:9) in the terminal links of a concurrent-chains schedule of negative reinforcement. The allocation of responding under this schedule was well described by the generalized matching equation, for each participant. These results replicate previous findings obtained with nonhumans and humans under concurrent schedules of positive reinforcement. In addition, they extend the results reported by Alessandri and Rivière (2013) showing that human behavior maintained by timeouts from an effortful response is sensitive to changes in relative reinforcement ratios as well as relative delays of reinforcement. [ABSTRACT FROM AUTHOR]

Resurgence occurs when a previously reinforced and then extinguished target response increases due to a worsening of reinforcement conditions for an alternative response. We conducted four crowdsourcing experiments to evaluate effects of alternative-reinforcer rate and magnitude on resurgence with humans. Contingent on an alternative response, we manipulated across groups either the rate of point delivery (Experiment 1) or number of points delivered per reinforcer (Experiments 2–3). Experiment 4 arranged combinations of high- or low-rate and high- or low-magnitude alternative reinforcement across four groups. When extinguishing alternative responding across experiments, we observed resurgence of target responding with relatively high rates of alternative reinforcement but differences in reinforcer magnitude did not influence resurgence. A quantitative model based on the concatenated matching law, Resurgence as Choice in Context (RaC2), provided a poor fit to the data, generally underpredicted target responding, and could not account for data from control groups experiencing extinction of target responding in the absence of alternative reinforcement. We then fit a modified version of RaC2 borrowing an assumption from theories of choice that suggest some proportion of reinforcers are misallocated between responses – this modified version of RaC2 provided a better account of these findings. • Examined effects of reinforcer rate and magnitude on resurgence through crowdsourcing. • In four experiments, greater reinforcer rates but not magnitudes increased resurgence. • We fit a quantitative model based on matching, Resurgence as Choice in Context (RaC2). • RaC2 fits improved when assuming reinforcers are misallocated between responses. • Misallocation also allowed RaC2 to be fit for the first time to simple extinction data. [ABSTRACT FROM AUTHOR]

Highlights: [•] Participants played a Paper Scissors Rock game against a computer or a fictitious human opponent. [•] Sensitivity to the relative reinforcer rate was higher for those in the “computer” condition than the “player” condition. [•] Perceived opponent type can alter the effect of reinforcer contingencies on human choice behaviour. [•] The generalised matching law was a good descriptor of three-alternative human choice behaviour. [Copyright &y& Elsevier]

Highlights: [•] A new procedure to study human operant conditioning is described using a rest force period as reinforcer when high force was required. [•] Experiment 1 reports evidence that the rest force period acts as a reinforcer. [•] Experiment 2 demonstrates sensitivity to delay as a parameter of choice in a self-control paradigm. [•] The results of the two experiments indicate a functional similarity between primary reinforcers used in non-human subjects and the present reinforcer. [•] So this procedure is well-suited to study operant conditioning in humans. [Copyright &y& Elsevier]

Abstract: The present experiment examined whether, in a matching-to-sample (MTS) procedure, a relation between two stimuli, a sample and a comparison, could be established as a result of just stimulus–stimulus pairing, even if back up reinforcers were never provided for the conditional relation between the sample and comparison stimuli, but rather only for the comparison stimulus. A procedure called “pseudo matching-to-sample” was used in which, when S1 was presented as a sample stimulus, two comparison stimuli (C1 and C2) were presented, and only responses to C1 were reinforced. Conversely, when S2 was presented, only responses to C3 (and not C4) were reinforced. In other words, organisms experiencing this procedure could discriminate C1 from C2, and C3 from C4, by simple discrimination without regard to the conditional sample stimuli. In order to examine cross-species differences, responding by humans in this procedure was compared to that by pigeons. Although the humans developed a discriminative function for the sample stimuli, that is, the humans’ responding was affected by both the sample stimuli and the reinforcers, responding by the pigeons was affected solely by the reinforcers. These data suggest that, in this procedure, humans (but not pigeons) are able to learn relations among stimuli simply as a result of stimulus–stimulus pairing. [Copyright &y& Elsevier]

Abstract: The availability of alternative reinforcers reduces drug taking. Escalating alternative reinforcer values have been used to initiate and maintain abstinence from drug use. A reset in reinforcer value has been added to the schedule of alternative reinforcer presentation to discourage relapse. The purpose of this preliminary study was to test the influence of escalating and escalating and resetting alternative reinforcer value on cigarette choice in the human laboratory. Fourteen daily cigarette smokers completed this experiment, which required one practice and three experimental sessions. During each experimental session, subjects made six choices between smoking a cigarette and receiving money, available under Constant, Escalating or Escalating and Resetting conditions. The total number of cigarettes chosen and puffs taken, but not the maximum consecutive number of cigarettes choices, was decreased in the Escalating condition relative to the Constant condition. The maximum number of consecutive cigarettes chosen was decreased in the Escalating and Resetting condition relative to the Constant condition. The proportion of money earned was increased in the Escalating condition relative to the Constant and Escalating and Resetting conditions. These initial findings indicate that whereas an escalating alternative reinforcer schedule reduces cigarette smoking overall, an escalating and resetting alternative reinforcer schedule may reduce repeated cigarette smoking (i.e., relapse). [Copyright &y& Elsevier]

Abstract: When humans buy a lottery ticket or gamble at a casino they are engaging in an activity that on average leads to a loss of money. Although animals are purported to engage in optimal foraging behavior, similar sub-optimal behavior can be found in pigeons. They show a preference for an alternative that is associated with a low probability of reinforcement (e.g., one that is followed by a red hue on 20% of the trials and then reinforcement or by a green hue on 80% of the trials and then the absence of reinforcement) over an alternative that is associated with a higher probability of reinforcement (e.g., blue or yellow each of which is followed by reinforcement 50% of the time). This effect appears to result from the strong conditioned reinforcement associated with the stimulus that is always followed by reinforcement. Surprisingly, although it is experienced four times as much, the stimulus that is never followed by reinforcement does not appear to result in significant conditioned inhibition (perhaps due to the absence of observing behavior). Similarly, human gamblers tend to overvalue wins and undervalue losses. Thus, this animal model may provide a useful analog to human gambling behavior, one that is free from the influence of human culture, language, social reinforcement, and other experiential biases that may influence human gambling behavior. [Copyright &y& Elsevier]

Abstract: Recently, have advanced a behavior-economic approach to measure the value of reinforcers, in which demand elasticity is measured relative to the point at which price is zero, a technique that allows for comparisons across reinforcers that show different consumption patterns or across different dosages or magnitudes of the same reinforcer. The authors have proposed an exponential model in which the elasticity coefficient measures the essential value of reinforcers. The application of the exponential model in various experiments has shown that it provided a good fit to the data and supplied different theoretically consistent results. Considering that this previous research has either been experimentally based or has involved nonhuman participants, the present work examined the application of the model to the analysis of changes in consumption of brands with changes in prices, employing data from actual consumers buying brands of food products in grocery shopping, differing in the level of informational (i.e., socially mediated) and utilitarian (i.e., product mediated) reinforcement they offered. Purchase information concerning two products was obtained from a consumer panel, which included data related to purchases of more than 1600 consumers during 52 weeks. The model, calculated for different brands, fitted the data only moderately, but its parameters showed good reliability across stores. The essential value of brands showed significant increases with increases in brand informational reinforcement. The results indicate the reliability of the measure of essential value as its application is extended from the closed setting of the laboratory to the open settings of the marketplace and to symbolic secondary reinforcers. [Copyright &y& Elsevier]

Abstract: Zolpidem attenuates shift-change-related sleep and performance disruptions. It is unknown whether these benefits alter the reinforcing effects of the drug during shift work. This study examined zolpidem-related reinforcing effects during simulated shift work. Eleven volunteers (3F, 8M) completed this 16-day within-participant, residential laboratory study. Each day participants were given an opportunity to self-administer oral zolpidem (10mg) or receive a $1 voucher immediately following a 9-h work period and immediately before going to bed. Participants worked under two shift conditions: (1) during the night shift, participants completed computerized task batteries from 00:30 to 09:30h and went to bed at 16:00h and (2) during the day shift, participants completed task batteries from 08:30 to 17:30h and went to bed at 24:00h. Shift conditions alternated three times during the study. Despite the fact that sleep, psychomotor performance, and some ratings of mood were disrupted during night-shift work, there was no significant effect of shift on choice to take zolpidem. Overall, participants selected markedly fewer zolpidem doses than monetary vouchers (17% versus 83%). Thus, zolpidem did not serve as a reinforcer even when sleep was disrupted. These data are consistent with previous reports indicating that sedatives produce limited reinforcing effects in individuals without a history of drug abuse. [Copyright &y& Elsevier]

Abstract: Past studies using the concurrent-chain procedure showed that pigeons and humans generally prefer an unsegmented schedule to a segmented schedule. This finding is ostensibly inconsistent with theories of conditioned reinforcement such as delay-reduction theory. In the present study with humans, two changes in the basic segmented schedule were implemented to resolve this inconsistency. The first change was that in the segmented schedule the terminal-link stimulus (S+ stimulus) changed late in the terminal-link, close to reinforcement presentation. The second change was that the presentation of the segmenting stimulus, S+, was brief allowing a reinstatement of the early terminal-link stimulus, which is contiguous with reinforcement. Our data constitute the first demonstration of preference for the segmented schedule when a brief S+ is correlated with a greater reduction in delay to reinforcement. [Copyright &y& Elsevier]

Abstract: Cocaine dependence continues to be a significant public health concern. Contingency management, wherein alternative reinforcers are made available upon cocaine abstinence, has shown promise for decreasing cocaine use. Other research has modeled this effect and demonstrated that alternative reinforcers also reduce cocaine self-administration in the laboratory. Results from both clinical and laboratory studies suggest that the type and value of alternative reinforcers influences their ability to decrease drug choice. The purpose of the present experiment was to determine the effect of money or food alternative reinforcers, valued at $0.01, 0.25, 0.50 and 1.00, on intranasal cocaine (4 [placebo] and 30mg) choice. Cocaine was chosen to a greater extent than placebo across alternative reinforcer types and values, but the monetary alternative reinforcer suppressed drug choice to a greater degree than the food reinforcer. These results are concordant with previous findings and suggest that money may be a more effective alternative reinforcer for decreasing cocaine use. Future research should determine the sensitivity of this model to specific behavioral aspects of contingency management and whether food could compete with drugs as reinforcers in humans under laboratory conditions. [Copyright &y& Elsevier]

Reinforcement was presented contingent upon human subjects simultaneously varying three dimensions of an operant response. The response was drawing rectangles on a computer screen. The dimensions were area of the rectangle, its location on the screen, and its shape. In Experiment 1, an experimental group was reinforced for satisfying the three-part variability contingency. A control group was equally reinforced for drawing rectangles but independently of levels of variability. Results showed that the experimental group varied significantly more along each of the dimensions than did the control group. In Experiment 2, another group of subjects was reinforced for repeating instances along one of the dimensions, e.g. repeatedly draw a rectangle in approximately the same location, while simultaneously varying along the other two dimensions. The subjects learned to satisfy these contingencies as well. These results show reinforcement simultaneously and independently controls the variability of three orthogonal dimensions of a response. [Copyright &y& Elsevier]

Rule-governed behavior is typically acquired faster than contingency-governed behavior but is less sensitive than contingency-governed behavior to unverbalized contingency changes. The present study investigated these relationships in a computer task frequently used to study human self-control. Instructions for one group of participants contained a hint about how to maximize long-term reinforcement; the other group performed the task without the hint. Participants given the hint came closer to maximizing reinforcement in the long term, but their behavior was less sensitive to an unsignaled contingency change than that of those not given the hint. The study shows that, like other complex behaviors, self-control may be contingency-governed or rule-governed. [Copyright &y& Elsevier]