Search

Cannabis demand is sensitive to next‐day responsibilities, such as job interviews; however, it is unclear how demand is affected by non‐work‐related responsibilities and how reported compatibility of cannabis use (i.e., how suitable one perceives cannabis use to be in a situation) influences demand. This study examined the effects of a range of responsibilities on cannabis demand in a crowdsourced sample of adults who smoked cannabis at least monthly (n = 177; 78% White; 47% women; mean age = 36.52). Participants completed hypothetical marijuana purchase tasks asking how much cannabis they would consume at escalating prices in the context of no responsibilities and next‐day responsibilities spanning work, leisure, and caregiving. Cannabis demand was significantly reduced in all responsibility conditions (ps < .008; ds .28–.94), with the largest reductions for the job interview and caring‐for‐kids conditions. Higher ratings of suitability of cannabis use in each situation were correlated with higher demand. Finally, a qualitative thematic analysis characterized why cannabis use was considered suitable or unsuitable with each responsibility. These results suggest that demand is sensitive to next‐day responsibilities. However, these effects are not uniform, and future research is needed to examine these individual differences and the timing of upcoming responsibilities. [ABSTRACT FROM AUTHOR]

In this article, we describe a mediational theory of emergent or derived relations resulting from matching‐to‐sample procedures that produce equivalence and transformation of function. According to a mediational theory, behaviors that occur at the time of reinforcement mediate subsequent behavioral relations referred to as “derived” or “emergent.” Such relations have been documented for decades in studies using mostly matching‐to‐sample procedures with humans and nonhumans. In both verbal human and nonhuman participants, the mediating behaviors consist of differential responding to the sample stimulus. In humans, such behaviors are mostly, but not necessarily, verbal; in nonhumans they include a variety of sample‐specific responses, sometimes called “coding.” The proposed mediational theory, based only on the four‐term contingency and the basic principles of operant learning, makes specific predictions and explains results from a broad range of experiments. There are at least three important implications of a mediational theory. First, if by “derived” or “emergent” one means untrained or unreinforced, then derived relations may not exist. Second, if there are no derived relations, then theories of such relations may not be necessary. Third, a mediational theory of relational responding has potentially important implications for clinical practice. [ABSTRACT FROM AUTHOR]

The current study examined 98 participants' preferences for five pictorial stimuli. The researchers used a verbal multiple‐stimulus‐without‐replacement (VMSWO) preference assessment with each participant to identify high‐preference and low‐preference pictorial stimuli. Next, participants viewed each pictorial stimulus in a randomized order on a computer while using a hand dynamometer that measured the amount of force they exerted to increase or maintain the visual clarity of each image. The results indicate that over 75% of participants' force response ranks corresponded with participants' VMSWO high‐preference stimuli, VMSWO low‐preference stimuli, or both. The results of the current study provide further evidence for the use of conjugate schedules in the assessment of stimulus preference with potential for use as a reinforcer assessment. Implications along with directions for future research and limitations of the findings are discussed. [ABSTRACT FROM AUTHOR]

This study examined a conjugate approach for evaluating auditory stimulus preference for 81 participants using force as a continuous response dimension. First, the researchers used a verbal preference assessment to evaluate each participant's preference for listening to five genres of music. This process identified high‐preference and low‐preference music for each participant. Thereafter, the researchers exposed each participant to the five music genres in a randomized order while using a hand dynamometer to measure their response force to increase the auditory clarity of the music. The results indicate (a) 63% of the participants' high‐preference music genres corresponded to the genre for which they exerted the highest mean force and (b) most participants' low‐preference music genres corresponded to the genre for which they exerted the lowest mean force. These findings are consistent with those from Davis et al. (2021) and further support using conjugate preparations for measuring the relative value of some stimulus events. [ABSTRACT FROM AUTHOR]

Hyperbolic relations between independent and dependent variables are ubiquitous in the experimental analysis of behavior, mentioned in over 150 articles in the Journal of the Experimental Analysis of Behavior. There are two principal forms of hyperbolae: The first describes the relation between response rate and reinforcement rate on variable‐interval schedules of reinforcement; it rises asymptotically toward a maximum. The second describes the relation between the current equivalent value of an incentive and its delay or (im)probability; it falls from a maximum toward an asymptote of 0. Where do these come from? What do their parameters mean? How are they related? This article answers the first two questions and addresses the last. [ABSTRACT FROM AUTHOR]

We developed and examined a laboratory preparation with adult humans that pits shorter term avoidance over longer term positive reinforcement and may serve as a useful laboratory functional analogue of problematic behavior. Participants were exposed to choices between (1) avoiding an aversive sound and acquiring no money or (2) listening to an aversive sound for a set duration and then receiving money. The first choice, avoiding an aversive sound and acquiring no money, was conceptualized as immediate negative reinforcement and no positive reinforcement, whereas the latter choice, listening to an aversive sound for a set duration and then receiving money, was conceptualized as a potential positive punisher paired with a larger later positive reinforcer. We manipulated the duration of the sound and the magnitude of money to identify the point at which individual participants' choices changed from avoiding the sound to choosing the sound plus money. As the sound duration increased, the choice of listening to the sound and receiving money decreased. Similar functions were observed with two different monetary magnitudes. The model has potential applicability to real‐world problems such as smoking, addiction, gambling, anxiety disorders, and other impulse control disorders. [ABSTRACT FROM AUTHOR]

Efficient methods for assessing the relative aversiveness of stimuli are sparse and underresearched. Having access to efficient procedures that can identify aversive stimuli would benefit researchers and practitioners alike. Across three experiments, 13 participants helped to pilot, refine, and test two approaches to identifying negative reinforcers. The first experiment presented two conditions, one in which computerized button pressing started or stopped one of two recorded infant cries (or silence, when the control button was selected). Choices were presented either in a modified observing‐response procedure (i.e., simultaneous observing) or in a modified progressive‐ratio procedure (i.e., committed concurrent progressive ratio; CCPR). Results were favorable though not conclusive on their own. A second experiment, using more distinct stimuli (i.e., one likely aversive, one likely not aversive), replicated the first, and clearer results emerged. Finally, the third experiment tested the stimuli from the second experiment in a CCPR arrangement where sound was terminated contingent on responding and idiosyncratic negative reinforcement hierarchies emerged. The utility of these two procedures is discussed, and future work that addresses the limitations is outlined. [ABSTRACT FROM AUTHOR]

Discrimination performance in perceptual choice tasks is known to reflect both sensory discriminability and nonsensory response bias. In the framework of signal detection theory, these aspects of discrimination performance are quantified through separate measures, sensitivity (d′) for sensory discriminability and decision criterion (c) for response bias. However, it is unknown how response bias (i.e., criterion) changes at the single‐trial level as a consequence of reinforcement history. We subjected rats to a two‐stimulus two‐response conditional discrimination task with auditory stimuli and induced response bias through unequal reinforcement probabilities for the two responses. We compared three signal‐detection‐theory‐based criterion learning models with respect to their ability to fit experimentally observed fluctuations of response bias on a trial‐by‐trial level. These models shift the criterion by a fixed step (1) after each reinforced response or (2) after each nonreinforced response or (3) after both. We find that all three models fail to capture essential aspects of the data. Prompted by the observation that steady‐state criterion values conformed well to a behavioral model of signal detection based on the generalized matching law, we constructed a trial‐based version of this model and find that it provides a superior account of response bias fluctuations under changing reinforcement contingencies. [ABSTRACT FROM AUTHOR]

The current study explored the influence of different levels of speaker coherence on rule following and speaker preference. In Experiment 1, rules provided by three different speakers were either 100% accurate, 0% accurate, or 50% accurate/inaccurate. Experiment 2 was similar to Experiment 1 except that the speaker's coherence was adjusted to 80% accurate, 20% accurate, and 50% accurate/inaccurate, respectively. Overall, participants tended to follow coherent speaker rules and avoid following incoherent speaker rules during training and testing phases. The results also indicated that following and not following rules provided by speakers may be generalizable to novel stimuli and maintained in the absence of differential reinforcement (i.e., in experimental test phases). Additionally, in a preference test, participants tended to prefer coherent over incoherent and partially coherent speakers. Furthermore, participants tended to prefer the relatively more incoherent speaker (i.e., 0% or 20% accurate) over the 50% accurate coherent speaker in both experiments. Finally, a comparison of the results of both experiments indicated that different levels of relational coherence affected the variability of rule‐following and speaker preference behaviors. These findings are discussed in the context of the complexities that appear to be involved in rule‐following behaviors and speaker preference. [ABSTRACT FROM AUTHOR]

Resurgence is a temporary increase in a previously suppressed target behavior following a worsening in reinforcement conditions. Previous studies have examined how higher rates or magnitudes of alternative reinforcement affect suppression of the target behavior and subsequent resurgence. However, there has been no investigation of the effects of higher versus lower qualities of alternative reinforcement on resurgence. Using a three‐phase resurgence preparation with rats, the present experiments examined the effects of an alternative reinforcer that was of higher (Experiment 1) or lower (Experiment 2) quality than the reinforcer that had previously maintained the target behavior. The results of both experiments showed greater reductions in target behavior with a higher quality alternative reinforcer and larger increases in target responding when a higher quality alternative reinforcer was removed. Along with prior findings with higher rates and magnitudes of alternative reinforcement, these findings suggest that variations in reinforcer dimensions that increase the efficacy of alternative reinforcement also tend to increase resurgence when alternative reinforcement is removed. The results are discussed in terms of the resurgence as choice in context model and in terms of potential clinical implications. [ABSTRACT FROM AUTHOR]

Following successful treatment in which problem behavior is reduced, it may reemerge as a function of changes in contextual stimuli or the worsening of reinforcement conditions for an alternative response. Although understudied, preliminary research suggests that simultaneous changes in contextual stimuli and reinforcement conditions may represent particularly exigent treatment challenges that create the condition for additive or superadditive relapse. The purpose of the present review was to systematically examine the relapse literature involving simultaneous changes in contextual stimuli and reinforcement conditions in relapse tests and experimental preparations arranged to evaluate their effect on response recovery. We identified 16 empirical articles spanning 27 experiments. Although all experiments included at least one condition that experienced a change in contextual stimuli and worsening of alternative reinforcement conditions, only two experiments included the comparison conditions needed to precisely evaluate additive and superadditive relapse. Our findings establish the preclinical generality of relapse effects associated with simultaneous changes to reinforcement conditions and contextual stimuli across a range of subjects, schedule arrangements, response topographies, reinforcers, and types of contextual changes. We make several recommendations for future research based on our findings from this nascent and clinically relevant subdomain of the relapse literature. [ABSTRACT FROM AUTHOR]

Behavioral momentum theory (BMT) provides a theoretical and methodological framework for understanding how differentially maintained operant responding resists disruption. A common way to test operant resistance involves contingencies with suppressive effects, such as extinction or prefeeding. Other contingencies with known suppressive effects, such as response‐cost procedures arranged as point‐loss or increases in response force, remain untested as disruptive events within the BMT framework. In the present set of three experiments, responding of humans was maintained by point accumulation programmed according to a multiple variable‐interval (VI) VI schedule with different reinforcement rates in either of two components. Subsequently, subtracting a point following each response (Experiment 1) or increasing the force required for the response to be registered (Experiments 2 and 3 decreased response rates, but responding was less disrupted in the component associated with the higher reinforcement rate. The point‐loss contingency and increased response force similarly affected response rates by suppressing responding and human persistence, replicating previous findings with humans and nonhuman animals when other types of disruptive events (e.g., extinction and prefeeding) were investigated. The present findings moreover extend the generality of the effects of reinforcement rate on persistence, and thus BMT, extending the analysis of resistance to two well‐known manipulations used to reduce responding in the experimental analysis of behavior. [ABSTRACT FROM AUTHOR]

This article provides an overview of the distinction between goal-directed behavior and habitual behavior in operant behavior. It explains that goal-directed behavior is influenced by the current value of its reinforcing consequence, while habits occur independently of that value. The article discusses various studies that examine the characteristics and measurement of habits, as well as their persistence and susceptibility to change. It also presents alternative frameworks for understanding habits and goal-directed behavior. The article highlights the evolving understanding of habits and their role in behavior. [Extracted from the article]

Cycling between the availability and unavailability of reinforcement for alternative responding has successfully reduced resurgence in basic laboratory evaluations, but this approach represents a marked departure from current standards of care when treating problem behavior, warranting careful translation before its use clinically. Therefore, with extinction arranged for target responding across groups in Phase 2, we evaluated the effects of cycling between the availability and unavailability of differential reinforcement of alternative behavior (DRA) using a computer‐based task with adult humans recruited through Amazon MTurk. Two control groups experienced constant DRA in Phase 2, with one group experiencing a dense DRA schedule and another group experiencing a lean DRA schedule. The cycling DRA group tended to show greater reductions in target responding and improved discrimination in Phase 2 and less target responding across Phases 2 and 3 than the lean DRA and dense DRA groups. These preliminary findings suggest that on/off DRA cycling procedures may produce more desirable treatment outcomes than constant DRA without producing negative side effects; however, further research is needed to confirm these possibilities. [ABSTRACT FROM AUTHOR]

The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the "contingencies of reinforcement." Mathematical models of each of these principles comprised mathematical principles of reinforcement (MPR; Killeen, 1994). Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm‐up, extinction, sign tracking, pausing, and sequential control in progressive‐ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted. [ABSTRACT FROM AUTHOR]

Three pigeon dyads were exposed to a two‐component multiple schedule comprised of two tandem variable‐interval 30‐s interresponse time (IRT) > 3‐s schedules in the presence of different stimuli. Pecks to keys by both pigeons of a dyad occurring within 500 ms of one another were required for reinforcement under one tandem schedule (the coordination component), and such coordinated responses were not required under the other (the control component). The terminal link of each schedule ensured that the reinforced coordination response was an IRT > 3 s. Rates of coordinated IRTs > 3 s and total rates of coordinated responses (composed of IRTs > 3 s and IRTs ≤ 3 s) were higher in the coordination components than in either of two different control components in which coordination was not required for reinforcement. This difference in coordinated responses in the presence and absence of the coordination requirement under stimulus control transitorily deteriorated and then was reestablished when the relation between the stimulus and the coordination contingency or its absence was reversed. The results show coordinated responding to function as a discriminated social operant. [ABSTRACT FROM AUTHOR]

We investigated the effects of differential and nondifferential reinforcers on divided control by compound‐stimulus dimensions. Six pigeons responded in a delayed matching‐to‐sample procedure in which a blue or yellow sample stimulus flashed on/off at a fast or slow rate, and subjects reported its color or alternation frequency. The dimension to report was unsignaled (Phase 1) or signaled (Phase 2). Correct responses were reinforced with a probability of.70, and the probability of reinforcers for errors varied across conditions. Comparison choice depended on reinforcer ratios for correct and incorrect responding; as the frequency of error reinforcers according to a dimension increased, control (measured by log d) by that dimension decreased and control by the other dimension increased. Davison and Nevin's (1999) model described data when the dimension to report was unsignaled, whereas model fits were poorer when it was signaled, perhaps due to carryover between conditions. We are the first to test this quantitative model of divided control with reinforcers for errors and when the dimension to report is signaled; hence, further research is needed to establish the model's generality. We question whether divided stimulus control is dimensional and suggest it may instead reflect joint control by compound stimuli and reinforcer ratios. [ABSTRACT FROM AUTHOR]

In separate chambers, responding by two pairs of pigeons was reinforced under concurrent random‐ratio schedules of reinforcement. For each pair, the birds' schedules were coupled in such a manner that left‐ and right‐key reinforcement probabilities were determined by the key being pecked by the other pigeon of the pair. In this way, a reinforcement matrix, like that of the popular Prisoner's Dilemma game of game theory, was created. The responding of all subjects soon gravitated to the choice combination identified by the mathematician John Nash as the equilibrium of the Prisoner's Dilemma game. This was found both before and after reversal of contingencies on the keys. In a second experiment, with a single pair of pigeons, stimuli signaling the choice of the paired pigeon had little lasting effect: responding again gravitated to the game's equilibrium. The results affirm earlier findings, demonstrating that Skinner's principle of positive reinforcement, together with Nashian mathematics, entirely accounts for iterative game‐theoretic behavior. They extend these findings to the so‐called free operant: to schedules of reinforcement in which responding is not constrained by stimulus–response sequencing (i.e., a trials procedure). The coupled schedule of reinforcement introduced here offers significant promise for the experimental analysis of economic and social behaviors. [ABSTRACT FROM AUTHOR]

Resurgence of previously reinforced behavior represents a challenge to otherwise successful interventions based on differential reinforcement of alternative behavior (DRA). Expanded‐operant treatments seek to increase the number of functional alternative behaviors through DRA, thereby potentially mitigating resurgence. However, the few studies that have directly examined these methods as a tool for resurgence mitigation have provided limited and unclear results. Thus, the present experiments were designed to investigate the effect of expanded‐operant DRA methods on resurgence of previously reinforced behavior using rat subjects. In two experiments, following a baseline phase in which a target response was trained, groups of rats experienced concurrent (i.e., five simultaneous alternative responses), serial (i.e., five sequentially available alternative responses), or single DRA interventions arranging similar rates of alternative reinforcement in order to examine potential differences in resurgence. Both experiments showed that neither serial nor concurrent DRA expanded‐operant treatments reduced resurgence compared with single DRA regardless of whether stimuli associated with previously reinforced alternative responses were removed (Experiment 1) or remained present (Experiment 2) for the serial‐DRA group. Further, a primacy effect in resurgence was obtained for the serial‐DRA group in both experiments. Overall, these results suggest that expanded‐operant treatments may not help to reduce resurgence. [ABSTRACT FROM AUTHOR]

Sidman's (2000) theory of stimulus equivalence states that all positive elements in a reinforcement contingency enter an equivalence class. The theory also states that if an element from an equivalence class conflicts with a reinforcement contingency, the conflicting element will "drop out" of the class. Minster et al. (2006) found evidence that a conflicting reinforcer does not drop out of an equivalence class. To explain their results, they proposed that the reinforcer enters the class via pairing after conditional relations have been established, and when there is a conflict between the class and the contingencies, conditionally related elements that have a longer history in the class and that were brought in via reinforcement will exert stronger control. In the current study, stimulus‐reinforcer relations were established before conditional relations to assess the role of developmental order of stimulus relations on conditional‐discrimination performance. The results replicate the findings of Minster et al. (2006) but suggest that developmental order may not be an important factor contributing to maintained accuracy on baseline conditional relations. An interpretation of "dropping out" in terms of differentiated subclasses is discussed. The relevance of the results to the phenomenon known as the differential outcomes effect is also discussed. [ABSTRACT FROM AUTHOR]

Dogs may be relinquished to shelters and are unlikely to be adopted if they engage in problem behavior. A successful way to eliminate problem behavior is through training techniques based on behavioral principles. Obedience training with the use of positive reinforcement has been successful in treating problematic behavior by dogs. In order for this method to work, it is essential that the stimuli selected function as reinforcers. Preference assessments can be used to identify these potential reinforcers. A preference assessment is a systematic method used to identify stimuli that may serve as possible reinforcers by yielding preference hierarchies. Although preference and reinforcer assessments have been successfully used with humans, research with nonhuman animals is limited. Therefore, the purpose of the study was to compare the efficacy and efficiency of paired‐stimulus preference assessment with a multiple‐stimulus preference assessment. The results suggested that the results of both preference assessments corresponded with reinforcer assessments but that the paired‐stimulus method was the most efficient. [ABSTRACT FROM AUTHOR]

Response‐independent schedules involve the delivery of an item independent of a response requirement. Often described in the applied behavior analytic literature as "noncontingent reinforcement," they have also frequently been used to reduce undesired or problematic behaviors. The current study examined the use of an automated response‐independent food schedule on the behaviors and sound levels of shelter dogs. Several dogs were included in a 6‐week reversal design, where a fixed‐time 1 min schedule was compared with a baseline condition. Eleven behaviors were measured, as were two areas of each kennel and the overall and session sound intensity (dB) that occurred during the study. The results demonstrated that the fixed‐time schedule increased overall activity while decreasing inactivity and led to a reduction in the overall sound intensity measured. Session and hour‐to‐hour sound‐intensity data were less clear, suggesting a potential contextual conditioning effect as well as a need for adjusted methods to study shelter sound. The above are discussed in terms of their potential welfare benefits for shelter dogs as well as the translational approach that this and similar research could contribute to the application and functional understanding of response‐independent schedules. [ABSTRACT FROM AUTHOR]

Renewal is a type of relapse that occurs due to a change in context. Previous research has demonstrated that renewal of target responding may occur despite the availability of differential reinforcement for an alternative response (DRA). Nevertheless, the current literature on renewal presents mixed findings regarding the effects of dense and lean schedules of DRA on the magnitude of renewal. We used a translational approach with undergraduate college students and a task on a touchscreen tablet device to study the effects of dense and lean schedules of DRA during repeated renewal tests. All participants experienced two, three‐phase ABA renewal arrangements. In the dense and lean renewal arrangements, we differentially reinforced alternative behavior in Context B and the renewal test in Context A on a VI 3‐s or a VI 12‐s schedule, respectively. Overall, we observed renewal in 31/36 (86%) renewal tests regardless of the density of reinforcement for the alternative response. Furthermore, the results showed that although renewal occurred in both arrangements, we found slightly higher magnitudes of renewal during DRA with lean schedules of reinforcement relative to dense schedules. We discuss the implications of these findings as they relate to the treatment of problem behavior. [ABSTRACT FROM AUTHOR]

Incidental bidirectional naming (Inc‐BiN) has been defined as a verbal developmental cusp whereby children demonstrate learning the names of things as listener and speaker as a function of observation alone. Stimulus characteristics have been found to affect performance in tests for Inc‐BiN. To further explore this effect, Experiment 1 compared untaught listener and speaker responses for novel familiar‐type versus novel nonfamiliar‐type stimuli with 20 first‐grade students following naming experiences in which the participants observed each visual stimulus five times while hearing its name. Participants performed significantly better with familiar‐type than with nonfamiliar‐type stimuli. Experiment 2 examined the effects of a repeated‐probe intervention to induce Inc‐BiN with nonfamiliar‐type stimuli. Participants were six first‐grade students who demonstrated incidental unidirectional naming (i.e., acquired names as listener from exposure alone). Implementation of the intervention was staggered across dyads of participants in a multiple‐probe, simultaneous‐treatments design. One participant in each dyad received the intervention with nonfamiliar‐type stimuli only and the other with both nonfamiliar‐ and familiar‐type stimuli. Pre‐ and postintervention Inc‐BiN probes with stimuli not included in the intervention suggested both conditions were effective in establishing Inc‐BiN for nonfamiliar‐type stimuli. These findings have implications for understanding the mechanisms underlying Inc‐BiN. [ABSTRACT FROM AUTHOR]

The operant demand framework has achieved high levels of adoption as an approach to quantify how various ecological factors influence choice. A central goal of the framework proposed by Hursh and Silberburg (2008) was to isolate the "essential value" of reinforcers—namely, their effects on behavior given various contextual factors. The effect of reinforcers on behavior is a phenomenon that is expected to vary as a function of reinforcer magnitude/dosage (i.e., units of reinforcement), price (i.e., schedule requirements), the intensity of demand (i.e., consumption in free operant conditions), the availability of reinforcers (i.e., supply, presence of alternatives), and the individual's current and historical context. This technical report provides a historical summary of the concept, describes the quantitative basis for essential value in the framework of Hursh and Silberburg (2008), reviews prior attempts to extract a generalizable index of essential value, and presents a newer formulation using exact solution that provides a more succinct and durable index. Proofs and solutions are provided to clarify the bases for novel and existing representations of essential value. Recommendations are provided to improve the precision and accuracy of behavioral economic metrics as well as support consensus regarding their interpretation in the operant demand framework. [ABSTRACT FROM AUTHOR]

Shahan et al. (2006) found that the relative rate of pigeons' pecking on two observing responses (i.e., responses that only produced an S+ or stimulus correlated with primary reinforcement) was well described by the relative rate of S+ delivery. Researchers have not evaluated the effects of S+ delivery rate in a concurrent observing response procedure with human subjects, so the necessary procedural modifications for studying the effects of conditioned reinforcement on human choice remain unclear. The purpose of the current study was to conduct an additive component analysis of modifications to the procedures of Shahan et al. (2006). We evaluated the additive effects of introducing response cost, a changeover response, and ordinal discriminative stimuli on correspondence with the results of Shahan et al. and the quality of fits of the generalized matching equation. When our procedures were most similar to those of Shahan et al., we observed low rates of observing and indifference between the two observing responses. For the group of subjects with whom all three additive components were included, we obtained the highest level of sensitivity to relative rate of S+ delivery, but the slope and R2 of our fits of the generalized matching equation were still much lower than those obtained by Shahan et al. Potential reasons for these discrepancies, methods of resolving them, and implications for future research are discussed. [ABSTRACT FROM AUTHOR]

The simultaneous matching‐to‐sample procedures that are widely used to study stimulus equivalence in human participants have generally been unsuccessful in animals. However, functional equivalence classes have been demonstrated in pigeons and sea lions using a concurrent repeated reversal discrimination procedure. In this procedure, responding to one set of stimuli is reinforced but responding to a different set is not and the set associated with reinforcement is changed with multiple reversals during the experiment. The experiments reported here were designed to assess whether functional equivalence classes could be demonstrated in rats using similar techniques. Rats were initially trained with two sets of olfactory stimuli (six odors/set). Following many reversals, probe reversal sessions were conducted in which rats were exposed to a subset of the members of each set and, later in the session, the withheld stimuli were introduced. Responding to these delayed probe trials in accord with the reversed contingencies constituted transfer of function. There was some evidence of transfer in Experiment 1, but the effects were relatively weak and variable. Experiment 2 introduced procedural changes and found strong evidence of transfer of function consistent with the formation of functional equivalence classes. These procedures offer a promising strategy to study symbolic behavior in rodents. [ABSTRACT FROM AUTHOR]

Three experiments examined the effect of signaling reinforcement on rats' lever pressing on contingencies that reinforced variable responding to extend the exploration of signaled reinforcement to a schedule that has previously not been examined in this respect. In Experiment 1, rats responding on a lag‐8 variability schedule with signaled reinforcement displayed greater levels of variability (U values) than rats on the same schedule lacking a reinforcement signal. In Experiment 2, rats responding on a differential reinforcement of least frequent responses schedule also displayed greater operant variability with a signal for reinforcement compared with rats without a reinforcement signal. In Experiment 3, a reinforcement signal decreased the variability of a response sequence when there was no variability requirement. These results offer empirical corroboration that operant variability responds to manipulations in the same manner as do other forms of operant response and that a reinforcement signal facilitates the emission of the required operant. [ABSTRACT FROM AUTHOR]

We present the mathematical description of feedback functions of variable interval and variable differential reinforcement of low rates as functions of schedule size only. These results were obtained using an R script named Beak, which was built to simulate rates of behavior interacting with simple schedules of reinforcement. Using Beak, we have simulated data that allow an assessment of different reinforcement feedback functions. This was made with unparalleled precision, as simulations provide huge samples of data and, more importantly, simulated behavior is not changed by the reinforcement it produces. Therefore, we can vary response rates systematically. We've compared different reinforcement feedback functions for random interval schedules, using the following criteria: meaning, precision, parsimony, and generality. Our results indicate that the best feedback function for the random interval schedule was published by Baum (1981). We also propose that the model used by Killeen (1975) is a viable feedback function for the random differential reinforcement of low rates schedule. We argue that Beak paves the way for greater understanding of schedules of reinforcement, addressing still open questions about quantitative features of simple schedules. Also, Beak could guide future experiments that use schedules as theoretical and methodological tools. [ABSTRACT FROM AUTHOR]

The generalized matching law predicts performance on concurrent schedules when variable‐interval schedules are programmed but is trivially applicable when independent ratio schedules are used. Responding usually is exclusive to the schedule with the lowest response requirement. Determining a method to program concurrent ratio schedules such that matching analyses can be usefully employed would extend the generality of matching research and lead to new avenues of research. In the present experiments, ratio schedules were programmed dependently such that responses to either of the two options progressed the requirement on both schedules. Responding is not exclusive because the probability of reinforcement increases on both schedules as responses are allocated to either schedule. In Experiment 1, performance on concurrent variable‐ratio schedules was assessed, and reinforcer ratios were varied across conditions to investigate changes in sensitivity. Additionally, the length of a changeover delay was manipulated. In Experiment 2, performance was compared under concurrently available, dependently programmed variable‐ratio and fixed‐ratio schedules. Performance was well described by the generalized matching law. Increases in the changeover delay decreased sensitivity, whereas sensitivity was higher when variable‐ratio schedules were employed, compared with fixed‐ratio schedules. Concurrent ratio schedules can be a viable approach to studying functional differences between ratio and interval schedules. [ABSTRACT FROM AUTHOR]

A test of the evolutionary theory was conducted by replicating Bradshaw et al.'s (1977, 1978, 1979) experiments in which human participants worked on single‐alternative variable‐interval (VI) schedules of reinforcement under three punishment conditions: no punishment, superimposed VI punishment, and superimposed variable‐ratio (VR) punishment. Artificial organisms (AOs) animated by the theory worked in the same environments. Four principal findings were reported for the human participants: (1) their behavior was well described by an hyperbola in all conditions, (2) the asymptote of the hyperbola under VI punishment was equal to the asymptote in the absence of punishment, but the asymptote under VR punishment was lower than the asymptote in the absence of punishment, (3) the parameter in the denominator of the hyperbola was larger under both VI and VR punishment than in the absence of punishment, and (4) response suppression under punishment was greater at lower than at higher reinforcement frequencies. These four outcomes were also observed in the behavior of the AOs working in the same environments, thereby confirming the theory's first‐order predictions about the effects of punishment on single‐alternative responding. [ABSTRACT FROM AUTHOR]

Estes (1944) reported that adding electric shock punishment to extinction hastened response suppression but that responding increased when shock was removed. This result contributed to a view that reinforcement and punishment are asymmetrical processes because punishment has only indirect and temporary suppressive effects. Azrin and Holz (1966) suggested the result might be interpreted instead as shock serving as a discriminative stimulus for the absence of reinforcement. Here, to further examine potential stimulus control by punishment in a similar preparation, two groups of rats initially responded for food plus punishment and a third group for food alone. Reinforcement was then removed for all groups for the remaining three phases. With P and N denoting punishment and no punishment, the four phases for the three groups were: P‐P‐N‐N, P‐N‐P‐N, and N‐P‐N‐N. We found some evidence for stimulus control by shock deliveries for group N‐P‐N‐N (as suggested by Azrin and Holz), but all other changes in responding appeared due to introduction or removal of the aversive properties of shock. Although punishment may indeed have temporary effects under many circumstances, we argue that the view that this implies asymmetrical reinforcement and punishment processes was based on the flawed assumption that reinforcement has direct strengthening effects. [ABSTRACT FROM AUTHOR]

When Herrnstein put two levers in the box (or rather two buttons since he was studying the pecking of pigeons rather than the lever-pressing of rats) and began to formulate the matching law, he knew very well that he was following the path of Tolman. "You can be a behaviorist and still talk about the mind - as long as you don't put it into a person's head": An interview with Howard Rachlin1 Dr. Howard Rachlin was Distinguished Research Professor of Psychology at Stony Brook University. We took this term from Tolman (although our position was much more Skinnerian than Tolmanian) because it was deviating from Skinner in the direction of Tolman. [Extracted from the article]

When Herrnstein put two levers in the box (or rather two buttons since he was studying the pecking of pigeons rather than the lever-pressing of rats) and began to formulate the matching law, he knew very well that he was following the path of Tolman. "You can be a behaviorist and still talk about the mind - as long as you don't put it into a person's head": An interview with Howard Rachlin1 Dr. Howard Rachlin was Distinguished Research Professor of Psychology at Stony Brook University. We took this term from Tolman (although our position was much more Skinnerian than Tolmanian) because it was deviating from Skinner in the direction of Tolman. [Extracted from the article]

The effects of delivering nondrug alternative reinforcement on resistance to extinction and reinstatement of rats' ethanol‐maintained lever pressing were evaluated in two experiments. In both, rats self‐administered ethanol by lever pressing in a two‐component multiple schedule during baseline. In the Rich component, alternative food reinforcement was made available for performing an alternative response (Experiment 1) or according to a differential‐reinforcement‐of‐other‐behavior schedule for lever pressing (Experiment 2). In the Lean component, only ethanol was available. Moreover, the frequency of alternative reinforcement was manipulated across conditions in Experiment 1. Following baseline, lever pressing was extinguished in both components by suspending ethanol reinforcement, and alternative food reinforcers were discontinued. Finally, to test for reinstatement, ethanol reinforcers were delivered independently of lever pressing in both components. In both experiments, proportion‐of‐baseline response rates were higher during extinction and reinstatement testing in the Rich component than in the Lean component (although differentiation was not observed at the lowest frequency of alternative reinforcement in Experiment 1). Thus, alternative nondrug reinforcers increased resistance to extinction and reinstatement of rats' ethanol‐maintained lever pressing, even when those reinforcers were delivered contingently on an alternative response or on abstinence from lever pressing. [ABSTRACT FROM AUTHOR]

The present study investigated the effects of variability requirements on learning difficult target sequences in humans. Twenty university students emitted five‐response sequences. For the experimental groups, 30 nontarget sequences were reinforced according to the Lag‐10 variation criterion or the Lag‐3 repetition criterion across conditions. For the control groups, the probability of reinforcers for nontarget sequences was yoked to that obtained by the experimental groups. In addition, for both groups, two difficult target sequences were continuously reinforced. U values were higher with the Lag‐10 variation criterion than with the Lag‐3 repetition criterion for the experimental groups and were unsystematic for the control groups. Higher U values ​​were accompanied by a random pattern in the emission of nontarget sequences for all groups. Higher levels of variability, regardless of whether they were directly produced by reinforcement or were contingency induced, facilitated learning of difficult target sequences. [ABSTRACT FROM AUTHOR]

Differential reinforcement of alternative behavior (DRA) involves placing problem behavior under extinction and simultaneously reinforcing a desirable behavior. Recent research revealed that, as predicted by Behavioral Momentum Theory, DRA may also increase the persistence of the problem behavior. This research has also shown that a different approach to DRA, in which an alternative behavior is trained in a separate context from the target behavior, produces less persistence than the standard procedure. The research on this phenomenon, so far, assessed persistence using extinction as the disruptor. DRA, however, is often implemented under conditions in which extinction of the problem behavior is not feasible. This study evaluated persistence of problem behavior following same‐ and separate‐ context DRA training using an alternative disruptor, an additional source of reinforcement. Following a successful reproduction of a previous study of extinction as a disruptor but with domestic hens, this study produced similar findings using an additional source of reinforcement as the disruptor. These findings add to the evidence that alternative DRA arrangements may avoid the response‐strengthening effects found with traditional DRA procedures. The findings also demonstrate that disruptors other than extinction can be used to investigate response persistence following DRA and other procedures. [ABSTRACT FROM AUTHOR]

Effects of delays of reinforcement on zebrafish behavior were examined following training with immediate reinforcement. The delay was either signaled by an exteroceptive stimulus present for the entire delay period (fully signaled), signaled briefly only at delay onset (partial signal), or without a stimulus (unsignaled). Unsignaled delays consistently resulted in low response rates. Fully signaled delays resulted in higher response rates than unsignaled delays when the delay was 3 s, but this difference in response rates disappeared at 6‐s delays. Partially signaled delays were less effective in maintaining responding than fully signaled delays, but more effective than unsignaled delays, although these results were only suggestive. These results indicate that stimulus changes that occur during delays to reinforcement have similar effects with zebrafish as with other species, but also that responding of zebrafish has a relatively low tolerance to the delay duration. A vast majority of experiments examining zebrafish behavior suggests that the fish have potential to serve as an interface between biological and behavioral science, but this may not be the case in some research areas involving delays, such as delay discounting. [ABSTRACT FROM AUTHOR]

Equivalence classes are defined according to the substitutability, or functional similarity, of the stimuli within a stimulus class. Several studies have demonstrated that the degree of functional similarity between stimuli in a class is dependent, in part, upon the number of nodes (intervening stimuli) between the stimuli. Higher nodal number is related to lower functional similarity. This effect is referred to as "nodality." There are three key factors that have not been simultaneously controlled for in the relevant studies: priming effects, reinforcement during training, and multiple stimulus functions of stimuli (sample, comparison, or both). In the present experiment, controlling for these factors, two 6‐member, 4‐node equivalence classes were established, and a within‐class preference assessment was used to evaluate nodality. Of 12 participants, five achieved criterion accuracy (90%) during testing. These participants demonstrated nodality, showing preference for stimuli that were nodally proximal to a sample in the preference test. When distal comparisons were chosen, participants took longer, on average, to make the selection compared to selections of proximal stimuli. These findings are consistent with earlier studies demonstrating nodality, which suggests that nodality is a robust phenomenon and not an artifact of the factors that were controlled for in the present study. [ABSTRACT FROM AUTHOR]

In animal training, there is disagreement regarding whether a conditioned reinforcer, such as the sound of a clicker, should always be followed by an unconditioned reinforcer, such as a treat. Proponents for clicking without always giving a treat argue that the click can substitute for the reinforcer, due to Pavlovian conditioning and the partial reinforcement effect. Those who advise always following the click with a treat argue that the clicker will become an unreliable predictor of food if it is not always followed by an unconditioned reinforcer. In this study, a within‐subject reversal design with two dogs was used to compare the behavioral effects of always following a click with food (one click condition) and only sometimes following a click with food (two clicks condition). Results showed that the two clicks condition disrupted the frequency, accuracy, and topography of the behavior and increased noncompliance and other unwanted behaviors. While the detrimental effects of this condition may seem paradoxical at first, they can be explained by the discriminative properties of the conditioned reinforcer. [ABSTRACT FROM AUTHOR]

Positive reinforcement is becoming more common in horse training. Identifying effective reinforcers is critical for training success. The aim of this study was to determine relative reinforcer efficacy of different grains. Four horses learned to muzzle touch a target, after which they were tested using a progressive ratio schedule of reinforcement with different grains as the consequence. Break points were used to determine relative reinforcer efficacy of each grain and were also converted into unit price per kilocalorie to determine if caloric value impacted reinforcer efficacy. Condition 1 compared three textured grains that spanned industry‐accepted standards of low to high nonstructural carbohydrate content. Condition 2 compared three pelleted grains that similarly differed in nonstructural carbohydrate content, comparable to Condition 1, but that had a different texture than those of Condition 1. Finally, Condition 3 directly compared one grain each from Conditions 1 and 2. Results showed overall little difference in reinforcer efficacy or unit price between grains but found that all grains tested functioned as reinforcers for the horses. This suggests that a range of commercially available grains can maintain behavior and therefore be used for training. We also identified possible extraexperimental factors that impact reinforcer efficacy. [ABSTRACT FROM AUTHOR]

Many approaches for reducing unwanted behavior use punishment, extinction, or noncontingent reinforcement. Other methods focus on teaching and reinforcing alternative behaviors that can replace the unwanted behavior. Another strategy can be to change the stimulus control of the unwanted behavior. The present study investigated if conditional discrimination training using positive reinforcement could reduce undesirable behaviors in a pet dog. After conditional discrimination training, two unwanted behaviors (jumping and mouthing) occurred reliably in the presence of new discriminative stimuli, while other behaviors occurred in the presence of the discriminative stimuli that had previously produced these unwanted behaviors. This experiment demonstrates that conditional discrimination training can be an effective way to control the frequency of an unwanted behavior by controlling the frequency of the presentation of a discriminative stimulus. [ABSTRACT FROM AUTHOR]

Some of the earliest applications outside the laboratory of principles derived from the experimental analysis of behavior (EAB), such as the pioneering work of Keller and Marian Breland, involved animals. This translational tradition continues to the present as EAB‐related behavior principles are applied with increasing frequency to behavior management and training practices with animals in nonlaboratory settings. Such translations, and those populations to which they are applied, benefit from a rigorous experimental analysis of practices that are promulgated in popular outlets. These translations both affirm the generality of those principles and serve as goads for laboratory and field research that can further articulate extant principles, develop new ones, and refine methods of application and assessment. This review considered several areas of basic EAB research and contemporary applied animal behavior (AAB) practices in relation to one another: (1) response establishment and maintenance, (2) response reduction and elimination, (3) chaining and conditioned reinforcement, and (4) discriminative stimulus control. Within each topic, a selection of processes and procedures in both EAB and AAB work were reviewed in relation to one another. [ABSTRACT FROM AUTHOR]

Functional analysis data and previous studies on animal training have demonstrated that social interaction with humans can serve as a reinforcer for animals. Yet, some studies have demonstrated that tactile interaction (e.g., patting, petting, or scratching) is less effective or ineffective when compared to food. However, the reinforcement procedures used may account for these discrepancies. The current study investigated whether tactile interaction, in the form of petting and scratching, could be used as a reinforcer to train behaviors to two horses and a mule. First, each equine learned when reinforcement would be available and what behaviors to engage in during reinforcement delivery. Next, a series of shaping steps and a changing‐criterion design were used to test whether tactile interaction could be used to shape two new behaviors, stay and come. All three equines completed reinforcement training and met the mastery criteria for training stay and come. These results demonstrate that tactile interaction can be used as a reinforcer to train equines and also suggest that details of the reinforcement delivery process may be an important consideration when tactile interaction is used as a reinforcer. [ABSTRACT FROM AUTHOR]

Of the millions of dogs that enter animal shelters in the United States each year, many exhibit behaviors labeled as fear, which can decrease their likelihood of adoption. Current dog training procedures to treat these behaviors can take months or even years to show significant change. When these procedures are used in shelters, they mainly focus on reducing fear, as opposed to teaching specific behaviors to increase adoptions. The goal of the current study was to teach fearful shelter dogs to interact with a novel person. A seven‐step shaping procedure used the removal of the novel person as a reinforcer. The dogs learned a series of behaviors, starting with looking at the person and small head movements and progressing until the dog was approaching the front of the kennel and voluntarily interacting with the person. All three dogs completed the program in a short amount of time (under 40 min) and showed an increase in approaching the front of the kennel, sniffing, tail wagging, and accepting petting. These behaviors persisted during a return‐to‐baseline condition, suggesting that the newly shaped behaviors had come under the control of positive reinforcement in the form of social interaction with the experimenter. [ABSTRACT FROM AUTHOR]

The recurrence of a previously eliminated or reduced behavior following a downshift in alternative reinforcement is referred to as resurgence. Resurgence as Choice (RaC) is a quantitative model of behavioral persistence that posits that resurgence is governed by the same behavioral principles that underlie choice behavior. Consistent with the predictions of RaC, extant basic research with animals indicates that resurgence increases as an exponential function of the size of the downshift in alternative reinforcement. Recently, Shahan and Greer (2021) extended this finding to resurgence of problem behavior during schedule thinning following functional communication training (FCT). They found that when resurgence occurred, it increased exponentially as a function of relative decrements in reinforcer availability during schedule thinning with compound schedules of reinforcement. The purpose of the current study was to directly replicate the analytic procedures described in Shahan and Greer to examine resurgence of problem behavior during schedule thinning following FCT using two novel clinical datasets. Our results closely replicate the findings from Shahan and Greer, providing additional support for the generality of resurgence during downshifts in alternative reinforcement in clinical contexts. These results also highlight the potential applicability of RaC for modeling resurgence of problem behavior during FCT schedule thinning. [ABSTRACT FROM AUTHOR]

The putamen is a nucleus within the sensory‐motor striatal network that is involved in automatic, habitual actions. Schedule‐induced polydipsia (SIP) is highly automated behavior, reliably occurring under intermediate interval schedules of reinforcement. The effect of putamen inhibition in mediating SIP of water and ethanol (4% w/v) under a Fixed Time 5‐min (FT‐5 min) schedule for food delivery was tested in 12 rhesus monkeys (6 male, 6 female). Water and ethanol SIP sessions ended after set volumes were consumed. Baseline patterns of SIP intake differed between water and ethanol SIP in volume but not in pattern of drinking. Activation of the designer receptor exclusively activated by designer drug (DREADD: hM4Di) with deschloroclozapine (DCZ; 300 μg/kg, i.m.) administered 30 min prior to the onset of the SIP session, for four consecutive sessions. DCZ administration increased the postpellet drink volume and reduced the time to drink both water and ethanol. Although the effect of DCZ treatment was similar for increasing SIP with either water or ethanol, post‐DCZ return to baseline SIP rates of differed, perhaps highlighting the effect of a state dependency with ethanol SIP. Overall, the study shows that targeting the putamen with the inhibitory DREADD produces a reversible, reproducible and reliable increase in adjunctive drinking. [ABSTRACT FROM AUTHOR]

An accumulated body of choice research has demonstrated that choice behavior can be understood within the context of its history of reinforcement by measuring response patterns. Traditionally, work on predicting choice behaviors has been based on the relationship between the history of reinforcement—the reinforcer arrangement used in training conditions—and choice behavior. We suggest an alternative method that treats the reinforcement history as unknown and focuses only on operant choices to accurately predict (more precisely, retrodict) reinforcement histories. We trained machine learning models known as artificial spiking neural networks (SNNs) on previously published pigeon datasets to detect patterns in choices with specific reinforcement histories—seven arranged concurrent variable‐interval schedules in effect for nine reinforcers. Notably, SNN extracted information from a small 'window' of observational data to predict reinforcer arrangements. The models' generalization ability was then tested with new choices of the same pigeons to predict the type of schedule used in training. We examined whether the amount of the data provided affected the prediction accuracy and our results demonstrated that choices made by the pigeons immediately after the delivery of reinforcers provided sufficient information for the model to determine the reinforcement history. These results support the idea that SNNs can process small sets of behavioral data for pattern detection, when the reinforcement history is unknown. This novel approach can influence our decisions to determine appropriate interventions; it can be a valuable addition to our toolbox, for both therapy design and research. [ABSTRACT FROM AUTHOR]

The progressive ratio procedure is used across fields to assess motivation for different reinforcers, define the effects of experimental interventions on motivation, and determine experience‐dependent changes in motivation. However, less is known about how operant training schedules affect performance on this widely utilized task. Here we designed an experiment to examine the effect of variable ratio versus fixed ratio training schedules of reinforcement on progressive ratio performance while holding other performance variables constant between groups. We found a robust increase in maximum ratio completed between the pretest and posttraining test highlighting a robust training effect on progressive ratio performance. However, it did not matter if the training was under a fixed or variable ratio schedule. Additionally, we show that neither individual rates during training nor extinction responding correlated with maximum ratio achieved during the sessions. Finally, we show that rates during the training sessions do correlate with extinction performance, suggesting that these variables measure a different aspect of performance that does not predict motivation. [ABSTRACT FROM AUTHOR]

The dopamine‐depleting agent tetrabenazine alters effort‐based choice, suppressing food‐reinforced behaviors with high response requirements, while increasing selection of low‐cost options. In the present experiments, rats were tested on a concurrent fixed ratio 5/chow feeding choice task, in which high‐carbohydrate Bio‐serv pellets reinforced lever pressing and lab chow was concurrently available. Detailed timing of lever pressing was monitored with an event recording system, and the temporal characteristics of operant behavior seen after 1.0 mg/kg tetrabenazine or vehicle injections were analyzed. Tetrabenazine shifted choice, decreasing lever pressing but increasing chow intake. There was a small effect on the interresponse‐time distribution within ratios, but marked increases in the total duration of pauses in responding. The postreinforcement‐pause (PRP) distribution was bimodal, but tetrabenazine did not increase the duration of PRPs. Tetrabenazine increased time feeding and duration and number of feeding bouts, but did not affect feeding rate or total time spent lever pressing for pellets and consuming chow. Thus, TBZ appears to predominantly affect the relative allocation of lever pressing versus chow, with little alteration in consummatory motor acts involved in chow intake. Tetrabenazine is used to model motivational symptoms in psychopathology, and these effects in rats could have implications for psychiatric research. [ABSTRACT FROM AUTHOR]