Search

The motivational value of visual infant stimuli in humans is considered to encourage parental behavior. To explore the evolutionary roots of this preference for infants, we examined the reward value of conspecific infant videos compared to adult ones in nine chimpanzees. We employed a novel approach, a simultaneous discrimination task with differential sensory reinforcement. In Experiments 1 and 2, we tested if watching conspecific infant videos is more rewarding than watching adult ones. Participants were required to discriminate between two visual stimuli by a touch panel task. In video reward trials, a video clip featuring a chimpanzee infant followed a correct choice, while one featuring an adult followed an incorrect choice. However, the percentage of correct choices did not significantly differ from chance except in one chimpanzee, indicating that chimpanzees did not exhibit a preference for watching infant videos over those of adult. In Experiment 3, we tested if chimpanzees prefer conspecific videos over a blank screen; however, we did not find evidence either at a group level. These results suggest that the incentive salience of infant stimuli may not be universally compelling across species. Additionally, we discuss the limitations of the task using sensory reinforcement. [ABSTRACT FROM AUTHOR]

Estradiol and progesterone potentiate and attenuate reward processes, respectively. Despite these well-characterized effects, there is minimal research on the effects of synthetic estrogens (e.g., ethinyl estradiol, or EE) and progestins (e.g., levonorgestrel, or LEVO) contained in clinically-utilized hormonal contraceptives. The present study characterized the separate effects of repeated exposure to EE or LEVO on responding maintained by a reinforcing visual stimulus. Forty ovary-intact female Sprague-Dawley rats received either sesame oil vehicle (n = 16), 0.18 μg/day EE (n = 16), or 0.6 μg/day LEVO (n = 8) subcutaneous injections 30-min before daily one-hour sessions. Rats' responding was maintained by a 30-sec visual stimulus on a Variable Ratio-3 schedule of reinforcement. The day after rats' last session, we determined rats estrous cycle phase via vaginal cytology before sacrifice and subsequently weighing each rat's uterus to further verify the contraceptive hormone manipulation. The visual stimulus functioned as a reinforcer, but neither EE nor LEVO enhanced visual stimulus maintained responding. Estrous cytology was consistent with normal cycling in vehicle rats and halting of normal cycling in EE and LEVO rats. EE increased uterine weights consistent with typical uterotrophic effects observed with estrogens, further confirming the physiological impacts of our EE and LEVO doses. In conclusion, a physiologically effective dose of neither EE nor LEVO did not alter the reinforcing efficacy of a visual stimulus reinforcer. Future research should characterize the effects of hormonal contraceptives on responding maintained by other reinforcer types to determine the generality of the present findings. • A brief visual stimulus functioned as a reinforcer. • Ethinyl estradiol and levonorgestrel did not alter visual stimulus reinforcement. • Estrous cycling was halted by low doses of ethinyl estradiol and levonorgestrel. • Ethinyl estradiol produced expected estrogen-evoked uterotrophy. [ABSTRACT FROM AUTHOR]

Sensory attributes, such as sound quality ascertained by listening to a stereo, are often ambiguous and therefore difficult to encode and retrieve. Despite this, consumers often place more weight on these attributes compared to verbally described market information when making brand choice decisions. Results from two studies demonstrate that providing criteria to evaluate the sound quality of competing brands of stereos facilitates the encoding, retrieval, and alignment of the sensory attribute in a brand choice task. Study 1 shows that without criteria to evaluate sound quality during trial, memory for this attribute is poor. Further, perceptions of sound quality assimilate to conflicting market information, which adversely affects decision performance. The reverse is true when evaluative criteria and a scheme to rate the criteria are provided: memory for sound quality improves, perceptions of sound quality contrast with conflicting market information, more weight is placed on sound quality when decision making, and better choices are made. Study 2 shows that providing evaluative criteria during product trial enhances performance through improvement in the encoding process. [ABSTRACT FROM AUTHOR]

The sound-induced flash illusion is a multisensory illusion occurring when one flash is presented with two beeps and perceived as two flashes. Younger individuals are largely susceptible to the illusion when the stimulus onset asynchrony between the first and the second beep falls within the temporal window of integration, but the susceptibility falls dramatically outside of this short temporal range. Older individuals, in particular older adults prone to falling and/or mild cognitive impairment, show an extended susceptibility to the illusion. This suggests that they have inefficient multisensory integration, particularly in the temporal domain. In the present study, we investigated the reliability of the illusion across younger and older people, guided by the hypothesis that the experimental context, i.e., exposure to a wider or smaller number of stimulus onset asynchronies, would modify the intrapersonal susceptibility to the illusion at shorter asynchronies vs. longer asynchronies, likely due to the gathering of model evidence based on Bayesian inference.We tested 22 young adults and 29 older adults and verified these hypotheses. Both groups showed higher susceptibility to the illusion when exposed to a smaller range of asynchronies, but only for longer ones, not within the 100 ms window. We discuss the theoretical implications in terms of online perceptual learning and practical implications in terms of standardisation of the experimental context when attempting to find normative values. [ABSTRACT FROM AUTHOR]

Previous research has shown that rats reared in simple/impoverished environments demonstrate greater repetitive responding for sensory reinforcers ( e.g. , light onset). Moreover, the brains of these rats are abnormally developed, compared to brains of rats reared in more complex/enriched environments. Repetitive behaviors are commonly observed in individuals with developmental disorders. Some of these repetitive behaviors could be maintained by the reinforcing effects of the sensory stimulation that they produce. Therefore, rearing rats in impoverished conditions may provide an animal model for certain repetitive behaviors associated with developmental disorders. We hypothesize that in rats reared in simple/impoverished environments, the normal habituation process to sensory reinforcers is impaired, resulting in high levels of repetitive behaviors. We tested the hypothesis using an operant sensory reinforcement paradigm in rats reared in simple/impoverished (IC), standard laboratory (SC), and complex/enrichened conditions (EC, treatments including postnatal handling and environmental enrichment). Results show that the within-session habituation of the reinforcer effectiveness of light onset was slower in the IC and SC rats than in the EC rats. A dishabituation challenge indicated that within-session decline of responses was due to habituation and not motor fatigue or sensory adaptation. In conclusion, rearing rats in simple/impoverished environments, and comparing them to rats reared in more complex/enriched environments, may constitute a useful approach for studying certain repetitive behaviors associated with developmental disorders. [ABSTRACT FROM AUTHOR]

Predictive coding models of attention propose that attention and prediction operate synergistically to optimize perception, as reflected in interactive effects on early sensory neural responses. It is yet unclear whether attention and prediction based on the temporal attributes of expected events operate in a similar fashion. We investigated how attention and prediction based on timing interact by manipulating the task relevance and a priori probability of auditory stimulus onset timing within a go/no-go task while recording EEG. Preparatory activity, as indexed via the contingent negative variation, reflected temporally specific anticipation as a function of both attention and prediction. Higher stimulus probability led to significant predictive N1 suppression; however, we failed to find an effect of task relevance on N1 amplitude and an interaction of task relevance with prediction. We suggest the predictability of sensory timing is the predominant influence on early sensory responses where a priori probabilities allow for strong prior beliefs. When this is the case, we find that the effects of temporal prediction on early sensory responses are independent of the task relevance of sensory stimuli. Our findings contribute to the expansion of predictive coding frameworks to include the role of timing in sensory processing. [ABSTRACT FROM AUTHOR]

The mechanosensory lateral line system of fishes detects water motions within a few body lengths of the source. Several types of artificial stimuli have been used to probe lateral line function in the laboratory, but few studies have investigated the role of flow sensing in benthic feeding teleosts. In this study, we used artificial flows emerging from a sandy substrate to assess the contribution of flow sensing to prey detection in the peacock cichlid, Aulonocara stuartgranti, which feeds on benthic invertebrates in Lake Malawi. Using a positive reinforcement protocol, we trained fish to respond to flows lacking the visual and chemical cues generated by tethered prey in prior studies with A. stuartgranti. Fish successfully responded to artificial flows at all five rates presented (characterized using digital particle image velocimetry), and showed a range of flow-sensing behaviors, including an unconditioned bite response. Immediately after lateral line inactivation, fish rarely responded to flows and the loss of vital fluorescent staining of hair cells (with 4-di-2-ASP) verified lateral line inactivation. With in 2 days post-treatment, some aspects of flow-sensing behavior returned and after 7 days, flow-sensing behavior and hair cell fluorescence both returned to pre-treatment levels, which is consistent with the reported timing of hair cell regeneration in other vertebrates. The presentation of ecologically relevant water flows to assess flow-sensing behaviors and the use of a positive reinforcement protocol are methods that present new opportunities to study the role of flow sensing in the feeding ecology of benthic feeding fishes. [ABSTRACT FROM AUTHOR]

In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral and neural based explanations of reinforcement. We argue that habituation of reinforcer effectiveness (HRE) is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009;Rankin et al., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slow HRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect ‘accelerated-HRE’. Consideration of HRE is important for the development of effective reinforcement based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are non-consumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior.

Problem behavior often has sensory consequences that cannot be separated from the target response, even if external, social reinforcers are removed during treatment. Because sensory reinforcers that accompany socially mediated problem behavior may contribute to persistence and relapse, research must develop analog sensory reinforcers that can be experimentally manipulated. In this research, we devised analogs to sensory reinforcers in order to control for their presence and determine how sensory reinforcers may impact treatment efficacy. Experiments 1 and 2 compared the efficacy of differential reinforcement of alternative behavior (DRA) versus noncontingent reinforcement (NCR) with and without analog sensory reinforcers in a multiple schedule. Experiment 1 measured the persistence of key pecking in pigeons, whereas Experiment 2 measured the persistence of touchscreen responses in children with intellectual and developmental disabilities. Across both experiments, the presence of analog sensory reinforcers increased the levels, persistence, and variability of responding relative to when analog sensory reinforcers were absent. Also in both experiments, target responding was less persistent under conditions of DRA compared to NCR regardless of the presence or absence of analog sensory reinforcers. [ABSTRACT FROM AUTHOR]

In four experiments we assessed the effect of systemic amphetamine on the ability of a stimulus paired with reward and a stimulus that was not paired with reward to support instrumental conditioning; i.e., we trained rats to press two levers, one followed by a stimulus that had been trained in a predictive relationship with a food outcome and the other by a stimulus unpaired with that reward. Here we show, in general accord with predictions from the dopamine re-selection hypothesis [Redgrave and Gurney (2006). Nat. Rev. Neurosci. 7, 967– 975], that systemic amphetamine greatly enhanced the performance of lever press responses that delivered a visual stimulus whether that stimulus had been paired with reward or not. In contrast, amphetamine had no effect on the performance of responses on an inactive lever that had no stimulus consequences. These results support the notion that dopaminergic activity serves to mark or tag actions associated with stimulus change for subsequent selection (or re-selection) and stand against the more specific suggestion that dopaminergic activity is solely related to the prediction of reward.

In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral- and neural-based explanations of reinforcement. We argue that HRE is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009; Rankin et al., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slowHRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect "accelerated-HRE." Consideration of HRE is important for the development of effective reinforcement-based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are nonconsumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior. [ABSTRACT FROM AUTHOR]

The hierarchical structure of human and animal behavior has been of critical interest in neuroscience for many years. Yet understanding the neural processes that give rise to such structure remains an open challenge. In recent research, a new perspective on hierarchical behavior has begun to take shape, inspired by ideas from machine learning, and in particular the framework of hierarchical reinforcement learning. Hierarchical reinforcement learning builds on traditional reinforcement learning mechanisms, extending them to accommodate temporally extended behaviors or subroutines. The resulting computational paradigm has begun to influence both theoretical and empirical work in neuroscience, conceptually aligning the study of hierarchical behavior with research on other aspects of learning and decision making, and giving rise to some thought-provoking new findings. [Copyright &y& Elsevier]

The effects of sleep deprivation produced using a carousel method on the consolidation of spatial memory were studied in rats (male Wistar rats) after one-day training using the Frick et al. protocol (2000) in a Morris water maze. Data were obtained providing evidence that the memory trace after rapid 3-h training was retained for one day. Sleep deprivation for 24 h after training prevented reinforcement (consolidation) of spatial memory. The results led to the conclusion that a model based on one-day training can be used to study the neurophysiological and neurochemical mechanisms of the effects of sleep deprivation on consolidation of spatial memory. [ABSTRACT FROM AUTHOR]

Abstract: Background: Light onset can be both a sensory reinforcer (SR) with intrinsic reinforcing properties, and a conditioned reinforcer (CR) which predicts a biologically important reinforcer. Stimulant drugs, such as methamphetamine (METH), may increase the reinforcing effectiveness of CRs by enhancing the predictive properties of the CR. In contrast, METH-induced increases in the reinforcing effectiveness of SRs, are mediated by the immediate sensory consequences of the light. Methods: The effects of novelty (on SRs) and METH (on both CRs and SRs) were tested. Experiment 1: rats were pre-exposed to 5s light and water pairings presented according to a variable-time (VT) 2min schedule or unpaired water and light presented according to independent, concurrent VT 2min schedules. Experiment 2: rats were pre-exposed to 5s light presented according to a VT 2min schedule, or no stimuli. In both experiments, the pre-exposure phase was followed by a test phase in which 5s light onset was made response-contingent on a variable-interval (VI) 2min schedule and the effects of METH (0.5mg/kg) were determined. Results: Novel light onset was a more effective reinforcer than familiar light onset. METH increased the absolute rate of responding without increasing the relative frequency of responding for both CRs and SRs. Conclusion: Novelty plays a role in determining the reinforcing effectiveness of SRs. The results are consistent with the interpretation that METH-induced increases in reinforcer effectiveness of CRs and SRs may be mediated by immediate sensory consequences, rather than prediction. [Copyright &y& Elsevier]

Abstract: The term “sensory reinforcer” has been used to refer to sensory stimuli (e.g. light onset) that are primary reinforcers in order to differentiate them from other more biologically important primary reinforcers (e.g. food and water). Acquisition of snout poke responding for a visual stimulus (5s light onset) with fixed ratio 1 (FR 1), variable-interval 1min (VI 1min), or variable-interval 6min (VI 6min) schedules of reinforcement was tested in three groups of rats (n =8/group). The VI 6min schedule of reinforcement produced a higher response rate than the FR 1 or VI 1min schedules of visual stimulus reinforcement. One explanation for greater responding on the VI 6min schedule relative to the FR 1 and VI 1min schedules is that the reinforcing effectiveness of light onset habituated more rapidly in the FR 1 and VI 1min groups as compared to the VI 6min group. The inverse relationship between response rate and the rate of visual stimulus reinforcement is opposite to results from studies with biologically important reinforcers which indicate a positive relationship between response and reinforcement rate. Rapid habituation of reinforcing effectiveness may be a fundamental characteristic of sensory reinforcers that differentiates them from biologically important reinforcers, which are required to maintain homeostatic balance. [Copyright &y& Elsevier]

Abstract: Background: The human personality trait of sensation seeking (SS) indicates an attraction to novel sensations and experiences, and is associated with greater likelihood of drug abuse. In rodents, locomotor activity in a novel environment (Loco) has been found to predict drug self-administration (SA), and has been hypothesized to be a translational model of human SS. Previously, we reported (Gancarz et al., 2011 ) that high responder (HR) animals responded more than low responder (LR) animals to produce a response contingent light onset. The primary goal of this paper was a detailed analysis of the association between Loco and light contingent responding in a large sample of rats (n =93). Methods: Male rats were pre-exposed to dark operant test chambers for ten 30min sessions and baseline levels of responding (snout poking) were determined. The pre-exposure phase was followed by 6 sessions during which active responding produced a visual sensory reinforcer (VSR; 5s light onset) according to a variable interval 1min schedule of reinforcement. After completion of the VSR phase, Loco was tested. Results: The activating effects (total responding) of light were associated with Loco, but the response guiding effects (proportion of active responding) of the light were not. In addition, HR rats habituated more slowly in both the VSR and Loco tests than LR rats. Conclusions: These data indicate that VSR measures aspects of the rodent''s response to novel sensations and experiences that are not detected by Loco. These data provide some evidence for the use of light reinforcement as an animal model of SS. [Copyright &y& Elsevier]

The relative contributions of bottom-up versus top-down sensory inputs to auditory learning are not well established. In our experiment, listeners were instructed to perform either a frequency discrimination (FD) task ('FD-train group') or an intensity discrimination (ID) task ('ID-train group') during training on a set of physically identical tones that were impossible to discriminate consistently above chance, allowing us to vary top-down attention whilst keeping bottom-up inputs fixed. A third, control group did not receive any training. Only the FD-train group improved on a FD probe following training, whereas all groups improved on ID following training. However, only the ID-train group also showed changes in performance accuracy as a function of interval with training on the ID task. These findings suggest that top-down, dimension-specific attention can direct auditory learning, even when this learning is not reflected in conventional performance measures of threshold change. [ABSTRACT FROM AUTHOR]

Control of saccadic gain is often viewed as a simple compensatory process in which gain is adjusted over many trials by the postsaccadic retinal error, thereby maintaining saccadic accuracy. Here, we propose that gain might also be changed by a reinforcement process not requiring a visual error. To test this hypothesis, we used experimental paradigms in which retinal error was removed by extinguishing the target at the start of each saccade and either an auditory tone or the vision of the target on the fovea was provided as reinforcement after those saccades that met an amplitude criterion. These reinforcement procedures caused a progressive change in saccade amplitude in nearly all subjects, although the rate of adaptation differed greatly among subjects. When we reversed the contingencies and reinforced those saccades landing closer to the original target location, saccade gain changed back toward normal gain in most subjects. When subjects had saccades adapted first by reinforcement and a week later by conventional intrasaccadic step adaptation, both paradigms yielded similar degrees of gain changes and similar transfer to new amplitudes and to new starting positions of the target step as well as comparable rates of recovery. We interpret these changes in saccadic gain in the absence of postsaccadic retinal error as showing that saccade adaptation is not controlled by a single error signal. More generally, our findings suggest that normal saccade adaptation might involve general learning mechanisms rather than only specialized mechanisms for motor calibration. [ABSTRACT FROM AUTHOR]

Contrafreeloading, which means that animals work for food even though identical food is freely available, has been reported in animals' feeding behavior. This phenomenon has been assumed to be explained by the information primacy model, in which the information about a food resource as well as the food itself is valuable for animals. This study confirmed a contrafreeloading-like phenomenon using movies as rewards rather than food in Japanese macaques ( Macaca fuscata) and investigated the motivational system that exists behind contrafreeloading. In the experiment, movies that were presented dependently on subjects' responses (earned movies) and movies that were presented automatically (free movies) were supplied simultaneously. The subjects continued to make responses to obtain the presentation of the earned movies although identical movies were available as free movies. These results provide the first evidence of contrafreeloading that occurs with movie rewards. The motivation maintaining the contrafreeloading behavior for movies may be control over the environment according to the competence theory. [ABSTRACT FROM AUTHOR]

Abstract: There is evidence that visual stimuli used to signal drug delivery in self-administration procedures have primary reinforcing properties, and that drugs of abuse enhance the reinforcing properties of such stimuli. Here, we explored the relationships between locomotor activity, responding for a visual stimulus, and self-administration of methamphetamine (METH). Rats were classified as high or low responders based on activity levels in a novel locomotor chamber and were subsequently tested for responding to produce a visual stimulus followed by self-administration of a low dose of METH (0.025mg/kg/infusion) paired with the visual stimulus. High responder rats responded more for the visual stimulus than low responder rats indicating that the visual stimulus was reinforcing and that operant responding for a visual stimulus has commonalities with locomotor activity in a novel environment. Similarly, high responder rats responded more for METH paired with a visual stimulus than low responder rats. Because of the reinforcing properties of the visual stimulus, it was not possible to determine if the rats were responding to produce the visual stimulus, METH or the combination. We speculate that responding to produce sensory reinforcers may be a measure of sensation seeking. These results indicate that visual stimuli have unconditioned reinforcing effects which may have a significant role in acquisition of drug self-administration, a role that is not yet well understood. [Copyright &y& Elsevier]

Copyright of Mexican Journal of Behavioral Analysis / Revista Mexicana de Análisis de la Conducta is the property of Sociedad Mexicana de Analisis de la Conducta and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Humans as well as some nonhuman primates have an evolved predisposition to associate snakes with fear by detecting their presence as fear-relevant stimuli more rapidly than fear-irrelevant ones. In the present experiment, a total of 74 of 3- to 4-year-old children and adults were asked to find a single target black-and-white photo of a snake among an array of eight black-and-white photos of flowers as distracters. As target stimuli, we prepared two groups of snake photos, one in which a typical striking posture was displayed by a snake and the other in which a resting snake was shown. When reaction time to find the snake photo was compared between these two types of the stimuli, its mean value was found to be significantly smaller for the photos of snakes displaying striking posture than for the photos of resting snakes in both the adults and children. These findings suggest the possibility that the human perceptual bias for snakes per se could be differentiated according to the difference of the degree to which their presence acts as a fear-relevant stimulus. [ABSTRACT FROM AUTHOR]

Pharmacological and genetic studies have suggested that the metabotropic glutamate receptor 5 (mGluR5) is critically involved in mediating the reinforcing effects of drugs of abuse, but not food. The purpose of this study was to use mGluR5 knockout (KO), heterozygous (Het), and wildtype (WT) mice to determine if mGluR5 modulates operant sensation seeking (OSS), an operant task that uses varied sensory stimuli as a reinforcer. We found that mGluR5 KO mice had significantly reduced OSS responding relative to WT mice, while Het mice displayed a paradoxical increase in OSS responding. Neither KO nor Het mice exhibited altered operant responding for food as a reinforcer. Further, we assessed mGluR5 KO, Het and WT mice across a battery of cocaine locomotor, place preference and anxiety related tests. Although KO mice showed expected differences in some locomotor and anxiety measures, Het mice either exhibited no phenotype or an intermediate one. In total, these data demonstrate a key role for mGluR5 in OSS, indicating an important role for this receptor in reinforcement-based behavior. [ABSTRACT FROM AUTHOR]

How to compute initially unknown reward values makes up one of the key problems in reinforcement learning theory, with two basic approaches being used. Model-free algorithms rely on the accumulation of substantial amounts of experience to compute the value of actions, whereas in model-based learning, the agent seeks to learn the generative process for outcomes from which the value of actions can be predicted. Here we show that (i) "probability matching"-a consistent example of suboptimal choice behavior seen in humans-occurs in an optimal Bayesian model-based learner using a max decision rule that is initialized with ecologically plausible, but incorrect beliefs about the generative process for outcomes and (ii) human behavior can be strongly and predictably altered by the presence of cues suggestive of various generative processes, despite statistically identical outcome generation. These results suggest human decision making is rational and model based and not consistent with model-free learning. [ABSTRACT FROM AUTHOR]

Orientation adaptation and perceptual learning change orientation tuning curves of V1 cells. Adaptation shifts tuning curve peaks away from the adapted orientation, reduces tuning curve slopes near the adapted orientation, and increases the responses on the far flank of tuning curves. Learning an orientation discrimination task increases tuning curve slopes near the trained orientation. These changes have been explained previously in a recurrent model (RM) of orientation selectivity. However, the RM generates only complex cells when they are well tuned, so that there is currently no model of orientation plasticity for simple cells. In addition, some feedforward models, such as the modified feedforward model (MFM), also contain recurrent cortical excitation, and it is unknown whether they can explain plasticity. Here, we compare plasticity in the MFM, which simulates simple cells, and a recent modification of the RM (MRM), which displays a continuum of simple-to-complex characteristics. Both pre- and postsynaptic-based modifications of the recurrent and feedforward connections in the models are investigated. The MRM can account for all the learning- and adaptation-induced plasticity, for both simple and complex cells, while the MFM cannot. The key features from the MRM required for explaining plasticity are broadly tuned feedforward inputs and sharpening by a Mexican hat intracortical interaction profile. The mere presence of recurrent cortical interactions in feedforward models like the MFM is insufficient; such models have more rigid tuning curves. We predict that the plastic properties must be absent for cells whose orientation tuning arises from a feedforward mechanism. [ABSTRACT FROM AUTHOR]

Visual preference was evaluated in a male agile gibbon. The subject was raised by humans immediately after birth, but lived with his biological family from one year of age. Visual preference was assessed using a free-choice task in which five or six photographs of different primate species, including humans, were presented on a touch-sensitive screen. The subject touched one of them. Food rewards were delivered irrespective of the subject’s responses. We prepared two types of stimulus sets. With set 1, the subject touched photographs of humans more frequently than those of other species, recalling previous findings in human-reared chimpanzees. With set 2, photographs of nine species of gibbons were presented. Chimpanzees touched photographs of white-handed gibbons more than those of other gibbon species. The gibbon subject initially touched photographs of agile gibbons more than white-handed gibbons, but after one and two years his choice patterns resembled the chimpanzees’. The results suggest that, as in chimpanzees, visual preferences of agile gibbons are not genetically programmed but develop through social experience during infancy. [ABSTRACT FROM AUTHOR]

Abstract: The brain is able to perform actions based on an adequate internal representation of the world, where task-irrelevant features are ignored and incomplete sensory data are estimated. Traditionally, it is assumed that such abstract state representations are obtained purely from the statistics of sensory input for example by unsupervised learning methods. However, more recent findings suggest an influence of the dopaminergic system, which can be modeled by a reinforcement learning approach. Standard reinforcement learning algorithms act on a single layer network connecting the state space to the action space. Here, we involve in a feature detection stage and a memory layer, which together, construct the state space for a learning agent. The memory layer consists of the state activation at the previous time step as well as the previously chosen action. We present a temporal difference based learning rule for training the weights from these additional inputs to the state layer. As a result, the performance of the network is maintained both, in the presence of task-irrelevant features, and at randomly occurring time steps during which the input is invisible. Interestingly, a goal-directed forward model emerges from the memory weights, which only covers the state–action pairs that are relevant to the task. The model presents a link between reinforcement learning, feature detection and forward models and may help to explain how reward systems recruit cortical circuits for goal-directed feature detection and prediction. [Copyright &y& Elsevier]

Sensory stimulation is aimed at creating or increasing an individual's response to the environment --mainly objects and people. Sensory ways are used to send information to the different brain areas involved, making their activation possible. Among multi-sensory stimulation, basal stimulation is appropriate for all kind of people, including subjects who are seriously affected. Sensory stimulation pursues a basic level of perception and motor activity in order to lay the foundations for future learning. Intervention objectives are drawn from previous assessment, taking into account the patient's starting functional level. [ABSTRACT FROM AUTHOR]

In two studies, 58 sadomasochistic (SM) practitioners provided physiological measures of salivary cortisol and testosterone (hormones associated with stress and dominance, respectively) and psychological measures of relationship closeness before and after participating in SM activities. Observed activities included bondage, sensory deprivation, a variety of painful and pleasurable stimulation, verbal and non-verbal communication, and expressions of caring and affection. During the scenes, cortisol rose significantly for participants who were bound, receiving stimulation, and following orders, but not for participants who were providing stimulation, orders, or structure. Female participants who were bound, receiving stimulation, and following orders also showed increases in testosterone during the scenes. Thereafter, participants who reported that their SM activities went well showed reductions in physiological stress (cortisol) and increases in relationship closeness. Among participants who reported that their SM activities went poorly, some showed decreases in relationship closeness whereas others showed increases. The increases in relationship closeness combined with the displays of caring and affection observed as part of the SM activities offer support for the modern view that SM, when performed consensually, has the potential to increase intimacy between participants. [ABSTRACT FROM AUTHOR]

Abstract: Stimuli associated with nicotine (NIC) can acquire new meaning via Pavlovian conditioning. If a stimulus is associated with the primary reinforcing effects of NIC, the new conditional properties of the stimulus should make it a more valuable reinforcer (i.e., increase the motivation to obtain the stimulus), and this value should be based, in part, on the strength or intensity of the primary reinforcer (i.e., NIC dose). The purpose of the present study was to investigate whether NIC-conditioned reinforcement increased motivation to obtain non-NIC stimuli, as reflected by performance on a progressive ratio (PR) reinforcement schedule, and whether this increased motivation was systematically related to NIC dose. Two Paired groups were allowed to nose-poke for NIC (0.03 or 0.09mg/kg/infusion, IV) accompanied by 15-s illumination of a stimulus light (conditional stimulus or CS). Two Unpaired groups (0.03 or 0.09mg/kg/infusion) could also make a nose-poke response for the CS; however their NIC infusions were controlled by the Paired group (i.e., yoked design). A fifth group (CS-Only) was allowed to nose-poke for CS presentations and saline infusions. After 29 conditioning sessions the nose-poke operant was prevented by obscuring the receptacle and the CS (accompanied by saline infusion for all groups) was made contingent upon a novel operant response (lever press). During the acquisition of this novel response, each CS/saline infusion earned increased the number of responses required to earn the next CS/saline infusion. Pairings with the primary reinforcing effects of NIC resulted the acquisition of a novel response for the CS. Motivation to obtain the CS depended on salience (dose) of the primary reinforcement (NIC). [Copyright &y& Elsevier]

What kind of strategies subjects follow in various behavioral circumstances has been a central issue in decision making. In particular, which behavioral strategy, maximizing or matching, is more fundamental to animal's decision behavior has been a matter of debate. Here, we prove that any algorithm to achieve the stationary condition for maximizing the average reward should lead to matching when it ignores the dependence of the expected outcome on subject's past choices. We may term this strategy of partial reward maximization ''matching strategy''. Then, this strategy is applied to the case where the subject's decision system updates the information for making a decision. Such information includes subject's past actions or sensory stimuli, and the internal storage of this information is often called ''state variables''. We demonstrate that the matching strategy provides an easy way tomaximize reward when combined with the exploration of the state variables that correctly represent the crucial information for reward maximization. Our results reveal for the first time how a strategy to achieve matching behavior is beneficial to reward maximization, achieving a novel insight into the relationship between maximizing and matching. [ABSTRACT FROM AUTHOR]

Learning to play a musical instrument requires complex multimodal skills involving simultaneous perception of several sensory modalities: auditory, visual, somatosensory, as well as the motor system. Therefore, musical training provides a good and adequate neuroscientific model to study multimodal brain plasticity effects in humans. Here, we investigated the impact of short-term unimodal and multimodal musical training on brain plasticity. Two groups of nonmusicians were musically trained over the course of 2 weeks. One group [sensorimotor-auditory (SA)] learned to play a musical sequence on the piano, whereas the other group [auditory (A)] listened to and made judgments about the music that had been played by participants of the sensorimotor-auditory group. Training-induced cortical plasticity was assessed by recording the musically elicited mismatch negativity (MMNm) from magnetoencephalographic measurements before and after training. SA and A groups showed significantly different cortical responses after training. Specifically, the SA group showed significant enlargement of MMNm after training compared with the A group, reflecting greater enhancement of musical representations in auditory cortex after sensorimotor-auditory training compared with after mere auditory training. Thus, we have experimentally demonstrated that not only are sensorimotor and auditory systems connected, but also that sensorimotor-auditory training causes plastic reorganizational changes in the auditory cortex over and above changes introduced by auditory training alone. [ABSTRACT FROM AUTHOR]

Summary: Perceptual inference is biased by foreknowledge about what is probable or possible. How prior expectations are neurally represented during visual perception, however, remains unknown. We used functional magnetic resonance imaging to measure brain activity in humans judging simple visual stimuli. Perceptual decisions were either biased in favor of a single alternative (A/∼A decisions) or taken without bias toward either choice (A/B decisions). Extrastriate and anterior temporal lobe regions were more active during A/∼A than A/B decisions, suggesting multiple representations of prior expectations within the visual hierarchy. Forward connectivity was increased when expected and observed perception diverged (“prediction error” signals), whereas prior expectations fed backward from higher to lower regions. Finally, the coincidence between expected and observed perception activated orbital prefrontal regions, perhaps reflecting the reinforcement of prior expectations. These data support computational and quantitative models proposing that a visual percept emerges from converging bottom-up and top-down signals. [Copyright &y& Elsevier]

It has been proposed that facial expression production originates in sensory regulation. Here we demonstrate that facial expressions of fear are configured to enhance sensory acquisition. A statistical model of expression appearance revealed that fear and disgust expressions have opposite shape and surface reflectance features. We hypothesized that this reflects a fundamental antagonism serving to augment versus diminish sensory exposure. In keeping with this hypothesis, when subjects posed expressions of fear, they had a subjectively larger visual field, faster eye movements during target localization and an increase in nasal volume and air velocity during inspiration. The opposite pattern was found for disgust. Fear may therefore work to enhance perception, whereas disgust dampens it. These convergent results provide support for the Darwinian hypothesis that facial expressions are not arbitrary configurations for social communication, but rather, expressions may have originated in altering the sensory interface with the physical world. [ABSTRACT FROM AUTHOR]

A wide variety of associative learning tasks have been employed to assess the functional role of the orbitofrontal cortex (OFC) and related structures in learning. Many of these tasks were designed to assess the learning of highly specific associations between Pavlovian conditioned stimuli (or instrumental responses) and the sensory properties of reinforcement (i.e., sensory-specific associations). Current research suggests that OFC lesions impair behavioral control by these sensory-specific associations in unconditioned stimulus (US) devaluation, differential outcome, and Pavlovian-to-instrumental transfer experiments. In addition, although the OFC has been shown to be important in conditioned reinforcement but not in potentiated feeding tasks, versions of these tasks that assess control by sensory-specific associations have either not been run or they have not examined the effects of OFC lesions. Thus, firm conclusions from conditioned reinforcement and potentiated feeding studies cannot yet be drawn. Furthermore, studies examining the OFC's involvement in reversal learning have also suggested that associations between stimuli and reinforcement importantly depend upon a functioning OFC, possibly because this structure is needed to generate outcome expectancies useful in the computation of prediction errors ultimately used to “update” associations elsewhere (e.g., basolateral amygdala). Other work has shown that both original and reversed sensory-specific associations can control performance after different time delays following reversal learning. This suggests that structures outside of the OFC may be involved in the storage of originally acquired associations. Overall, this review makes clear that the OFC plays an important role in the encoding of sensory-specific associations in a wide variety of learning tasks. [ABSTRACT FROM AUTHOR]

Although the theoretical underpinnings of sensory integrative therapy are questionable, sensory integration therapy techniques are widely used by physical and occupational therapists in clinical settings. In this study we evaluated the effects of noncontingent tactile and vestibular stimulation, two important components of the sensory integration therapy regimen, in treating nonsocially mediated self-injury in a 9-year-old boy with profound mental retardation and cerebral palsy. A significant reduction in self-injury occurred during observation sessions preceding and following treatment sessions. This finding is discussed relative to other research suggesting that tactile and vestibular stimulation may play a role in the maintenance of some cases of nonsocially mediated self-injury. [ABSTRACT FROM AUTHOR]

This article investigates vehicle steering control, focusing on the task of lane changing and the role of different sources of sensory feedback. Participants carried out 2 experiments in a fully instrumented, motion-based simulator. Despite the high level of realism afforded by the simulator, participants were unable to complete a lane change in the absence of visual feedback. When asked to produce the steering movements required to change lanes and turn a corner, participants produced remarkably similar behavior in each case, revealing a misconception of how a lane-change maneuver is normally executed. Finally, participants were asked to change lanes in a fixed-based simulator, in the presence of intermittent visual information. Normal steering behavior could be restored using brief but suitably timed exposure to visual information. The data suggest that vehicle steering control can be characterized as a series of unidirectional, open-loop steering movements, each punctuated by a brief visual update. [ABSTRACT FROM AUTHOR]

The present study investigated whether Pavlovian conditioning contributes, in the form of the response operandum serving as a conditioned stimulus, to the increase in the rate of response for 1% liquid-sucrose reinforcement when food-pellet reinforcement is upcoming. Rats were exposed to conditions in which sign tracking for 1% sucrose was measured when a subsequent period would or would not provide food pellets. Upcoming food pellets produced an increase in the sign-tracking response, but several accounts could potentially explain that increase. In a second experiment, rats responded at a higher rate for 1% sucrose on a lever predictive of upcoming food pellets than on a lever reliably followed by nonreinforcement. A similar result occurred in concurrent-choice probe sessions. These results, consistent with those of the first experiment, cannot be accounted for by the same alternative explanations and therefore suggest that Pavlovian conditioning can contribute to the observance of positive induction. [ABSTRACT FROM AUTHOR]

Lesion studies demonstrate that the basolateral amygdala complex (BLA) is important for assigning motivational significance to sensory stimuli, but little is known about how this information is encoded. We used in vivo electrophysiology procedures to investigate how the amygdala encodes motivating and reinforcing properties of cues that induce reinstatement of reward-seeking behavior. Two groups of rats were trained to respond to a sucrose reward. The "paired" group was trained with a reward-predictive cue, whereas the "unpaired" group was trained with a randomly presented cue. Both groups underwent identical extinction and reinstatement procedures during which the reward was withheld. The proportion of neurons that were phasically cue responsive during reinstatement was significantly higher in the paired group (46 of 100) than in the unpaired group (8 of 112). Cues that induce reward-seeking behavior can do so by acting as incentives or reinforcers. Distinct populations of neurons responded to the cue in trials in which the cue acted as an incentive, triggering a motivated reward-seeking state, or as a reinforcer, supporting continued instrumental responding. The incentive motivation-encoding population of neurons (34 of 46 cue-responsive neurons; 74%) extinguished in temporal agreement with a decrease in the rate of instrumental responding. The conditioned reinforcement-encoding population of neurons (12 of 46 cue-responsive neurons; 26%) maintained their response for the duration of cue-reinforced instrumental responding. These data demonstrate that separate populations of cue-responsive neurons in the BLA encode the motivating or reinforcing properties of a cue previously associated with a reward. [ABSTRACT FROM AUTHOR]

Abstract: Neuronal activity evokes changes in local CBF and CBV, whose spatial differences are not fully known. We use the Radial Correlation Contrast (RCC) analysis method with high spatial resolution 100×100×1000 μm3 data collected with an 11.7 T magnet to differentiate two spatial–temporal BOLD clusters during sensory rat forepaw stimulation and hypothesize that each corresponds to either the CBF or the CBV processes. One cluster, obtained during the time segment of stimulation onset, is characterized by a high positive BOLD signal whereas the other, obtained during the simulation decline time segment, is characterized by a lower positive signal and strong post stimulus undershoot. The average volume of stimulation onset clusters is embedded in the stimulation decline clusters with the latter significantly larger and shifted towards deeper cortical layers. Comparison of amplitude-RCC and cross-correlation analyses performed on equivalent time segments (30 s, 40 images) revealed no differences in cluster size or location, demonstrating that temporal locality is more important than spatial locality in distinguishing between stimulation onset and stimulation decline clusters. We hypothesize that clusters characterized by stimulation onset are highly weighted by local changes in CBF whereas clusters characterized by stimulation decline are more CBV weighted. Moreover, the data suggest that the locations of the highest CBF changes are distinct from the locations of the highest CBV changes. While the former located within stimulation decline clusters and its weight is gradually reduced towards cluster''s periphery (mainly ventrally), the highest changes in CBV occur in the cluster''s periphery with only modest changes towards its center. [Copyright &y& Elsevier]

The article presents a study about the involuntary functions of the senses conducted by Jean-Marc Gaspard Itard, chief physician of the National Institute for Deaf-Mutes in Paris, France. As he based his medical practice on experience, he regarded appropriate sensory stimulation as contemporary cures for those people who lacked knowledge and social abilities.

Four pigeons were exposed to two tandem variable-interval differential-reinforcement-of-low-rate schedules under different stimulus conditions. The values of the tandem schedules were adjusted so that reinforcement rates in one stimulus condition were higher than those in the other, even though response rates in the two conditions were nearly identical. Following this, a fixed-interval schedule of either shorter or longer values than, or equal to the baseline schedule, was introduced in the two stimulus conditions respectively. Response rates during those fixed-interval schedules typically were higher in the presence of the stimuli previously correlated with the lower reinforcement rates than were those in the presence of the stimuli previously correlated with the higher reinforcement rates. Such effects of the reinforcement history were most prominent when the value of the fixed-interval schedule was shorter. The results are consistent with both incentive contrast and response strength conceptualizations of related effects. They also suggest methods for disentangling the effects of reinforcement rate on subsequent responding, from the response rate with which it is confounded in many conventional schedules of reinforcement. [ABSTRACT FROM AUTHOR]

Joen Bettman's medley of great quotes delves into the experiences of all the senses, allowing the reader to sample the immediacy of all aspects of sensory life in nature from both a child's and an adult's point of view. Ms. Bettmann demonstrates that the immersion of the child's senses in the learning process reconnects the adult and child to the natural world and the fullness of life. [ABSTRACT FROM AUTHOR]

In 3 experiments, rats received preexposure to presentations of a compound flavor BX. The effective salience of B was then tested by assessing its ability to interfere with the aversion controlled by another flavor or the tendency to drink a saline solution after the induction of a salt need. It was found that the effective salience of B was maintained when during preexposure, presentations of BX alternated with presentations of X alone. This was true both when BX was presented as a simultaneous compound (Experiment 1) and as a serial compound (X → B; Experiments 2 and 3); salience was not maintained when the serial compound took the form B → X (Experiments 2 and 3a). It was argued that the salience of B declines during preexposure but is restored when presentations of X are able to activate the representation of B by way of the associative X-B link. [ABSTRACT FROM AUTHOR]