Search

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson’s disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Apathy is pervasive across many neuropsychiatric disorders but is poorly characterised mechanistically, so targeted therapeutic interventions remain elusive. A key impediment has been the lack of validated assessment tools to facilitate translation of promising findings between preclinical disease models and patients. Apathy is a common symptom in Huntington’s disease. Due to its established genetic basis and the availability of defined animal models, this disease offers a robust translational framework for linking motivated behaviour with underlying neurobiology and an ideal context in which to evaluate a quantitative, translational apathy assessment method. In this study we therefore aimed to demonstrate the validity of using touchscreen-delivered progressive ratio tasks to mirror apathy assessment in Huntington’s disease patients and a representative mouse model. To do this we evaluated Huntington’s disease patients (n=23) and age-matched healthy controls (n=20), and male R6/1 mice (n=23) and wildtype controls (n=29) for apathy-like behaviour using touchscreen-delivered progressive ratio tasks. The primary outcome measure of the assessment was breakpoint, defined as the highest number of touchscreen responses emitted before task engagement ceased. Patients and R6/1 mice were both found to exhibit significantly reduced breakpoints relative to their respective control groups, consistent with apathy-like behaviour. This performance was also not associated with motoric differences in either species. These data demonstrate the utility of touchscreen-delivered progressive ratio tasks in detecting clinically relevant motivational deficits in Huntington’s disease. This approach may offer a platform from which clinically relevant mechanistic insights concerning motivation symptoms can be derived and provide an effective route for translation of promising preclinical findings into viable therapeutic interventions.

Disruptions to motivated behaviour are a highly prevalent and severe symptom in a number of neuropsychiatric and neurodegenerative disorders. Current treatment options for these disorders have little or no effect upon motivational impairments. We assessed the contribution of muscarinic acetylcholine receptors to motivated behaviour in mice, as a novel pharmacological target for motivational impairments. Touchscreen progressive ratio (PR) performance was facilitated by the nonselective muscarinic receptor antagonist scopolamine as well as the more subtype-selective antagonists biperiden (M1) and tropicamide (M4). However, scopolamine and tropicamide also produced increases in non-specific activity levels, whereas biperiden did not. A series of control tests suggests the effects of the mAChR antagonists were sensitive to changes in reward value and not driven by changes in satiety, motor fatigue, appetite or perseveration. Subsequently, a sub-effective dose of biperiden was able to facilitate the effects of amphetamine upon PR performance, suggesting an ability to enhance dopaminergic function. Both biperiden and scopolamine were also able to reverse a haloperidol-induced deficit in PR performance, however only biperiden was able to rescue the deficit in effort related choice (ERC) performance. Taken together, these data suggest that the M1 mAChR may be a novel target for the pharmacological enhancement of effort exertion and consequent rescue of motivational impairments. Conversely, M4 receptors may inadvertently modulate effort exertion through regulation of general locomotor activity levels.

Genetic and pharmacological manipulations targeting metabotropic glutamate receptor 5 (mGluR5) affect performance in behavioural paradigms that depend on cognitive flexibility. Many of these studies involved exposing mice to highly stressful conditions including electric foot shocks or water immersion and forced swimming. Because mGluR5 is also implicated in resilience and stress responses, however, apparent impairments in inhibitory learning may have been an artifact of manipulation-induced changes in affective state. To address this, we present here a characterization of cognitive flexibility in mGluR5 knockout (KO) mice conducted with a rodent touchscreen cognitive assessment apparatus in which the animals experience significantly less stress. Our results indicate a significant reversal learning impairment relative to wild-type (WT) controls in the two-choice Visual Discrimination-Reversal (VDR) paradigm. Upon further analysis, we found that this deficit is primarily driven by a prolonged period of perseveration in the early phase of reversal. We also observed a similar perseveration phenotype in the KO mice in the Extinction (EXT) paradigm. In addition, mGluR5 KO mice show higher breakpoints in the touchscreen Progressive Ratio (PR) and altered decision making in the Effort-related Choice (ERC) tasks. Interestingly, this impairment in PR is an additional manifestation of an increased propensity to perseverate on the emission of relatively simplistic behavioural outputs. Together, these findings suggest that under conditions of low stress, mGluR5 KO mice exhibit a pronounced perseverative phenotype that blunts cognitive flexibility.

Rationale Across species, effort-related motivation can be assessed by testing behaviour under a progressive ratio (PR) schedule of reinforcement. However, to date, PR tasks for rodents have been available using traditional operant response systems only. Objectives Touchscreen operant response systems allow the assessment of behaviour in laboratory rodents, using tasks that share high face validity with the computerised assessments used in humans. Here, we sought to optimise a rat touchscreen variant of PR and validate it by assessing the effects of a number of manipulations known to affect PR performance in non-touchscreen paradigms. Methods Separate groups of male Sprague-Dawley rats were trained on PR schedules with either linear (PR4) or exponential (PREXP) schedules of reinforcement. PR performance was assessed in response to manipulations in reward outcome. Animals were tested under conditions of increased reward magnitude and following reward devaluation through a prefeeding procedure. Subsequently, the effects of systemic administration of the dopamine D2/D3 receptor antagonist raclopride and the psychostimulant d-amphetamine were examined as traditional pharmacological methods for manipulating motivation. Results Rats reinforced under PR4 and PREXP schedules consistently showed differential patterns of response rates within sessions. Furthermore, both PR4 and PREXP schedules were sensitive to suppression by prefeeding or raclopride administration. Performance under both schedules was facilitated by increasing reward magnitude or d-amphetamine administration. Conclusions Taken together, these findings mirror those observed in lever-based PR paradigms in rats. This study therefore demonstrates the successful validation of the rat touchscreen PR task. This will allow for the assessment of motivation in rats, within the same touchscreen apparatus used for the assessment of complex cognitive processes in this species.

Rationale Dysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning. Methods We used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks. Results Specifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback. Conclusions These results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

The 22q11.2 deletion syndrome (22q11.2DS) confers high risk of neurodevelopmental disorders such as schizophrenia and attention-deficit hyperactivity disorder. These disorders are associated with attentional impairment, the remediation of which is important for successful therapeutic intervention. We assessed a 22q11.2DS mouse model (Df(h22q11)/+) on a touchscreen rodent continuous performance test (rCPT) of attention and executive function that is analogous to human CPT procedures. Relative to wild-type littermates, Df(h22q11)/+ male mice showed impaired attentional performance as shown by decreased correct response ratio (hit rate) and a reduced ability to discriminate target stimuli from non-target stimuli (discrimination sensitivity, or d’). The Df(h22q11)/+ model exhibited decreased prefrontal cortical-hippocampal oscillatory synchrony within multiple frequency ranges during quiet wakefulness, which may represent a biomarker of cognitive dysfunction. The stimulant amphetamine (0-1.0mg/kg, i.p.) dose-dependently improved d’ in Df(h22q11)/+ mice whereas the highest dose of modafinil (40mg/kg, i.p.) exacerbated their d’ impairment. This is the first report to directly implicate attentional impairment in a 22q11.2DS mouse model, mirroring a key endophenotype of the human disorder. The capacity of the rCPT to detect performance impairments in the 22q11.2DS mouse model, and improvement following psychostimulant-treatment, highlights the utility and translational potential of the Df(h22q11)/+ model and this automated behavioral procedure.

Several neuropsychiatric and neurodegenerative disorders are characterised by motivational impairments manifested as lack of behavioural activation or energy resulting in significant functional impairment. Given the clinical significance of these symptoms, the study of motivation in preclinical research has recently intensified. This review briefly summarises the tasks that have been implemented for the evaluation of motivation in different species, emphasising the recent use of touchscreen-based rodent testing systems. This methodology has been widely used in the evaluation of multiple cognitive domains emphasising their translational value and flexibility. Recently touchscreen-based versions of classical tasks for the evaluation of motivation have been or are currently being developed and validated, thus facilitating translation from animal to human research and promoting their implementation in clinical contexts.

Reliable and reproducible assessment of animal learning and behavior is a central aim of basic and translational neuroscience research. Recent developments in automated operant chamber technology have led to the possibility of universal standard protocols, in addition to increased translational potential, reliability and accuracy. However, the impact of regional and national differences in the supplies of available reinforcers in this system on behavioural performance and inter-laboratory variability is an unknown and at present uncontrolled variable. Therefore, we aimed to identify which constituent(s) of the reward determines reinforcer strength to enable improved standardization of this parameter across laboratories. Male C57BL/6 mice were examined in the touchscreen-based fixed ratio (FR) and progressive ratio (PR) schedules, reinforced with different kinds of milk-based reinforcers to directly compare the incentive values of plain milk (PM, high-calorie: high-fat/low-sugar), strawberry-flavored milk (SM, high-calorie: low-fat/high-sugar), and semi-skimmed low-fat milk (LM, low-calorie: low-fat/low-sugar) on the basis of differences in caloric content, sugar/fat content, and flavor. Use of a higher caloric content reward was effective in increasing operant training acquisition rate. Total trial number completed in FR and breakpoint in PR were higher using the two isocaloric milk products (PM and SM) than the lower caloric LM, with comparable outcomes between PM and SM conditions, suggesting that total caloric content determines reward strength. Analysis of within-session changes in response rate revealed that overall outputs in FR and PR primarily depend on the response rate at the initial phase of a session, which itself was dependent on reinforcer caloric content. Interestingly, the rate of satiation, indicated by decay in response rate within a FR session, was highest when reinforced with SM, suggesting a rapid satiating effect of sugar. The key contribution

Rationale The hippocampus is implicated in many of the cognitive impairments observed in conditions such as Alzheimer’s disease (AD) and schizophrenia (SCZ). Often, mice are the species of choice for models of these diseases and the study of the relationship between brain and behaviour more generally. Thus, automated and efficient hippocampal-sensitive cognitive tests for the mouse are important for developing therapeutic targets for these diseases, and understanding brain-behaviour relationships. One promising option is to adapt the touchscreen-based trial-unique nonmatching-to-location (TUNL) task that has been shown to be sensitive to hippocampal dysfunction in the rat. Objectives This study aims to adapt the TUNL task for use in mice and to test for hippocampus-dependency of the task. Methods TUNL training protocols were altered such that C57BL/6 mice were able to acquire the task. Following acquisition, dysfunction of the dorsal hippocampus (dHp) was induced using a fibre-sparing excitotoxin, and the effects of manipulation of several task parameters were examined. Results Mice could acquire the TUNL task using training optimised for the mouse (experiments 1). TUNL was found to be sensitive to dHp dysfunction in the mouse (experiments 2, 3 and 4). In addition, we observed that performance of dHp dysfunction group was somewhat consistently lower when sample locations were presented in the centre of the screen. Conclusions This study opens up the possibility of testing both mouse and rat models on this flexible and hippocampus-sensitive touchscreen task.

Rationale The CANTAB object-location paired-associate learning (PAL) test can detect cognitive deficits in schizophrenia and Alzheimer’s disease. A rodent version of touch screen PAL (dPAL) has been developed, but the underlying neural mechanisms are not fully understood. Although there is evidence that inactivation of the hippocampus following training leads to impairments in rats, this has not been tested in mice. Furthermore, it is not known whether acquisition, as opposed to performance, of the rodent version depends on the hippocampus. This is critical as many mouse models may have hippocampal dysfunction prior to the onset of task training. Objectives The objectives of this study are to examine the effects of dorsal hippocampal (dHp) dysfunction on both performance and acquisition of mouse dPAL and to determine if hippocampal task sensitivity could be increased using a newly developed context-disambiguated PAL (cdPAL) paradigm. Methods In experiment 1, C57Bl/6 mice received post-acquisition dHp infusions of the GABA agonist muscimol. In experiment 2, C57Bl/6 mice received excitotoxic dHp lesions prior to dPAL/cdPAL acquisition. Results Post-acquisition muscimol dose-dependently impaired dPAL and cdPAL performance. Pre-acquisition dHp lesions had only mild effects on both PAL tasks. Behavioural challenges including addition of objects and degradation of the visual stimuli with noise did not reveal any further impairments. Conclusions dPAL and cdPAL performance is hippocampus-dependent in the mouse, but both tasks can be learned in the absence of a functional dHp.

Rationale Touchscreens are widely used to examine rodent cognition. Current paradigms require animals to view stimuli and nose poke at an appropriate touchscreen location. After responding, there is little screen interaction and, as infra-red touchscreens eliminate the need for physical contact, minimal somatosensory feedback. It is therefore unclear if touchscreens can support the vigorous, repetitive responding required in paradigms like progressive ratio (PR) for assessing motivation and effort-related choice (ERC) for assessing decision-making. Objectives This study aims to adapt and validate PR and ERC for the rodent touchscreen. Methods Male C57Bl/6 mice were trained until responding on PR stabilised. Amphetamine, sulpiride and raclopride were administered via the intraperitoneal route to modify performance. Mice were transferred to ERC and paradigm parameters adjusted to demonstrate behavioural modification. ERC reward preference was assessed by home cage choice analysis. Results PR performance stabilised within seven sessions. Amphetamine (1 mg/kg) increased and raclopride (0.3 mg/kg) decreased performance by 63 and 28 %, respectively, with a 20-min injection-test interval. Sulpiride (50 mg/kg) decreased performance by 19 % following a 40-min injection-test interval. Increasing ERC operant requirements shifted responding from the operant response-dependent preferred reward towards the freely available alternative. Conclusions Vigorous, repetitive responding is sustainable in touchscreen PR and ERC and task validation mirrors non-touchscreen versions. Thus, motivation and reward-related decision-making can be measured directly with touchscreens and can be evaluated prior to cognitive testing in the same apparatus to avoid confounding by motivational factors.

Operant testing is a widely used and highly effective method of studying cognition in rodents. Performance on such tasks is sensitive to reinforcer strength. It is therefore advantageous to select effective reinforcers to minimize training times and maximize experimental throughput. To quantitatively investigate the control of behavior by different reinforcers, performance of mice was tested with either strawberry milkshake or a known powerful reinforcer, super saccharin (1.5% or 2% (w/v) saccharin/1.5% (w/v) glucose/water mixture). Mice were tested on fixed (FR)- and progressive-ratio (PR) schedules in the touchscreen-operant testing system. Under an FR schedule, both the rate of responding and number of trials completed were higher in animals responding for strawberry milkshake versus super saccharin. Under a PR schedule, mice were willing to emit similar numbers of responses for strawberry milkshake and super saccharin; however, analysis of the rate of responding revealed a significantly higher rate of responding by animals reinforced with milkshake versus super saccharin. To determine the impact of reinforcer strength on cognitive performance, strawberry milkshake and super saccharin-reinforced animals were compared on a touchscreen visual discrimination task. Animals reinforced by strawberry milkshake were significantly faster to acquire the discrimination than animals reinforced by super saccharin. Taken together, these results suggest that strawberry milkshake is superior to super saccharin for operant behavioral testing and further confirms that the application of response rate analysis to multiple ratio tasks is a highly sensitive method for the detection of behavioral differences relevant to learning and motivation.

Satiety, rather than all or none, can instead be viewed as a cumulative decrease in the drive to eat that develops over the course of a meal. The nucleus accumbens (NAc) is known to play a critical role in this type of value reappraisal, but the underlying circuits that influence such processes are unclear. Although NAc cholinergic interneurons (CINs) comprise only a small proportion of NAc neurons, their local impact on reward-based processes provides a candidate cell population for investigating the neural underpinnings of satiety. The present research therefore aimed to determine the role of NAc-CINs in motivation for food reinforcers in relation to satiety signaling. Through bi-directional control of CIN activity in mice we show that when motivated by food restriction, increasing CIN activity led to a reduction in palatable food consumption while reducing CIN excitability enhanced food intake. These activity-dependent changes only developed late in the session and were unlikely to be driven by the innate reinforcer strength, suggesting that CIN modulation was instead impacting the cumulative change in motivation underlying satiety signaling. We propose that on a circuit-level, an overall increase in inhibitory tone onto NAc output neurons played a role in the behavioral results, as activating NAc-CINs led to an inhibition of medium spiny neurons that was dependent on nicotinic receptor activation. Our results reveal an important role for NAc-CINs in controlling motivation for food intake and additionally provide a circuit-level framework for investigating the endogenous cholinergic circuits that signal satiety.

Effort-based decision-making is impaired in multiple psychopathologies leading to significant impacts on the daily life of patients. Preclinical studies of this important transdiagnostic symptom in rodents are hampered, however, by limitations present in currently available decision-making tests, including the presence of delayed reinforcement and off-target cognitive demands. Such possible confounding factors can complicate the interpretation of results in terms of decision-making per se. In this study we addressed this problem using a novel touchscreen Rearing-Effort Discounting (RED) task in which mice choose between two single-touch responses: rearing up to touch an increasingly higher positioned stimulus to obtain a High Reward (HR) or touching a lower stimulus to obtain a Low Reward (LR). To explore the putative advantages of this new approach, RED was compared with a touchscreen version of the well-studied Fixed Ratio-based Effort Discounting (FRED) task, in which multiple touches are required to obtain an HR, and a single response is required to obtain an LR. Results from dopaminergic (haloperidol and d-amphetamine), behavioral (changes in the order of effort demand; fixed-ratio schedule in FRED or response height in RED), and dietary manipulations (reward devaluation by pre-feeding) were consistent with the presence of variables that may complicate interpretation of conventional decision-making tasks, and demonstrate how RED appears to minimize such variables.

Apathy is pervasive across many neuropsychiatric disorders but is poorly characterised mechanistically, so targeted therapeutic interventions remain elusive. A key impediment has been the lack of validated assessment tools to facilitate translation of promising findings between preclinical disease models and patients. Apathy is a common symptom in Huntington’s disease. Due to its established genetic basis and the availability of defined animal models, this disease offers a robust translational framework for linking motivated behaviour with underlying neurobiology and an ideal context in which to evaluate a quantitative, translational apathy assessment method. In this study we therefore aimed to demonstrate the validity of using touchscreen-delivered progressive ratio tasks to mirror apathy assessment in Huntington’s disease patients and a representative mouse model. To do this we evaluated Huntington’s disease patients (n=23) and age-matched healthy controls (n=20), and male R6/1 mice (n=23) and wildtype controls (n=29) for apathy-like behaviour using touchscreen-delivered progressive ratio tasks. The primary outcome measure of the assessment was breakpoint, defined as the highest number of touchscreen responses emitted before task engagement ceased. Patients and R6/1 mice were both found to exhibit significantly reduced breakpoints relative to their respective control groups, consistent with apathy-like behaviour. This performance was also not associated with motoric differences in either species. These data demonstrate the utility of touchscreen-delivered progressive ratio tasks in detecting clinically relevant motivational deficits in Huntington’s disease. This approach may offer a platform from which clinically relevant mechanistic insights concerning motivation symptoms can be derived and provide an effective route for translation of promising preclinical findings into viable therapeutic interventions.

Genetic and pharmacological manipulations targeting metabotropic glutamate receptor 5 (mGluR5) affect performance in behavioural paradigms that depend on cognitive flexibility. Many of these studies involved exposing mice to highly stressful conditions including electric foot shocks or water immersion and forced swimming. Because mGluR5 is also implicated in resilience and stress responses, however, apparent impairments in inhibitory learning may have been an artifact of manipulation-induced changes in affective state. To address this, we present here a characterization of cognitive flexibility in mGluR5 knockout (KO) mice conducted with a rodent touchscreen cognitive assessment apparatus in which the animals experience significantly less stress. Our results indicate a significant reversal learning impairment relative to wild-type (WT) controls in the two-choice Visual Discrimination-Reversal (VDR) paradigm. Upon further analysis, we found that this deficit is primarily driven by a prolonged period of perseveration in the early phase of reversal. We also observed a similar perseveration phenotype in the KO mice in the Extinction (EXT) paradigm. In addition, mGluR5 KO mice show higher breakpoints in the touchscreen Progressive Ratio (PR) and altered decision making in the Effort-related Choice (ERC) tasks. Interestingly, this impairment in PR is an additional manifestation of an increased propensity to perseverate on the emission of relatively simplistic behavioural outputs. Together, these findings suggest that under conditions of low stress, mGluR5 KO mice exhibit a pronounced perseverative phenotype that blunts cognitive flexibility.

Disruptions to motivated behaviour are a highly prevalent and severe symptom in a number of neuropsychiatric and neurodegenerative disorders. Current treatment options for these disorders have little or no effect upon motivational impairments. We assessed the contribution of muscarinic acetylcholine receptors to motivated behaviour in mice, as a novel pharmacological target for motivational impairments. Touchscreen progressive ratio (PR) performance was facilitated by the nonselective muscarinic receptor antagonist scopolamine as well as the more subtype-selective antagonists biperiden (M1) and tropicamide (M4). However, scopolamine and tropicamide also produced increases in non-specific activity levels, whereas biperiden did not. A series of control tests suggests the effects of the mAChR antagonists were sensitive to changes in reward value and not driven by changes in satiety, motor fatigue, appetite or perseveration. Subsequently, a sub-effective dose of biperiden was able to facilitate the effects of amphetamine upon PR performance, suggesting an ability to enhance dopaminergic function. Both biperiden and scopolamine were also able to reverse a haloperidol-induced deficit in PR performance, however only biperiden was able to rescue the deficit in effort related choice (ERC) performance. Taken together, these data suggest that the M1 mAChR may be a novel target for the pharmacological enhancement of effort exertion and consequent rescue of motivational impairments. Conversely, M4 receptors may inadvertently modulate effort exertion through regulation of general locomotor activity levels.

The 22q11.2 deletion syndrome (22q11.2DS) confers high risk of neurodevelopmental disorders such as schizophrenia and attention-deficit hyperactivity disorder. These disorders are associated with attentional impairment, the remediation of which is important for successful therapeutic intervention. We assessed a 22q11.2DS mouse model (Df(h22q11)/+) on a touchscreen rodent continuous performance test (rCPT) of attention and executive function that is analogous to human CPT procedures. Relative to wild-type littermates, Df(h22q11)/+ male mice showed impaired attentional performance as shown by decreased correct response ratio (hit rate) and a reduced ability to discriminate target stimuli from non-target stimuli (discrimination sensitivity, or d’). The Df(h22q11)/+ model exhibited decreased prefrontal cortical-hippocampal oscillatory synchrony within multiple frequency ranges during quiet wakefulness, which may represent a biomarker of cognitive dysfunction. The stimulant amphetamine (0-1.0mg/kg, i.p.) dose-dependently improved d’ in Df(h22q11)/+ mice whereas the highest dose of modafinil (40mg/kg, i.p.) exacerbated their d’ impairment. This is the first report to directly implicate attentional impairment in a 22q11.2DS mouse model, mirroring a key endophenotype of the human disorder. The capacity of the rCPT to detect performance impairments in the 22q11.2DS mouse model, and improvement following psychostimulant-treatment, highlights the utility and translational potential of the Df(h22q11)/+ model and this automated behavioral procedure.

Rationale Dysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning. Methods We used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks. Results Specifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback. Conclusions These results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

Several neuropsychiatric and neurodegenerative disorders are characterised by motivational impairments manifested as lack of behavioural activation or energy resulting in significant functional impairment. Given the clinical significance of these symptoms, the study of motivation in preclinical research has recently intensified. This review briefly summarises the tasks that have been implemented for the evaluation of motivation in different species, emphasising the recent use of touchscreen-based rodent testing systems. This methodology has been widely used in the evaluation of multiple cognitive domains emphasising their translational value and flexibility. Recently touchscreen-based versions of classical tasks for the evaluation of motivation have been or are currently being developed and validated, thus facilitating translation from animal to human research and promoting their implementation in clinical contexts.

Reliable and reproducible assessment of animal learning and behavior is a central aim of basic and translational neuroscience research. Recent developments in automated operant chamber technology have led to the possibility of universal standard protocols, in addition to increased translational potential, reliability and accuracy. However, the impact of regional and national differences in the supplies of available reinforcers in this system on behavioural performance and inter-laboratory variability is an unknown and at present uncontrolled variable. Therefore, we aimed to identify which constituent(s) of the reward determines reinforcer strength to enable improved standardization of this parameter across laboratories. Male C57BL/6 mice were examined in the touchscreen-based fixed ratio (FR) and progressive ratio (PR) schedules, reinforced with different kinds of milk-based reinforcers to directly compare the incentive values of plain milk (PM, high-calorie: high-fat/low-sugar), strawberry-flavored milk (SM, high-calorie: low-fat/high-sugar), and semi-skimmed low-fat milk (LM, low-calorie: low-fat/low-sugar) on the basis of differences in caloric content, sugar/fat content, and flavor. Use of a higher caloric content reward was effective in increasing operant training acquisition rate. Total trial number completed in FR and breakpoint in PR were higher using the two isocaloric milk products (PM and SM) than the lower caloric LM, with comparable outcomes between PM and SM conditions, suggesting that total caloric content determines reward strength. Analysis of within-session changes in response rate revealed that overall outputs in FR and PR primarily depend on the response rate at the initial phase of a session, which itself was dependent on reinforcer caloric content. Interestingly, the rate of satiation, indicated by decay in response rate within a FR session, was highest when reinforced with SM, suggesting a rapid satiating effect of sugar. The key contribution

Satiety, rather than all or none, can instead be viewed as a cumulative decrease in the drive to eat that develops over the course of a meal. The nucleus accumbens (NAc) is known to play a critical role in this type of value reappraisal, but the underlying circuits that influence such processes are unclear. Although NAc cholinergic interneurons (CINs) comprise only a small proportion of NAc neurons, their local impact on reward-based processes provides a candidate cell population for investigating the neural underpinnings of satiety. The present research therefore aimed to determine the role of NAc-CINs in motivation for food reinforcers in relation to satiety signaling. Through bi-directional control of CIN activity in mice we show that when motivated by food restriction, increasing CIN activity led to a reduction in palatable food consumption while reducing CIN excitability enhanced food intake. These activity-dependent changes only developed late in the session and were unlikely to be driven by the innate reinforcer strength, suggesting that CIN modulation was instead impacting the cumulative change in motivation underlying satiety signaling. We propose that on a circuit-level, an overall increase in inhibitory tone onto NAc output neurons played a role in the behavioral results, as activating NAc-CINs led to an inhibition of medium spiny neurons that was dependent on nicotinic receptor activation. Our results reveal an important role for NAc-CINs in controlling motivation for food intake and additionally provide a circuit-level framework for investigating the endogenous cholinergic circuits that signal satiety.

Rationale The hippocampus is implicated in many of the cognitive impairments observed in conditions such as Alzheimer’s disease (AD) and schizophrenia (SCZ). Often, mice are the species of choice for models of these diseases and the study of the relationship between brain and behaviour more generally. Thus, automated and efficient hippocampal-sensitive cognitive tests for the mouse are important for developing therapeutic targets for these diseases, and understanding brain-behaviour relationships. One promising option is to adapt the touchscreen-based trial-unique nonmatching-to-location (TUNL) task that has been shown to be sensitive to hippocampal dysfunction in the rat. Objectives This study aims to adapt the TUNL task for use in mice and to test for hippocampus-dependency of the task. Methods TUNL training protocols were altered such that C57BL/6 mice were able to acquire the task. Following acquisition, dysfunction of the dorsal hippocampus (dHp) was induced using a fibre-sparing excitotoxin, and the effects of manipulation of several task parameters were examined. Results Mice could acquire the TUNL task using training optimised for the mouse (experiments 1). TUNL was found to be sensitive to dHp dysfunction in the mouse (experiments 2, 3 and 4). In addition, we observed that performance of dHp dysfunction group was somewhat consistently lower when sample locations were presented in the centre of the screen. Conclusions This study opens up the possibility of testing both mouse and rat models on this flexible and hippocampus-sensitive touchscreen task.

Rationale The CANTAB object-location paired-associate learning (PAL) test can detect cognitive deficits in schizophrenia and Alzheimer’s disease. A rodent version of touch screen PAL (dPAL) has been developed, but the underlying neural mechanisms are not fully understood. Although there is evidence that inactivation of the hippocampus following training leads to impairments in rats, this has not been tested in mice. Furthermore, it is not known whether acquisition, as opposed to performance, of the rodent version depends on the hippocampus. This is critical as many mouse models may have hippocampal dysfunction prior to the onset of task training. Objectives The objectives of this study are to examine the effects of dorsal hippocampal (dHp) dysfunction on both performance and acquisition of mouse dPAL and to determine if hippocampal task sensitivity could be increased using a newly developed context-disambiguated PAL (cdPAL) paradigm. Methods In experiment 1, C57Bl/6 mice received post-acquisition dHp infusions of the GABA agonist muscimol. In experiment 2, C57Bl/6 mice received excitotoxic dHp lesions prior to dPAL/cdPAL acquisition. Results Post-acquisition muscimol dose-dependently impaired dPAL and cdPAL performance. Pre-acquisition dHp lesions had only mild effects on both PAL tasks. Behavioural challenges including addition of objects and degradation of the visual stimuli with noise did not reveal any further impairments. Conclusions dPAL and cdPAL performance is hippocampus-dependent in the mouse, but both tasks can be learned in the absence of a functional dHp.

Rationale Touchscreens are widely used to examine rodent cognition. Current paradigms require animals to view stimuli and nose poke at an appropriate touchscreen location. After responding, there is little screen interaction and, as infra-red touchscreens eliminate the need for physical contact, minimal somatosensory feedback. It is therefore unclear if touchscreens can support the vigorous, repetitive responding required in paradigms like progressive ratio (PR) for assessing motivation and effort-related choice (ERC) for assessing decision-making. Objectives This study aims to adapt and validate PR and ERC for the rodent touchscreen. Methods Male C57Bl/6 mice were trained until responding on PR stabilised. Amphetamine, sulpiride and raclopride were administered via the intraperitoneal route to modify performance. Mice were transferred to ERC and paradigm parameters adjusted to demonstrate behavioural modification. ERC reward preference was assessed by home cage choice analysis. Results PR performance stabilised within seven sessions. Amphetamine (1 mg/kg) increased and raclopride (0.3 mg/kg) decreased performance by 63 and 28 %, respectively, with a 20-min injection-test interval. Sulpiride (50 mg/kg) decreased performance by 19 % following a 40-min injection-test interval. Increasing ERC operant requirements shifted responding from the operant response-dependent preferred reward towards the freely available alternative. Conclusions Vigorous, repetitive responding is sustainable in touchscreen PR and ERC and task validation mirrors non-touchscreen versions. Thus, motivation and reward-related decision-making can be measured directly with touchscreens and can be evaluated prior to cognitive testing in the same apparatus to avoid confounding by motivational factors.

Cerebral small vessel disease (SVD) is a major contributor to stroke, cognitive impairment and dementia with limited therapeutic interventions. There is a critical need to provide mechanistic insight and improve translation between pre-clinical research and the clinic. A 2-day workshop was held which brought together experts from several disciplines in cerebrovascular disease, dementia and cardiovascular biology, to highlight current advances in these fields, explore synergies and scope for development. These proceedings provide a summary of key talks at the workshop with a particular focus on animal models of cerebral vascular disease and dementia, mechanisms and approaches to improve translation. The outcomes of discussion groups on related themes to identify the gaps in knowledge and requirements to advance knowledge are summarized.

Rationale Across species, effort-related motivation can be assessed by testing behaviour under a progressive ratio (PR) schedule of reinforcement. However, to date, PR tasks for rodents have been available using traditional operant response systems only. Objectives Touchscreen operant response systems allow the assessment of behaviour in laboratory rodents, using tasks that share high face validity with the computerised assessments used in humans. Here, we sought to optimise a rat touchscreen variant of PR and validate it by assessing the effects of a number of manipulations known to affect PR performance in non-touchscreen paradigms. Methods Separate groups of male Sprague-Dawley rats were trained on PR schedules with either linear (PR4) or exponential (PREXP) schedules of reinforcement. PR performance was assessed in response to manipulations in reward outcome. Animals were tested under conditions of increased reward magnitude and following reward devaluation through a prefeeding procedure. Subsequently, the effects of systemic administration of the dopamine D2/D3 receptor antagonist raclopride and the psychostimulant d-amphetamine were examined as traditional pharmacological methods for manipulating motivation. Results Rats reinforced under PR4 and PREXP schedules consistently showed differential patterns of response rates within sessions. Furthermore, both PR4 and PREXP schedules were sensitive to suppression by prefeeding or raclopride administration. Performance under both schedules was facilitated by increasing reward magnitude or d-amphetamine administration. Conclusions Taken together, these findings mirror those observed in lever-based PR paradigms in rats. This study therefore demonstrates the successful validation of the rat touchscreen PR task. This will allow for the assessment of motivation in rats, within the same touchscreen apparatus used for the assessment of complex cognitive processes in this species.

Operant testing is a widely used and highly effective method of studying cognition in rodents. Performance on such tasks is sensitive to reinforcer strength. It is therefore advantageous to select effective reinforcers to minimize training times and maximize experimental throughput. To quantitatively investigate the control of behavior by different reinforcers, performance of mice was tested with either strawberry milkshake or a known powerful reinforcer, super saccharin (1.5% or 2% (w/v) saccharin/1.5% (w/v) glucose/water mixture). Mice were tested on fixed (FR)- and progressive-ratio (PR) schedules in the touchscreen-operant testing system. Under an FR schedule, both the rate of responding and number of trials completed were higher in animals responding for strawberry milkshake versus super saccharin. Under a PR schedule, mice were willing to emit similar numbers of responses for strawberry milkshake and super saccharin; however, analysis of the rate of responding revealed a significantly higher rate of responding by animals reinforced with milkshake versus super saccharin. To determine the impact of reinforcer strength on cognitive performance, strawberry milkshake and super saccharin-reinforced animals were compared on a touchscreen visual discrimination task. Animals reinforced by strawberry milkshake were significantly faster to acquire the discrimination than animals reinforced by super saccharin. Taken together, these results suggest that strawberry milkshake is superior to super saccharin for operant behavioral testing and further confirms that the application of response rate analysis to multiple ratio tasks is a highly sensitive method for the detection of behavioral differences relevant to learning and motivation.

Despite considerable advances in both in silico and in vitro approaches, in vivo studies that involve animal model systems remain necessary in many research disciplines. Neuroscience is one such area, with studies often requiring access to a complete nervous system capable of dynamically selecting between and then executing a full range of cognitive and behavioural outputs in response to a given stimulus or other manipulation. The involvement of animals in research studies is an issue of active public debate and concern and is therefore carefully regulated. Such regulations are based on the principles of the 3Rs of Replacement, Reduction and Refinement. In the sub-specialty of behavioural neuroscience, Full/Absolute Replacement remains a major challenge, as the complete ex vivo recapitulation of a system as complex and dynamic as the nervous system has yet to be achieved. However, a number of very positive developments have occurred in this area with respect to Relative Replacement and to both Refinement and Reduction. In this Review, we discuss the Refinement- and Reduction-related benefits yielded by the introduction of touchscreen-based behavioural assessment apparatus. We also discuss how data generated by a specific panel of behavioural tasks developed for this platform might substantially enhance monitoring of laboratory animal welfare and provide robust, quantitative comparisons of husbandry techniques to define and ensure maintenance of best practice.

This review is concerned with methods for assessing the processing of unrewarded responses in experimental animals and the mechanisms underlying performance of these tasks. A number of clinical populations, including Parkinson’s disease, depression, compulsive disorders, and schizophrenia demonstrate either abnormal processing or learning from non-rewarded responses in laboratory-based reinforcement learning tasks. These effects are hypothesized to result from disturbances in modulatory neurotransmitter systems, including dopamine and serotonin. Parallel work in experimental animals has revealed consistent behavioral patterns associated with non-reward and, consistent with the human literature, modulatory roles for specific neurotransmitters. Classical tests involving an important reward omission component include appetitive extinction, ratio schedules of responding, reversal learning, and delay and probability discounting procedures. In addition, innovative behavioral tests have recently been developed leverage probabilistic feedback to specifically assay accommodation of, and learning from, non-rewarded responses. These procedures will be described and reviewed with discussion of the behavioral and neural determinants of performance. A final section focusses specifically on the benefits of trial-by-trial analysis of responding during such tasks, and the implications of such analyses for the translation of findings to clinical studies.

Perseveration and apathy are two of the most common behavioural and psychological symptoms of dementia (BPSDs) in amyotrophic lateral sclerosis–frontotemporal dementia (ALS–FTD). Availability of a validated and behaviourally characterised animal model is crucial for translational research into BPSD in the FTD context. We behaviourally evaluated the male TDP-43Q331K mouse, an ALS–FTD model with a human-equivalent mutation (TDP-43Q331K) knocked into the endogenous Tardbp gene. We utilised a panel of behavioural tasks delivered using the rodent touchscreen apparatus, including progressive ratio (PR), extinction and visual discrimination/reversal learning (VDR) assays to examine motivation, response inhibition and cognitive flexibility, respectively. Relative to WT littermates, TDP-43Q331K mice exhibited increased responding under a PR schedule. While elevated PR responding is typically an indication of increased motivation for reward, a trial-by-trial response rate analysis revealed that TDP-43Q331K mice exhibited decreased maximal response rate and slower response decay rate, suggestive of reduced motivation and a perseverative behavioural phenotype, respectively. In the extinction assay, TDP-43Q331K mice displayed increased omissions during the early phase of each session, consistent with a deficit in activational motivation. Finally, the VDR task revealed cognitive inflexibility, manifesting as stimulus-bound perseveration. Together, our data indicate that male TDP-43Q331K mice exhibit a perseverative phenotype with some evidence of apathy-like behaviour, similar to BPSDs observed in human ALS–FTD patients. The TDP-43Q331K knock-in mouse therefore has features that recommend it as a useful platform to facilitate translational research into behavioural symptoms in the context of ALS–FTD.

Cerebral small vessel disease (SVD) is a major contributor to stroke, cognitive impairment and dementia with limited therapeutic interventions. There is a critical need to provide mechanistic insight and improve translation between pre-clinical research and the clinic. A 2-day workshop was held which brought together experts from several disciplines in cerebrovascular disease, dementia and cardiovascular biology, to highlight current advances in these fields, explore synergies and scope for development. These proceedings provide a summary of key talks at the workshop with a particular focus on animal models of cerebral vascular disease and dementia, mechanisms and approaches to improve translation. The outcomes of discussion groups on related themes to identify the gaps in knowledge and requirements to advance knowledge are summarized.

Cerebral small vessel disease (SVD) is a major contributor to stroke, cognitive impairment and dementia with limited therapeutic interventions. There is a critical need to provide mechanistic insight and improve translation between pre-clinical research and the clinic. A 2-day workshop was held which brought together experts from several disciplines in cerebrovascular disease, dementia and cardiovascular biology, to highlight current advances in these fields, explore synergies and scope for development. These proceedings provide a summary of key talks at the workshop with a particular focus on animal models of cerebral vascular disease and dementia, mechanisms and approaches to improve translation. The outcomes of discussion groups on related themes to identify the gaps in knowledge and requirements to advance knowledge are summarized.