Search

Foraging animals have to evaluate, compare and select food patches in order to increase their fitness. Understanding what drives foraging decisions requires careful manipulation of the value of alternative options while monitoring animals choices. Value-based decision-making tasks in combination with formal learning models have provided both an experimental and theoretical framework to study foraging decisions in lab settings. While these approaches were successfully used in the past to understand what drives choices in mammals, very little work has been done on fruit flies. This is despite the fact that fruit flies have served as model organism for many complex behavioural paradigms. To fill this gap we developed a single-animal, trial-based decision making task, where freely walking flies experienced optogenetic sugar-receptor neuron stimulation. We controlled the value of available options by manipulating the probabilities of optogenetic stimulation. We show that flies integrate reward history of chosen options and forget value of unchosen options. We further discover that flies assign higher values to rewards experienced early in the behavioural session, consistent with formal reinforcement learning models. Finally, we also show that the probabilistic rewards affect walking trajectories of flies, suggesting that accumulated value is controlling the navigation vector of flies in a graded fashion. These findings establish the fruit fly as a model organism to explore the genetic and circuit basis of reward foraging decisions.

Experiments aiming to understand sensory-motor systems, cognition and behavior often require animals trained to perform complex tasks. Traditional training protocols require lab personnel to move the animals between home cages and training chambers, to start and end training sessions, and in some cases, to hand-control each training trial. Human labor not only limits the amount of training per day, but also introduces several sources of variability and may increase animal stress. Here we present an automated training system for the 5-choice serial reaction time task (5CSRTT), a classic rodent task often used to test sensory detection, sustained attention and impulsivity. We found that fully automated training without human intervention greatly increased the speed and efficiency of learning, and decreased stress as measured by corticosterone levels. Introducing training breaks did not cancel these beneficial effects of automated training, and mice readily generalized across training systems when transferred from automated to manual protocols. Additionally, we validated our automated training system with mice implanted with wireless optogenetic stimulators, expanding the breadth of experimental needs our system may fulfill. Our automated 5CSRTT system can serve as a prototype for fully automated behavioral training, with methods and principles transferrable to a range of rodent tasks.

Organisms have evolved diverse behavioural strategies that enhance the likelihood of encountering and assessing mates1. Many species use pheromones to communicate information about the location, sexual and social status of potential partners2. In mice, the major urinary protein darcin—which is present in the urine of males—provides a component of a scent mark that elicits approach by females and drives learning3,4. Here we show that darcin elicits a complex and variable behavioural repertoire that consists of attraction, ultrasonic vocalization and urinary scent marking, and also serves as a reinforcer in learning paradigms. We identify a genetically determined circuit—extending from the accessory olfactory bulb to the posterior medial amygdala—that is necessary for all behavioural responses to darcin. Moreover, optical activation of darcin-responsive neurons in the medial amygdala induces both the innate and the conditioned behaviours elicited by the pheromone. These neurons define a topographically segregated population that expresses neuronal nitric oxide synthase. We suggest that this darcin-activated neural circuit integrates pheromonal information with internal state to elicit both variable innate behaviours and reinforced behaviours that may promote mate encounters and mate selection. A neural circuit activated by the male pheromone, darcin, mediates a complex and variable array of innate and reinforced behaviours that may promote mate encounters and mate selection.

Progress in science requires standardized assays whose results can be readily shared, compared, and reproduced across laboratories. Reproducibility, however, has been a concern in neuroscience, particularly for measurements of mouse behavior. Here, we show that a standardized task to probe decision-making in mice produces reproducible results across multiple laboratories. We adopted a task for head-fixed mice that assays perceptual and value-based decision making, and we standardized training protocol and experimental hardware, software, and procedures. We trained 140 mice across seven laboratories in three countries, and we collected 5 million mouse choices into a publicly available database. Learning speed was variable across mice and laboratories, but once training was complete there were no significant differences in behavior across laboratories. Mice in different laboratories adopted similar reliance on visual stimuli, on past successes and failures, and on estimates of stimulus prior probability to guide their choices. These results reveal that a complex mouse behavior can be reproduced across multiple laboratories. They establish a standard for reproducible rodent behavior, and provide an unprecedented dataset and open-access tools to study decision-making in mice. More generally, they indicate a path toward achieving reproducibility in neuroscience through collaborative open-science approaches., eLife digest In science, it is of vital importance that multiple studies corroborate the same result. Researchers therefore need to know all the details of previous experiments in order to implement the procedures as exactly as possible. However, this is becoming a major problem in neuroscience, as animal studies of behavior have proven to be hard to reproduce, and most experiments are never replicated by other laboratories. Mice are increasingly being used to study the neural mechanisms of decision making, taking advantage of the genetic, imaging and physiological tools that are available for mouse brains. Yet, the lack of standardized behavioral assays is leading to inconsistent results between laboratories. This makes it challenging to carry out large-scale collaborations which have led to massive breakthroughs in other fields such as physics and genetics. To help make these studies more reproducible, the International Brain Laboratory (a collaborative research group) et al. developed a standardized approach for investigating decision making in mice that incorporates every step of the process; from the training protocol to the software used to analyze the data. In the experiment, mice were shown images with different contrast and had to indicate, using a steering wheel, whether it appeared on their right or left. The mice then received a drop of sugar water for every correction decision. When the image contrast was high, mice could rely on their vision. However, when the image contrast was very low or zero, they needed to consider the information of previous trials and choose the side that had recently appeared more frequently. This method was used to train 140 mice in seven laboratories from three different countries. The results showed that learning speed was different across mice and laboratories, but once training was complete the mice behaved consistently, relying on visual stimuli or experiences to guide their choices in a similar way. These results show that complex behaviors in mice can be reproduced across multiple laboratories, providing an unprecedented dataset and open-access tools for studying decision making. This work could serve as a foundation for other groups, paving the way to a more collaborative approach in the field of neuroscience that could help to tackle complex research challenges.

Animals often navigate environments that are uncertain, volatile and complex, making it challenging to locate reliable food sources. Therefore, it is not surprising that many species evolved multiple, parallel and complementary foraging strategies to survive. Current research on animal behavior is largely driven by a reductionist approach and attempts to study one particular aspect of behavior in isolation. This is justified by the huge success of past and current research in understanding neural circuit mechanisms of behaviors. But focusing on only one aspect of behaviors obscures their inherent multidimensional nature. To fill this gap we aimed to identify and characterize distinct behavioral modules using a simple reward foraging assay. For this we developed a single-animal, trial-based probabilistic foraging task, where freely walking fruit flies experience optogenetic sugar-receptor neuron stimulation. By carefully analyzing the walking trajectories of flies, we were able to dissect the animals foraging decisions into multiple underlying systems. We show that flies perform local searches, cue-based navigation and learn task relevant contingencies. Using probabilistic reward delivery allowed us to bid several competing reinforcement learning (RL) models against each other. We discover that flies accumulate chosen option values, forget unchosen option values and seek novelty. We further show that distinct behavioral modules -learning and navigation-based systems-cooperate, suggesting that reinforcement learning in flies operates on dimensionality reduced representations. We therefore argue that animals will apply combinations of multiple behavioral strategies to generate foraging decisions.

Summary Human confidence judgments are thought to originate from metacognitive processes that provide a subjective assessment about one's beliefs. Alternatively, confidence is framed in mathematics as an objective statistical quantity: the probability that a chosen hypothesis is correct. Despite similar terminology, it remains unclear whether the subjective feeling of confidence is related to the objective, statistical computation of confidence. To address this, we collected confidence reports from humans performing perceptual and knowledge-based psychometric decision tasks. We observed two counterintuitive patterns relating confidence to choice and evidence: apparent overconfidence in choices based on uninformative evidence, and decreasing confidence with increasing evidence strength for erroneous choices. We show that these patterns lawfully arise from statistical confidence, and therefore occur even for perfectly calibrated confidence measures. Furthermore, statistical confidence quantitatively accounted for human confidence in our tasks without necessitating heuristic operations. Accordingly, we suggest that the human feeling of confidence originates from a mental computation of statistical confidence.

Microscopes play a central role in hands-on science exploration and communication. All too often, however, students do not have a good understanding of the optical principles that govern microscopy and lack access to instruments that could help them build that understanding. Here we present an open-source Do-It-Yourself (DIY) microscope kit developed by scientists and students at BioBus, a nonprofit organization for science outreach and education based in New York City (www.biobus.org). The DIY microscope uses 3D printing to make highly adaptable optical technology readily available to educators at a low cost. Its modular configuration makes it the perfect tool to teach optical design to students of all ages. At BioBus, Inc., over 230 school-age students and teachers learned basic optics and microscope building with the DIY microscope at our community and mobile laboratories. We further present examples of how the DIY microscope was used as a platform for student-driven projects, expanding the original design to include advanced optical features such as fluorescence and infrared imaging. The images, acquired with a low cost camera, were comparable in quality to those taken using professional grade laboratory microscopes. The use of the DIY microscope is not limited to applications in physical sciences, but can also be used as an interdisciplinary teaching tool. As an example, we showed how it was configured into a functional model of the eye, to explain the physics of vision and the pathophysiology of eye disorders, such as far and short-sightedness, and age-related macular degeneration.

Organisms have evolved diverse behavioural strategies that enhance the likelihood of encountering and assessing mates

In the mammalian cerebral cortex the diversity of interneuronal subtypes underlies a division of labour subserving distinct modes of inhibitory control. A unique mode of inhibitory control may be provided by inhibitory neurons that specifically suppress the firing of other inhibitory neurons. Such disinhibition could lead to the selective amplification of local processing and serve the important computational functions of gating and gain modulation. Although several interneuron populations are known to target other interneurons to varying degrees, little is known about interneurons specializing in disinhibition and their in vivo function. Here we show that a class of interneurons that express vasoactive intestinal polypeptide (VIP) mediates disinhibitory control in multiple areas of neocortex and is recruited by reinforcement signals. By combining optogenetic activation with single-cell recordings, we examined the functional role of VIP interneurons in awake mice, and investigated the underlying circuit mechanisms in vitro in auditory and medial prefrontal cortices. We identified a basic disinhibitory circuit module in which activation of VIP interneurons transiently suppresses primarily somatostatin- and a fraction of parvalbumin-expressing inhibitory interneurons that specialize in the control of the input and output of principal cells, respectively. During the performance of an auditory discrimination task, reinforcement signals (reward and punishment) strongly and uniformly activated VIP neurons in auditory cortex, and in turn VIP recruitment increased the gain of a functional subpopulation of principal neurons. These results reveal a specific cell type and microcircuit underlying disinhibitory control in cortex and demonstrate that it is activated under specific behavioural conditions.

The mouse is an important model system for investigating the neural circuits mediating behavior. Because of advances in imaging and optogenetic methods, head-fixed mouse preparations provide an unparalleled opportunity to observe and control neural circuits. To investigate how neural circuits produce behavior, these methods need to be paired with equally well-controlled and monitored behavioral paradigms. Here, we introduce the choice ball, a response device that enables two-alternative forced-choice (2AFC) tasks in head-fixed mice based on the readout of lateral paw movements. We demonstrate the advantages of the choice ball by training mice in the random-click task, a two-choice auditory discrimination behavior. For each trial, mice listened to binaural streams of Poisson-distributed clicks and were required to roll the choice ball laterally toward the side with the greater click rate. In this assay, mice performed hundreds of trials per session with accuracy ranging from 95% for easy stimuli (large interaural click-rate contrast) to near chance level for low-contrast stimuli. We also show, using the record of individual paw strokes, that mice often reverse decisions they have already initiated and that decision reversals correlate with improved performance. The choice ball enables head-fixed 2AFC paradigms, facilitating the circuit-level analysis of sensory processing, decision making, and motor control in mice.

Decision confidence is a forecast about the probability that a decision will be correct. From a statistical perspective, decision confidence can be defined as the Bayesian posterior probability that the chosen option is correct based on the evidence contributing to it. Here, we used this formal definition as a starting point to develop a normative statistical framework for decision confidence. Our goal was to make general predictions that do not depend on the structure of the noise or a specific algorithm for estimating confidence. We analytically proved several interrelations between statistical decision confidence and observable decision measures, such as evidence discriminability, choice, and accuracy. These interrelationships specify necessary signatures of decision confidence in terms of externally quantifiable variables that can be empirically tested. Our results lay the foundations for a mathematically rigorous treatment of decision confidence that can lead to a common framework for understanding confidence across different research domains, from human and animal behavior to neural representations.

Precisely timed experimental manipulations of the brain and its sensory environment are often employed to reveal principles of brain function. While complex and reliable pulse trains for temporal stimulus control can be generated with commercial instruments, contemporary options remain expensive and proprietary. We have developed Pulse Pal, an open source device that allows users to create and trigger software-defined trains of voltage pulses with high temporal precision. Here we describe Pulse Pal’s circuitry and firmware, and characterize its precision and reliability. In addition, we supply online documentation with instructions for assembling, testing and installing Pulse Pal. While the device can be operated as a stand-alone instrument, we also provide application programming interfaces in several programming languages. As an inexpensive, flexible and open solution for temporal control, we anticipate that Pulse Pal will be used to address a wide range of instrumentation timing challenges in neuroscience research.

Experiments aiming to understand sensory-motor systems, cognition and behavior necessitate training animals to perform complex tasks. Traditional training protocols require lab personnel to move the animals between home cages and training chambers, to start and end training sessions, and in some cases, to hand-control each training trial. Human labor not only limits the amount of training per day, but also introduces several sources of variability and may increase animal stress. Here we present an automated training system for the 5-choice serial reaction time task (5CSRTT), a classic rodent task often used to test sensory detection, sustained attention and impulsivity. We found that full automation without human intervention allowed rapid, cost-efficient training, and decreased stress as measured by corticosterone levels. Training breaks introduced only a transient drop in performance, and mice readily generalized across training systems when transferred from automated to manual protocols. We further validated our automated training system with wireless optogenetics and pharmacology experiments, expanding the breadth of experimental needs our system may fulfill. Our automated 5CSRTT system can serve as a prototype for fully automated behavioral training, with methods and principles transferrable to a range of rodent tasks.