Search

Reinforcement signals such as food reward and noxious punishment can change diverse behaviors. This holds true in fruit flies, Drosophila melanogaster, which can be conditioned by an odor a...

Regulation of reward signaling in the brain is critical for appropriate judgement of the environment and self. In Drosophila, the protocerebral anterior medial (PAM) cluster dopamine neurons mediate reward signals. Here, we show that localized inhibitory input to the presynaptic terminals of the PAM neurons titrates olfactory reward memory and controls memory specificity. The inhibitory regulation was mediated by metabotropic gamma-aminobutyric acid (GABA) receptors clustered in presynaptic microdomain of the PAM boutons. Cell type-specific silencing the GABA receptors enhanced memory by augmenting internal reward signals. Strikingly, the disruption of GABA signaling reduced memory specificity to the rewarded odor by changing local odor representations in the presynaptic terminals of the PAM neurons. The inhibitory microcircuit of the dopamine neurons is thus crucial for both reward values and memory specificity. Maladaptive presynaptic regulation causes optimistic cognitive bias.

Summary The mushroom body (MB) of Drosophila melanogaster has multiple functions in controlling memory and behavior. 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 However, circuit mechanisms that generate this functional diversity are largely unclear. Here, we systematically probed the behavioral contribution of each type of MB output neuron (MBON) by blocking during acquisition, retention, or retrieval of reward or punishment memories. We evaluated the contribution using two conditioned responses: memory-guided odor choice and odor source attraction. Quantitative analysis revealed that these conditioned odor responses are controlled by different sets of MBONs. We found that the valence of memory, rather than the transition of memory steps, has a larger impact on the patterns of required MBONs. Moreover, we found that the glutamatergic MBONs forming recurrent circuits commonly contribute to appetitive memory acquisition, suggesting a pivotal role of this circuit motif for reward processing. Our results provide principles how the MB output circuit processes associative memories of different valence and controls distinct memory-guided behaviors.

Summary: Neurotransmitters often have multiple receptors that induce distinct responses in receiving cells. Expression and localization of neurotransmitter receptors in individual neurons are therefore critical for understanding the operation of neural circuits. Here we describe a comprehensive library of reporter strains in which a convertible T2A-GAL4 cassette is inserted into endogenous neurotransmitter receptor genes of Drosophila. Using this library, we profile the expression of 75 neurotransmitter receptors in the brain. Cluster analysis reveals neurochemical segmentation of the brain, distinguishing higher brain centers from the rest. By recombinase-mediated cassette exchange, we convert T2A-GAL4 into split-GFP and Tango to visualize subcellular localization and activation of dopamine receptors in specific cell types. This reveals striking differences in their subcellular localization, which may underlie the distinct cellular responses to dopamine in different behavioral contexts. Our resources thus provide a versatile toolkit for dissecting the cellular organization and function of neurotransmitter systems in the fly brain. : Kondo et al. have generated a comprehensive library of convertible GAL4 knockin Drosophila strains for neurotransmitter receptor genes. The GAL4 lines can be converted into other reporters through the use of RMCE, providing a versatile toolkit. Expression profiling of receptor genes reveals neurochemical segmentation of the brain.

The mushroom body (MB) in insects is known as a major center for associative learning and memory, although exact locations for the correlating memory traces remain to be elucidated. Here, we asked whether presynaptic boutons of olfactory projection neurons (PNs) in the main input site of the MB undergo neuronal plasticity during classical odor-reward conditioning and correlate with the conditioned behavior. We simultaneously measured Ca2+responses in the boutons and conditioned behavioral responses to learned odors in honeybees. We found that the absolute amount of the neural change for the rewarded but not for the unrewarded odor was correlated with the behavioral learning rate across individuals. The temporal profile of the induced changes matched with odor response dynamics of the MB-associated inhibitory neurons, suggestive of activity modulation of boutons by this neural class. We hypothesize the circuit-specific neural plasticity relates to the learned value of the stimulus and underlies the conditioned behavior of the bees.

Dopamine modulates a variety of animal behaviors that range from sleep and learning to courtship and aggression. Besides its well-known phasic firing to natural reward, a substantial number of dopamine neurons (DANs) are known to exhibit ongoing intrinsic activity in the absence of an external stimulus. While accumulating evidence points at functional implications for these intrinsic “spontaneous activities” of DANs in cognitive processes, a causal link to behavior and its underlying mechanisms has yet to be elucidated. Recent physiological studies in the model organism Drosophila melanogaster have uncovered that DANs in the fly brain are also spontaneously active, and that this activity reflects the behavioral/internal states of the animal. Strikingly, genetic manipulation of basal DAN activity resulted in behavioral alterations in the fly, providing critical evidence that links spontaneous DAN activity to behavioral states. Furthermore, circuit-level analyses have started to reveal cellular and molecular mechanisms that mediate or regulate spontaneous DAN activity. Through reviewing recent findings in different animals with the major focus on flies, we will discuss potential roles of this physiological phenomenon in directing animal behaviors.

Summary Background Drosophila learn to avoid odors that are paired with aversive stimuli. Electric shock is a potent aversive stimulus that acts via dopamine neurons to elicit avoidance of the associated odor. While dopamine signaling has been demonstrated to mediate olfactory electric shock conditioning, it remains unclear how this pathway is involved in other types of behavioral reinforcement, such as in learned avoidance of odors paired with increased temperature. Results To better understand the neural mechanisms of distinct aversive reinforcement signals, we here established an olfactory temperature conditioning assay comparable to olfactory electric shock conditioning. We show that the AC neurons, which are internal thermal receptors expressing dTrpA1, are selectively required for odor-temperature but not for odor-shock memory. Furthermore, these separate sensory pathways for increased temperature and shock converge onto overlapping populations of dopamine neurons that signal aversive reinforcement. Temperature conditioning appears to require a subset of the dopamine neurons required for electric shock conditioning. Conclusions We conclude that dopamine neurons integrate different noxious signals into a general aversive reinforcement pathway.

Massive activation of dopamine neurons is critical for natural reward and drug abuse. In contrast, the significance of their spontaneous activity remains elusive. In Drosophila melanogaster, depolarization of the protocerebral anterior medial (PAM) cluster dopamine neurons en masse signals reward to the mushroom body (MB) and drives appetitive memory. Focusing on the functional heterogeneity of PAM cluster neurons, we identified that a single class of PAM neurons, PAM-γ3, mediates sugar reward by suppressing their own activity. PAM-γ3 is selectively required for appetitive olfactory learning, while activation of these neurons in turn induces aversive memory. Ongoing activity of PAM-γ3 gets suppressed upon sugar ingestion. Strikingly, transient inactivation of basal PAM-γ3 activity can substitute for reward and induces appetitive memory. Furthermore, we identified the satiety-signaling neuropeptide Allatostatin A (AstA) as a key mediator that conveys inhibitory input onto PAM-γ3. Our results suggest the significance of basal dopamine release in reward signaling and reveal a circuit mechanism for negative regulation., Author Summary Dopamine neurons in the midbrain of mammals fire action potentials in response to rewarding stimuli, while punitive stimuli or omission of reward suppress their activity. Different signs in the activity of dopamine neurons thus can encode appetitive and aversive values; however, how these bidirectional activities directly relate to behavior has yet to be elucidated. In fruit flies Drosophila, en masse activation of dopaminergic neurons in the protocerebral anterior medial (PAM) cluster has been shown to signal reward. Here, we demonstrate that a specific sub-class of these dopaminergic neurons, called PAM-γ3, mediates both aversive and appetitive reinforcement through activation and suppression of their activity, respectively. Notably, transient inactivation of the basal activity of PAM-γ3 neurons substitutes for reward and induces appetitive memory formation. Interestingly, we found that Allatostatin A, a neuropeptide that signals satiety, conveys inhibitory input onto PAM-γ3 neurons. Our results highlight the bidirectional activity of defined dopaminergic neurons, which underlies encoding of behaviorally relevant appetitive and aversive values., Transient suppression of a specific subset of dopamine neurons signals reward in the fruit fly Drosophila, suggesting that basal dopamine activity underlies behaviorally relevant valence coding.

Dopaminergic neurons serve multiple functions, including reinforcement processing during associative learning [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11 and 12]. It is thus warranted to understand which dopaminergic neurons mediate which function. We study larval Drosophila, in which only approximately 120 of a total of 10,000 neurons are dopaminergic, as judged by the expression of tyrosine hydroxylase (TH), the rate- limiting enzyme of dopamine biosynthesis [ 5 and 13]. Dopaminergic neurons mediating reinforcement in insect olfactory learning target the mushroom bodies, a higher-order “cortical” brain region [ 1, 2, 3, 4, 5, 11, 12, 14 and 15]. We discover four previously undescribed paired neurons, the primary protocerebral anterior medial (pPAM) neurons. These neurons are TH positive and subdivide the medial lobe of the mushroom body into four distinct subunits. These pPAM neurons are acutely necessary for odor-sugar reward learning and require intact TH function in this process. However, they are dispensable for aversive learning and innate behavior toward the odors and sugars employed. Optogenetical activation of pPAM neurons is sufficient as a reward. Thus, the pPAM neurons convey a likely dopaminergic reward signal. In contrast, DL1 cluster neurons convey a corresponding punishment signal [5], suggesting a cellular division of labor to convey dopaminergic reward and punishment signals. On the level of individually identified neurons, this uncovers an organizational principle shared with adult Drosophila and mammals [ 1, 2, 3, 4, 7, 9 and 10] (but see [6]). The numerical simplicity and connectomic tractability of the larval nervous system [ 16, 17, 18 and 19] now offers a prospect for studying circuit principles of dopamine function at unprecedented resolution.

Animals approach stimuli that predict a pleasant outcome. After the paired presentation of an odour and a reward, Drosophila melanogaster can develop a conditioned approach towards that odour. Despite recent advances in understanding the neural circuits for associative memory and appetitive motivation, the cellular mechanisms for reward processing in the fly brain are unknown. Here we show that a group of dopamine neurons in the protocerebral anterior medial (PAM) cluster signals sugar reward by transient activation and inactivation of target neurons in intact behaving flies. These dopamine neurons are selectively required for the reinforcing property of, but not a reflexive response to, the sugar stimulus. In vivo calcium imaging revealed that these neurons are activated by sugar ingestion and the activation is increased on starvation. The output sites of the PAM neurons are mainly localized to the medial lobes of the mushroom bodies (MBs), where appetitive olfactory associative memory is formed. We therefore propose that the PAM cluster neurons endow a positive predictive value to the odour in the MBs. Dopamine in insects is known to mediate aversive reinforcement signals. Our results highlight the cellular specificity underlying the various roles of dopamine and the importance of spatially segregated local circuits within the MBs.

Social insects like ants exhibit sophisticated communication by means of pheromones, one example of which is the use of alarm pheromones to alert nestmates for colony defense. In the ant Camponotus obscuripes, we have reported that information about formic acid and n-undecane, alarm pheromone components, is processed in a set of specific glomeruli in the antennal lobe (primary olfactory center). Alarm pheromone signals are then transmitted, mainly via uniglomerular projection neurons (uni-PNs), to the protocerebrum (PR), where sensory signals are integrated to form motor commands for behavioral responses. In this study, we physiologically and morphologically characterized 63 alarm pheromone-sensitive PR neurons in ants by using intracellular recording and staining techniques. Most of the pheromone-sensitive PR neurons had dendrites in the mushroom body (MB), the lateral horn, or the medial PR. Some neurons with dendrites in these areas responded specifically to formic acid or n-undecane and may participate in the control of specific behavioral responses to each pheromone component. Other neurons responded also to non-pheromonal odors, in contrast to uni-PNs, most of which responded specifically to alarm pheromones. Responses to non-pheromonal odors were most prominent in efferent neurons of the MB lobe, suggesting that they may participate in integration of pheromonal and non-pheromonal information. We found a class of PR neurons that receives input in all of these pheromone-processing areas and terminates in a variety of premotor areas. These neurons may participate in the control of pheromone-sensitized aggressive behavior, which is triggered by non-pheromonal sensory stimuli associated with a potential enemy.

Dopamine signals reward in animal brains. A single presentation of a sugar reward to Drosophila activates distinct subsets of dopamine neurons that independently induce short- and long-term olfactory memories (STM and LTM, respectively). In this study, we show that a recurrent reward circuit underlies the formation and consolidation of LTM. This feedback circuit is composed of a single class of reward-signaling dopamine neurons (PAM-α1) projecting to a restricted region of the mushroom body (MB), and a specific MB output cell type, MBON-α1, whose dendrites arborize that same MB compartment. Both MBON-α1 and PAM-α1 neurons are required during the acquisition and consolidation of appetitive LTM. MBON-α1 additionally mediates the retrieval of LTM, which is dependent on the dopamine receptor signaling in the MB α/β neurons. Our results suggest that a reward signal transforms a nascent memory trace into a stable LTM using a feedback circuit at the cost of memory specificity. DOI: http://dx.doi.org/10.7554/eLife.10719.001, eLife digest An animal that finds particularly nutritious and palatable food will often develop a long-lasting memory—even if they experience that event only once. One example of this is the ability of the fruit fly Drosophila to form a long-term association between a sugar reward and a specific odor that was present when they received the reward. The consumption of sugar triggers the release of a chemical called dopamine on specific compartments of a brain structure called the mushroom body. Dopamine then acts to modify the connection between cells called “Kenyon cells”, which encode specific odors, and the neurons that send signals out from the mushroom body (called MBONs). The result is the formation of a memory that links the odor with the reward. However, little is known about how this process differs for long-term vs. short-term memories, and how it can occur when the fly has experienced the odor and reward together on only a single occasion. To find out, Ichinose et al. combined behavioral testing of fruit flies with genetics. The results confirmed that the dopamine neurons and the MBONs that project to a single compartment of the mushroom body, called α1, are both required for the formation of long-term odor-reward memories, but not their short-term equivalents. These neurons are called PAM-α1 and MBON-α1, respectively. Unexpectedly, anatomical data revealed that PAM-α1 dopamine neurons receive input from MBON-α1; that is, long-term memory formation involves a feedback circuit: from PAM-α1 to Kenyon cells, then to MBON-α1 and back to PAM-α1. Blocking feedback from the MBON-α1 onto the PAM-α1 neurons shortly after odor-reward training disrupted long-term memory formation. Conversely, blocking feedback at a later stage did not. This suggests that prolonged activation of PAM-α1 by MBON-α1 helps to strengthen newly established memories, converting them into memories that will last for a long time. The discovery of a specific circuit that supports long-term, but not short-term, memory formation in fruit flies is consistent with evidence of distinct mechanisms underlying these processes in mammals. Further work is now required to determine whether feedback circuits similar to those in fruit flies also contribute to reward-based learning in other animals. DOI: http://dx.doi.org/10.7554/eLife.10719.002

Tremendous evolutional success and the ecological dominance of social insects, including ants, termites and social bees, are due to their efficient social organizations and their underlying communication systems. Functional division into reproductive and sterile castes, cooperation in defending the nest, rearing the young and gathering food are all regulated by communication by means of various kinds of pheromones. No brain structures specifically involved in the processing of non-sexual pheromone have been physiologically identified in any social insects. By use of intracellular recording and staining techniques, we studied responses of projection neurons of the antennal lobe (primary olfactory centre) of ants to alarm pheromone, which plays predominant roles in colony defence. Among 23 alarm pheromone-sensitive projection neurons recorded and stained in this study, eight were uniglomerular projection neurons with dendrites in one glomerulus, a structural unit of the antennal lobe, and the remaining 15 were multiglomerular projection neurons with dendrites in multiple glomeruli. Notably, all alarm pheromone-sensitive uniglomerular projection neurons had dendrites in one of five ‘alarm pheromone-sensitive (AS)’ glomeruli that form a cluster in the dorsalmost part of the antennal lobe. All alarm pheromone-sensitive multiglomerular projection neurons had dendrites in some of the AS glomeruli as well as in glomeruli in the anterodorsal area of the antennal lobe. The results suggest that components of alarm pheromone are processed in a specific cluster of glomeruli in the antennal lobe of ants.

Communication by means of pheromones plays predominant roles in colony integration by social insects. However, almost nothing is known about pheromone processing in the brains of social insects. In this study, we successfully applied intracellular recording and staining techniques to anatomically and physiologically characterize brain neurons of the ant Camponotus obscuripes. We identified 42 protocerebral neurons that responded to undecane and/or formic acid, components of alarm pheromones that evoke attraction or evasive behavior, respectively. Notably, 30 (71%) of these neurons were efferent (output) or feedback neurons of the mushroom body, and many of these exhibited different responses to formic acid and undecane. Eight of the remaining 12 neurons had arborizations in the lateral and/or medial protocerebrum, which receive terminations of efferent neurons of the mushroom body and from which premotor descending neurons originate. The remaining four neurons were bilateral neurons that connect lateral accessory lobes or dorsal protocerebrums of both hemispheres. We suggest that the mushroom body of the ant participates in the processing of alarm pheromones. Seventeen (40%) of 42 neurons exhibited responses to nonpheromonal odors, indicating that the pheromonal and nonpheromonal signals are not fully segregated when they are processed in the protocerebrum. This may be related to modulatory functions of alarm pheromones, i.e., they change alertness of the ant and change responses to a variety of sensory stimuli.

Drosophila melanogaster can acquire a stable appetitive olfactory memory when the presentation of a sugar reward and an odor are paired. However, the neuronal mechanisms by which a single training induces long-term memory are poorly understood. Here we show that two distinct subsets of dopamine neurons in the fly brain signal reward for short-term (STM) and long-term memories (LTM). One subset induces memory that decays within several hours, whereas the other induces memory that gradually develops after training. They convey reward signals to spatially segregated synaptic domains of the mushroom body (MB), a potential site for convergence. Furthermore, we identified a single type of dopamine neuron that conveys the reward signal to restricted subdomains of the mushroom body lobes and induces long-term memory. Constant appetitive memory retention after a single training session thus comprises two memory components triggered by distinct dopamine neurons.

Animals discriminate stimuli, learn their predictive value and use this knowledge to modify their behavior. In Drosophila, the mushroom body (MB) plays a key role in these processes. Sensory stimuli are sparsely represented by ∼2000 Kenyon cells, which converge onto 34 output neurons (MBONs) of 21 types. We studied the role of MBONs in several associative learning tasks and in sleep regulation, revealing the extent to which information flow is segregated into distinct channels and suggesting possible roles for the multi-layered MBON network. We also show that optogenetic activation of MBONs can, depending on cell type, induce repulsion or attraction in flies. The behavioral effects of MBON perturbation are combinatorial, suggesting that the MBON ensemble collectively represents valence. We propose that local, stimulus-specific dopaminergic modulation selectively alters the balance within the MBON network for those stimuli. Our results suggest that valence encoded by the MBON ensemble biases memory-based action selection. DOI: http://dx.doi.org/10.7554/eLife.04580.001, eLife digest An animal's survival depends on its ability to respond appropriately to its environment, approaching stimuli that signal rewards and avoiding any that warn of potential threats. In fruit flies, this behavior requires activity in a region of the brain called the mushroom body, which processes sensory information and uses that information to influence responses to stimuli. Aso et al. recently mapped the mushroom body of the fruit fly in its entirety. This work showed, among other things, that the mushroom body contained 21 different types of output neurons. Building on this work, Aso et al. have started to work out how this circuitry enables flies to learn to associate a stimulus, such as an odor, with an outcome, such as the presence of food. Two complementary techniques—the use of molecular genetics to block neuronal activity, and the use of light to activate neurons (a technique called optogenetics)—were employed to study the roles performed by the output neurons in the mushroom body. Results revealed that distinct groups of output cells must be activated for flies to avoid—as opposed to approach—odors. Moreover, the same output neurons are used to avoid both odors and colors that have been associated with punishment. Together, these results indicate that the output cells do not encode the identity of stimuli: rather, they signal whether a stimulus should be approached or avoided. The output cells also regulate the amount of sleep taken by the fly, which is consistent with the mushroom body having a broader role in regulating the fly's internal state. The results of these experiments—combined with new knowledge about the detailed structure of the mushroom body—lay the foundations for new studies that explore associative learning at the level of individual circuits and their component cells. Given that the organization of the mushroom body has much in common with that of the mammalian brain, these studies should provide insights into the fundamental principles that underpin learning and memory in other species, including humans. DOI: http://dx.doi.org/10.7554/eLife.04580.002

The honeybee Apis mellifera has a remarkable ability to detect and locate food sources during foraging, and to associate odor cues with food rewards. In the honeybee's olfactory system, sensory input is first processed in the antennal lobe (AL) network. Uniglomerular projection neurons (PNs) convey the sensory code from the AL to higher brain regions via two parallel but anatomically distinct pathways, the lateral and the medial antenno-cerebral tract (l- and m-ACT). Neurons innervating either tract show characteristic differences in odor selectivity, concentration dependence, and representation of mixtures. It is still unknown how this differential stimulus representation is achieved within the AL network. In this contribution, we use a computational network model to demonstrate that the experimentally observed features of odor coding in PNs can be reproduced by varying lateral inhibition and gain control in an otherwise unchanged AL network. We show that odor coding in the l-ACT supports detection and accurate identification of weak odor traces at the expense of concentration sensitivity, while odor coding in the m-ACT provides the basis for the computation and following of concentration gradients but provides weaker discrimination power. Both coding strategies are mutually exclusive, which creates a tradeoff between detection accuracy and sensitivity. The development of two parallel systems may thus reflect an evolutionary solution to this problem that enables honeybees to achieve both tasks during bee foraging in their natural environment, and which could inspire the development of artificial chemosensory devices for odor-guided navigation in robots.

Pheromones play major roles in intraspecific communication in many animals. Elaborated communication systems in eusocial insects provide excellent materials to study neural mechanisms for social pheromone processing. We previously reported that alarm pheromone information is processed in a specific cluster of glomeruli in the antennal lobe of the antCamponotus obscuripes. However, representation of alarm pheromone information in a secondary olfactory centre is unknown in any animal. Olfactory information in the antennal lobe is transmitted to secondary olfactory centres, including the lateral horn, by projection neurons (PNs). In this study, we compared distributions of terminal boutons of alarm pheromone-sensitive and -insensitive PNs in the lateral horn of ants. Distributions of their dendrites largely overlapped, but there was a region where boutons of pheromone-sensitive PNs, but not those of pheromone-insensitive PNs, were significantly denser than in the rest of the lateral horn. Moreover, most of a major type of pheromone-sensitive efferent neurons from the lateral horn extended dendritic branches in this region, suggesting specialization of this region for alarm pheromone processing. This study is the first study to demonstrate the presence of specialized areas for the processing of a non-sexual, social pheromone in the secondary olfactory centre in any animal.

Social insects exhibit sophisticated communication by means of pheromones, one example of which is the use of alarm pheromones to alert nestmates for colony defense. We review recent advances in the understanding of the processing of alarm pheromone information in the ant brain. We found that information about formic acid and n-undecane, alarm pheromone components, is processed in a set of specific glomeruli in the antennal lobe of the ant Camponotus obscuripes. Alarm pheromone information is then transmitted, via projection neurons, to the lateral horn and the calyces of the mushroom body of the protocerebrum. In the lateral horn, we found a specific area where terminal boutons of alarm pheromone-sensitive projection neurons are more densely distributed than in the rest of the lateral horn. Some neurons in the protocerebrum responded specifically to formic acid or n-undecane and they may participate in the control of behavioral responses to each pheromone component. Other neurons, especially those originating from the mushroom body lobe, responded also to non-pheromonal odors and may play roles in integration of pheromonal and non-pheromonal signals. We found that a class of neurons receive inputs in the lateral horn and the mushroom body lobe and terminate in a variety of premotor areas. These neurons may participate in the control of aggressive behavior, which is sensitized by alarm pheromones and is triggered by non-pheromonal sensory stimuli associated with a potential enemy. We propose that the alarm pheromone processing system has evolved by differentiation of a part of general odor processing system.

An important component in understanding central olfactory processing and coding in the insect brain relates to the characterization of the functional divisions between morphologically distinct types of projection neurons (PN). Using calcium imaging, we investigated how the identity, concentration and mixtures of odors are represented in axon terminals (boutons) of two types of PNs – lPN and mPN. In lPN boutons we found less concentration dependence, narrow tuning profiles at a high concentration, which may be optimized for fine, concentration-invariant odor discrimination. In mPN boutons, however, we found clear rising concentration dependence, broader tuning profiles at a high concentration, which may be optimized for concentration coding. In addition, we found more mixture suppression in lPNs than in mPNs, indicating lPNs better adaptation for synthetic mixture processing. These results suggest a functional division of odor processing in both PN types.