Search

Modulatory (e.g. dopaminergic) neurons provide “teaching signals” that drive associative learning across the animal kingdom, but the circuits that regulate their activity and compute teaching signals are still poorly understood. We provide the first synaptic-resolution connectome of the circuitry upstream of all modulatory neurons in a brain center for associative learning, the mushroom body (MB) of theDrosophilalarva. We discovered afferent pathways from sensory neurons, as well as an unexpected large population of 61 feedback neuron pairs that provide one- and two-step feedback from MB output neurons. The majority of these feedback pathways link distinct memory systems (e.g. aversive and appetitive). We functionally confirmed some of the structural pathways and found that some modulatory neurons compare inhibitory input from their own compartment and excitatory input from compartments of opposite valence, enabling them to compute integrated common-currency predicted values across aversive and appetitive memory systems. This architecture suggests that the MB functions as an interconnected ensemble during learning and that distinct types of previously formed memories can regulate future learning about a stimulus. We developed a model of the circuit constrained by the connectome and by the functional data which revealed that the newly discovered architectural motifs, namely the multilevel feedback architecture and the extensive cross-compartment connections, increase the computational performance and flexibility on learning tasks. Together our study provides the most detailed view to date of a recurrent brain circuit that computes teaching signals and provides insights into the architectural motifs that support reinforcement learning in a biological system.

Punishment feels bad, but relief upon its termination feels good. As a consequence of such timing-dependent valence reversal, memories of opposite valence can result from associating stimulus A with, for example, the occurrence of punishment (A−) versus punishment termination (−A): A− training results in aversive memory, but −A training in appetitive memory (corresponding effects exist for reward occurrence and termination). Whereas learning through the occurrence of punishment is well studied, much less is known about learning through its termination. Current research investigates how dopaminergic system function contributes to these processes in Drosophila, rats and humans. We argue that dopamine-related psychopathology may entail distortions in learning through punishment termination, and that this may contribute, for example, to non-suicidal self-injury or post-traumatic stress disorder.

Associating stimuli with positive or negative reinforcement is essential for survival, but a complete wiring diagram of a higherorder circuit supporting associative memory has not been previously available. We reconstructed one such circuit at synaptic resolution, theDrosophilalarval mushroom body, and found that most Kenyon cells integrate random combinations of inputs but a subset receives stereotyped inputs from single projection neurons. This organization maximizes performance of a model output neuron on a stimulus discrimination task. We also report a novel canonical circuit in each mushroom body compartment with previously unidentified connections: reciprocal Kenyon cell to modulatory neuron connections, modulatory neuron to output neuron connections, and a surprisingly high number of recurrent connections between Kenyon cells. Stereotyped connections between output neurons could enhance the selection of learned responses. The complete circuit map of the mushroom body should guide future functional studies of this learning and memory center.

Mapping brain function to brain structure is a fundamental task for neuroscience. For such an endeavour, the Drosophila larva is simple enough to be tractable, yet complex enough to be interesting. It features about 10,000 neurons and is capable of various taxes, kineses and Pavlovian conditioning. All its neurons are currently being mapped into a light-microscopical atlas, and Gal4 strains are being generated to experimentally access neurons one at a time. In addition, an electron microscopic reconstruction of its nervous system seems within reach. Notably, this electron microscope-based connectome is being drafted for a stage 1 larva - because stage 1 larvae are much smaller than stage 3 larvae. However, most behaviour analyses have been performed for stage 3 larvae because their larger size makes them easier to handle and observe. It is therefore warranted to either redo the electron microscopic reconstruction for a stage 3 larva or to survey the behavioural faculties of stage 1 larvae. We provide the latter. In a community-based approach we called the Ol1mpiad, we probed stage 1 Drosophila larvae for free locomotion, feeding, responsiveness to substrate vibration, gentle and nociceptive touch, burrowing, olfactory preference and thermotaxis, light avoidance, gustatory choice of various tastants plus odour-taste associative learning, as well as light/dark-electric shock associative learning. Quantitatively, stage 1 larvae show lower scores in most tasks, arguably because of their smaller size and lower speed. Qualitatively, however, stage 1 larvae perform strikingly similar to stage 3 larvae in almost all cases. These results bolster confidence in mapping brain structure and behaviour across developmental stages. The Gulbenkian/Melbourne group was supported by the Fundação para a Ciência e a Tecnologia (FCT; post-doctoral fellowship to M.J.A.-C.: SFRH/BPD/75993/2011; exploratory grant to M.J.A.-C. and C.K.M.: EXPL/BEX-BID/0497/2013). The Münster group was supported by the Cluster of Excellence Cells in Motion (CiM) and the CiM International Max Planck research school (CiM-IMPRS). The Barcelona group was supported by the Spanish Ministry of Economy and Competitiveness, 'Centro de Excelencia Severo Ochoa 2013-2017' (SEV-2012-0208), the CERCA Programme/Generalitat de Catalunya, the 'la Caixa' International PhD Programme, and the Spanish Ministry of Science and Innovation (BFU2011-26208). The LIN-GoLM group received support from the Wissenschaftsgemeinschaft Gottfried Wilhelm Leibniz, the State of Sachsen-Anhalt, the Center for Behavioral Brain Sciences Magdeburg and the Otto von Guericke Universität Magdeburg, as well as from the Deutsche Forschungsgemeinschaft (CRC 779 Motivated behaviour: B11; GE1091/4-1) and the European Commission (FP7-ICT project Miniature Insect Model for Active Learning MINIMAL). The Janelia group received support from the Howard Hughes Medical Institute. The Fribourg group was supported by a starter grant from the European Research Council (ERC-2012-StG 309832-PhotoNaviNet) and the Swiss National Science Foundation (31003A_169993). The Hamburg group was supported by the Deutsche Forschungsgemeinschaft (SPP 1926, Next generation optogenetics, SO1337/2-1), and the Landesforschungsförderung Hamburg (LFF-FV27). The LIN-MolSysBiol group received support from the Wissenschaftsgemeinschaft Gottfried Wilhelm Leibniz, the State of Sachsen-Anhalt, the Center for Behavioral Brain Sciences Magdeburg and the Deutsche Forschungsgemeinschaft (CRC 779 Motivated behaviour: B15; YA272/2-1). The Bonn group was supported by the Deutsche Forschungsgemeinschaft (PA 787/7-1) and Cluster of Excellence ImmunoSensation. The Konstanz group was supported by Deutsche Forschungsgemeinschaft (TH1584/1-1, TH1584/3-1), the Baden-Württemberg Stiftung and the Zukunftskolleg of the University of Konstanz.

Larval Drosophila offer a study case for behavioral neurogenetics that is simple enough to be experimentally tractable, yet complex enough to be worth the effort. We provide a detailed, hands-on manual for Pavlovian odor-reward learning in these animals. Given the versatility of Drosophila for genetic analyses, combined with the evolutionarily shared genetic heritage with humans, the paradigm has utility not only in behavioral neurogenetics and experimental psychology, but for translational biomedicine as well. Together with the upcoming total synaptic connectome of the Drosophila nervous system and the possibilities of single-cell-specific transgene expression, it offers enticing opportunities for research. Indeed, the paradigm has already been adopted by a number of labs and is robust enough to be used for teaching in classroom settings. This has given rise to a demand for a detailed, hands-on manual directed at newcomers and/or at laboratory novices, and this is what we here provide. The paradigm and the present manual have a unique set of features: (1) The paradigm is cheap, easy, and robust; (2) The manual is detailed enough for newcomers or laboratory novices; (3) It briefly covers the essential scientific context; (4) It includes sheets for scoring, data analysis, and display; (5) It is multilingual: in addition to an English version we provide German, French, Japanese, Spanish and Italian language versions as well. The present manual can thus foster science education at an earlier age and enable research by a broader community than has been the case to date.

Amino acids are important nutrients for animals, reflected in conserved internal pathways in vertebrates and invertebrates for monitoring cellular levels of these compounds. In mammals, sensory cells and metabotropic glutamate receptor-related taste receptors that detect environmental sources of amino acids in food are also well-characterised. By contrast, it is unclear how insects perceive this class of molecules through peripheral chemosensory mechanisms. Here we investigate amino acid sensing in Drosophila melanogaster larvae, which feed ravenously to support their rapid growth. We show that larvae display diverse behaviours (attraction, aversion, neutral) towards different amino acids, which depend upon stimulus concentration. Some of these behaviours require IR76b, a member of the variant ionotropic glutamate receptor repertoire of invertebrate chemoreceptors. IR76b is broadly expressed in larval taste neurons, suggesting a role as a co-receptor. We identify a subpopulation of these neurons that displays physiological activation by some, but not all, amino acids, and which mediate suppression of feeding by high concentrations of at least a subset of these compounds. Our data reveal the first elements of a sophisticated neuronal and molecular substrate by which these animals detect and behave towards external sources of amino acids.

Dopaminergic neurons serve multiple functions, including reinforcement processing during associative learning [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11 and 12]. It is thus warranted to understand which dopaminergic neurons mediate which function. We study larval Drosophila, in which only approximately 120 of a total of 10,000 neurons are dopaminergic, as judged by the expression of tyrosine hydroxylase (TH), the rate- limiting enzyme of dopamine biosynthesis [ 5 and 13]. Dopaminergic neurons mediating reinforcement in insect olfactory learning target the mushroom bodies, a higher-order “cortical” brain region [ 1, 2, 3, 4, 5, 11, 12, 14 and 15]. We discover four previously undescribed paired neurons, the primary protocerebral anterior medial (pPAM) neurons. These neurons are TH positive and subdivide the medial lobe of the mushroom body into four distinct subunits. These pPAM neurons are acutely necessary for odor-sugar reward learning and require intact TH function in this process. However, they are dispensable for aversive learning and innate behavior toward the odors and sugars employed. Optogenetical activation of pPAM neurons is sufficient as a reward. Thus, the pPAM neurons convey a likely dopaminergic reward signal. In contrast, DL1 cluster neurons convey a corresponding punishment signal [5], suggesting a cellular division of labor to convey dopaminergic reward and punishment signals. On the level of individually identified neurons, this uncovers an organizational principle shared with adult Drosophila and mammals [ 1, 2, 3, 4, 7, 9 and 10] (but see [6]). The numerical simplicity and connectomic tractability of the larval nervous system [ 16, 17, 18 and 19] now offers a prospect for studying circuit principles of dopamine function at unprecedented resolution.

Pain is aversive, but does the cessation of pain (‘relief’) have a reward-like effect? Indeed, fruitflies avoid an odour previously presented before a painful event, but approach an odour previously presented after a painful event. Thus, event-timing may turn punishment to reward. However, is event-timing also crucial in humans who can have explicit cognitions about associations? Here, we show that stimuli associated with pain-relief acquire positive implicit valence but are explicitly rated as aversive. Specifically, the startle response, an evolutionarily conserved defence reflex, is attenuated by stimuli that had previously followed a painful event, indicating implicit positive valence of the conditioned stimulus; nevertheless, participants explicitly evaluate these stimuli as ‘emotionally negative’. These results demonstrate a rift between the implicit and explicit conditioned valence induced by pain relief. They might explain why humans in some cases are attracted by conditioned stimuli despite explicitly judging them as negative.

Gustatory stimuli have at least 2 kinds of function: They can support immediate, reflexive responses (such as substrate choice and feeding) and they can drive internal reinforcement. We provide behavioral analyses of these functions with respect to sweet taste in larval Drosophila. The idea is to use the dose-effect characteristics as behavioral "fingerprints" to dissociate reflexive and reinforcing functions. For glucose and trehalose, we uncover relatively weak preference. In contrast, for fructose and sucrose, preference responses are strong and the effects on feeding pronounced. Specifically, larvae are attracted to, and feeding is stimulated most strongly for, intermediate concentrations of either sugar: Using very high concentrations (4 M) results in weakened preference and suppression of feeding. In contrast to such an optimum function regarding choice and feeding, an asymptotic dose-effect function is found for reinforcement learning: Learning scores reach asymptote at 2 M and remain stable for a 4-M concentration. A similar parametric discrepancy between the reflexive (choice and feeding) and reinforcing function is also seen for sodium chloride (Niewalda T, Singhal S, Fiala A, Saumweber T, Wegener S, Gerber B, in preparation). We discuss whether these discrepancies are based either on inhibition from high-osmolarity sensors upon specifically the reflexive pathways or whether different sensory pathways, with different effective dose-response characteristics, may have preferential access to drive either reflex responses or modulatory neurons mediating internal reinforcement, respectively.

Synapsin is an evolutionarily conserved presynaptic phosphoprotein. It is encoded by only one gene in the Drosophila genome and is expressed throughout the nervous system. It regulates the balance between reserve and releasable vesicles, is required to maintain transmission upon heavy demand, and is essential for proper memory function at the behavioral level. Task-relevant sensorimotor functions, however, remain intact in the absence of Synapsin. Using an odor–sugar reward associative learning paradigm in larval Drosophila, we show that memory scores in mutants lacking Synapsin (syn97) are lower than in wild-type animals only when more salient, higher concentrations of odor or of the sugar reward are used. Furthermore, we show that Synapsin is selectively required for larval short-term memory. Thus, without Synapsin Drosophila larvae can learn and remember, but Synapsin is required to form memories that match in strength to event salience—in particular to a high saliency of odors, of rewards, or the salient recency of an event. We further show that the residual memory scores upon a lack of Synapsin are not further decreased by an additional lack of the Sap47 protein. In combination with mass spectrometry data showing an up-regulated phosphorylation of Synapsin in the larval nervous system upon a lack of Sap47, this is suggestive of a functional interdependence of Synapsin and Sap47.

Adverse life events can induce two kinds of memory with opposite valence, dependent on timing: “negative” memories for stimuli preceding them and “positive” memories for stimuli experienced at the moment of “relief.” Such punishment memory and relief memory are found in insects, rats, and man. For example, fruit flies (Drosophila melanogaster) avoid an odor after odor-shock training (“forward conditioning” of the odor), whereas after shock-odor training (“backward conditioning” of the odor) they approach it. Do these timing-dependent associative processes share molecular determinants? We focus on the role of Synapsin, a conserved presynaptic phosphoprotein regulating the balance between the reserve pool and the readily releasable pool of synaptic vesicles. We find that a lack of Synapsin leaves task-relevant sensory and motor faculties unaffected. In contrast, both punishment memory and relief memory scores are reduced. These defects reflect a true lessening of associative memory strength, as distortions in nonassociative processing (e.g., susceptibility to handling, adaptation, habituation, sensitization), discrimination ability, and changes in the time course of coincidence detection can be ruled out as alternative explanations. Reductions in punishment- and relief-memory strength are also observed upon an RNAi-mediated knock-down of Synapsin, and are rescued both by acutely restoring Synapsin and by locally restoring it in the mushroom bodies of mutant flies. Thus, both punishment memory and relief memory require the Synapsin protein and in this sense share genetic and molecular determinants. We note that corresponding molecular commonalities between punishment memory and relief memory in humans would constrain pharmacological attempts to selectively interfere with excessive associative punishment memories, e.g., after traumatic experiences.

InDrosophila, short-term (STH) and long-term habituation (LTH) of olfactory avoidance behavior are believed to arise from the selective potentiation of GABAergic synapses between multiglomerular local circuit interneurons (LNs) and projection neurons in the antennal lobe. However, the underlying mechanisms remain poorly understood. Here, we show thatsynapsin(syn) function is necessary for STH and thatsyn97-null mutant defects in STH can be rescued bysyn+cDNA expression solely in the LN1 subset of GABAergic local interneurons. As synapsin is a synaptic vesicle-clustering phosphoprotein, these observations identify a presynaptic mechanism for STH as well as the inhibitory interneurons in which this mechanism is deployed. Serine residues 6 and/or 533, potential kinase target sites of synapsin, are necessary for synapsin function suggesting that synapsin phosphorylation is essential for STH. Consistently, biochemical analyses using a phospho-synapsin-specific antiserum show that synapsin is a target of Ca2+calmodulin-dependent kinase II (CaMKII) phosphorylationin vivo. Additional behavioral and genetic observations demonstrate that CaMKII function is necessary in LNs for STH. Together, these data support a model in which CaMKII-mediated synapsin phosphorylation in LNs induces synaptic vesicle mobilization and thereby presynaptic facilitation of GABA release that underlies olfactory STH. Finally, the striking observation that LTH occurs normally insyn97mutants indicates that signaling pathways for STH and LTH diverge upstream of synapsin function in GABAergic interneurons.

Painful events shape future behaviour in two ways: stimuli associated with pain onset subsequently support learned avoidance (i.e. punishment-learning) because they signal future, upcoming pain. Stimuli associated with pain offset in turn signal relief and later on support learned approach (i.e. relief-learning). The relative strengths of such punishment- and relief-learning can be crucial for the adaptive organization of behaviour in the aftermath of painful events. Using Drosophila , we compare punishment- and relief-memories in terms of their temporal decay and sensitivity to retrograde amnesia. During the first 75 min following training, relief-memory is stable, whereas punishment-memory decays to half of the initial score. By 24 h after training, however, relief-memory is lost, whereas a third of punishment-memory scores still remain. In accordance with such rapid temporal decay from 75 min on, retrograde amnesia erases relief-memory but leaves a half of punishment-memory scores intact. These findings suggest differential mechanistic bases for punishment- and relief-memory, thus offering possibilities for separately interfering with either of them.

Animals' behaviour towards odours depends on both odour quality and odour intensity. While neuronal coding of odour quality is fairly well studied, how odour intensity is treated by olfactory systems is less clear. Here we study odour intensity processing at the behavioural level, using the fruit flyDrosophila melanogaster. We trained flies by pairing a MEDIUM intensity of an odour with electric shock, and then, at a following test phase, measured flies' conditioned avoidance of either this previously trained MEDIUM intensity or a LOWer or a HIGHer intensity. With respect to 3-octanol,n-amylacetate and 4-methylcyclohexanol, we found that conditioned avoidance is strongest when training and test intensities match, speaking for intensity-specific memories. With respect to a fourth odour, benzaldehyde, on the other hand, we found no such intensity specificity. These results form the basis for further studies of odour intensity processing at the behavioural, neuronal and molecular level.

Synapsins are evolutionarily conserved, highly abundant vesicular phosphoproteins in presynaptic terminals. They are thought to regulate the recruitment of synaptic vesicles from the reserve pool to the readily-releasable pool, in particular when vesicle release is to be maintained at high spiking rates. As regulation of transmitter release is a prerequisite for synaptic plasticity, we use the fruit fly Drosophila to ask whether Synapsin has a role in behavioral plasticity as well; in fruit flies, Synapsin is encoded by a single gene (syn). We tackled this question for associative olfactory learning in larval Drosophila by using the deletion mutant syn97CS, which had been backcrossed to the Canton-S wild-type strain (CS) for 13 generations. We provide a molecular account of the genomic status of syn97CS by PCR and show the absence of gene product on Western blots and nerve-muscle preparations. We found that olfactory associative learning in syn97CS larvae is reduced to ∼50% of wild-type CS levels; however, responsiveness to the to-be-associated stimuli and motor performance in untrained animals are normal. In addition, we introduce two novel behavioral control procedures to test stimulus responsiveness and motor performance after “sham training.” Wild-type CS and syn97CS perform indistinguishably also in these tests. Thus, larval Drosophila can be used as a case study for a role of Synapsin in associative learning.

We investigate olfactory memory consolidation in honeybees. Three experiments are reported that include 1024 animals in 28 experimental groups. After one pairing of odorant and sucrose reward, retention is typically nonmonotonic with a minimum 3 min after conditioning. This corresponds to the “Kamin effect” in vertebrates; the postminimum rise in retention is usually interpreted as reflecting memory consolidation. First, we test for the generality of this effect across four different odorants. The postminimum rise in retention was reproducibly observed for 1-hexanol but not for 1-octanol, limonene, or geraniol. Second, we investigate whether previous learning about the training context modulates subsequent memory consolidation. On the day before training, a reward was applied either upon placement into the future training context for 1 min, halfway during exposure or just before removal from the context. In the latter group, the 3-min minimum in retention was eliminated; thus, in that group, forward pairings of context and reward (i.e., context exposure begins before reward is applied) lead to an associative context memory that can modulate subsequent olfactory memory consolidation. Third, we found no evidence for a modulation of olfactory memory consolidation by pre-exposure to the odorant.

To see what effects learning in one context can exercise upon subsequent learning in other contexts the relation between olfactory learning performance of honey bees,Apis melliferaL., in a restrained classical conditioning paradigm for the proboscis extension reflex and chemosensory experience under natural circumstances was investigated. The effects of food-source odours and of the hive's odour on subsequent laboratory proboscis extension performance were tested. There was a transfer effect for odours from a food source to proboscis extension reflex conditioning in the laboratory: bees extended their proboscis in response to food-source odour and showed resistance to its extinction. Hive odour had no detectable effect. Thus, the observed transfer effect for food-source odours was likely to be caused by memories established during foraging rather than by within-hive experience with the scent of harvested food. The observed transfer effect for odours from a food source thus points to a surprisingly weak role of context for the retrieval of olfactory memories established during foraging. Furthermore, it offers an experience-based explanation for variability in honey bee proboscis extension learning.