Search

Summary: Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Neuronally orchestrated muscular movement and locomotion are defining faculties of multicellular animals. Due to its simple brain and genetic accessibility, the larva of the fruit fly Drosophila melanogaster allows one to study these processes at tractable levels of complexity. However, although the faculty of locomotion clearly pertains to the individual, most studies of locomotion in larvae use measurements aggregated across animals, or animals tested one by one, an extravagance for larger-scale analyses. This prevents grasping the inter- and intra-individual variability in locomotion and its neurogenetic determinants. Here, we present the IMBA (individual maggot behaviour analyser) for analysing the behaviour of individual larvae within groups, reliably resolving individual identity across collisions. We use the IMBA to systematically describe the inter- and intra-individual variability in locomotion of wild-type animals, and how the variability is reduced by associative learning. We then report a novel locomotion phenotype of an adhesion GPCR mutant. We further investigated the modulation of locomotion across repeated activations of dopamine neurons in individual animals, and the transient backward locomotion induced by brief optogenetic activation of the brain-descending ‘mooncrawler’ neurons. In summary, the IMBA is an easy-to-use toolbox allowing an unprecedentedly rich view of the behaviour and its variability of individual larvae, with utility in multiple biomedical research contexts.

The way neurons in the brain rewire in larvae as they turn to adult fruit flies sheds light on how complete metamorphosis was ‘invented’ over the course of evolution.

The mushroom body of Drosophila integrates sensory information with past experience to guide behaviour. Here, the authors provide an atlas of the input and output neurons of the stage 3 larval mushroom body at the single-cell level, and analyse their function in learned and innate behaviours.

Relative to other nutrients, less is known about how animals sense amino acids and how behaviour is organized accordingly. This is a significant gap in our knowledge because amino acids are required for protein synthesis − and hence for life as we know it. Choosing Drosophila larvae as a case study, we provide the first systematic analysis of both the preference behaviour for, and the learning of, all 20 canonical amino acids in Drosophila. We report that preference for individual amino acids differs according to the kind of amino acid, both in first-instar and in third-instar larvae. Our data suggest that this preference profile changes across larval instars, and that starvation during the third instar also alters this profile. Only aspartic acid turns out to be robustly attractive across all our experiments. The essentiality of amino acids does not appear to be a determinant of preference. Interestingly, although amino acids thus differ in their innate attractiveness, we find that all amino acids are equally rewarding. Similar discrepancies between innate attractiveness and reinforcing effect have previously been reported for other tastants, including sugars, bitter substances and salt. The present analyses will facilitate the ongoing search for the receptors, sensory neurons, and internal, homeostatic amino acid sensors in Drosophila.

Finding rewards and avoiding punishments are powerful goals of behavior. To maximize reward and minimize punishment, it is beneficial to learn about the stimuli that predict their occurrence, and decades of research have provided insight into the brain processes underlying such associative reinforcement learning. In addition, it is well known in experimental psychology, yet often unacknowledged in neighboring scientific disciplines, that subjects also learn about the stimuli that predict the absence of reinforcement. Here we evaluate evidence for both these learning processes. We focus on two study cases that both provide a baseline level of behavior against which the effects of associative learning can be assessed. Firstly, we report pertinent evidence from Drosophila larvae. A re-analysis of the literature reveals that through paired presentations of an odor A and a sugar reward (A+) the animals learn that the reward can be found where the odor is, and therefore show an above-baseline preference for the odor. In contrast, through unpaired training (A/+) the animals learn that the reward can be found precisely where the odor is not, and accordingly these larvae show a below-baseline preference for it (the same is the case, with inverted signs, for learning through taste punishment). In addition, we present previously unpublished data demonstrating that also during a two-odor, differential conditioning protocol (A+/B) both these learning processes take place in larvae, i.e., learning about both the rewarded stimulus A and the non-rewarded stimulus B (again, this is likewise the case for differential conditioning with taste punishment). Secondly, after briefly discussing published evidence from adult Drosophila, honeybees, and rats, we report an unpublished data set showing that relative to baseline behavior after truly random presentations of a visual stimulus A and punishment, rats exhibit memories of opposite valence upon paired and unpaired training. Collectively, the evidence conforms to classical findings in experimental psychology and suggests that across species animals associatively learn both through paired and through unpaired presentations of stimuli with reinforcement – with opposite valence. While the brain mechanisms of unpaired learning for the most part still need to be uncovered, the immediate implication is that using unpaired procedures as a mnemonically neutral control for associative reinforcement learning may be leading analyses astray.

A fundamental problem in deciding between mutually exclusive options is that the decision needs to be categorical although the properties of the options often differ but in grade. We developed an experimental handle to study this aspect of behavior organization. Larval Drosophila were trained such that in one set of animals odor A was rewarded, but odor B was not (A+/B), whereas a second set of animals was trained reciprocally (A/B+). We then measured the preference of the larvae either for A, or for B, or for “morphed” mixtures of A and B, that is for mixtures differing in the ratio of the two components. As expected, the larvae showed higher preference when only the previously rewarded odor was presented than when only the previously unrewarded odor was presented. For mixtures of A and B that differed in the ratio of the two components, the major component dominated preference behavior—but it dominated less than expected from a linear relationship between mixture ratio and preference behavior. This suggests that a minor component can have an enhanced impact in a mixture, relative to such a linear expectation. The current paradigm may prove useful in understanding how nervous systems generate discrete outputs in the face of inputs that differ only gradually.

The ability to respond to and to learn about mechanosensory disturbance is widespread among animals. Using Drosophila larvae, we describe how the frequency of mechanosensory disturbance (‘buzz’) affects three aspects of behaviour: free locomotion, innate olfactory preference, and potency as a punishment. We report that (i) during 2–3 seconds after buzz onset the larvae slowed down and then turned, arguably to escape this situation; this was seen for buzz frequencies of 10, 100, and 1000 Hz, (ii) innate olfactory preference was reduced when tested in the presence of the buzz; this effect was strongest for the 100 Hz frequency, (iii) after odour-buzz associative training, we observed escape from the buzz-associated odour; this effect was apparent for 10 and 100, but not for 1000 Hz. We discuss the multiple behavioural effects of mechanosensation and stress that the immediate effects on locomotion and the impact as punishment differ in their frequency-dependence. Similar dissociations between immediate, reflexive behavioural effects and reinforcement potency were previously reported for sweet, salty and bitter tastants. It should be interesting to see how these features map onto the organization of sensory, ascending pathways.

Understanding social behaviour requires a study case that is simple enough to be tractable, yet complex enough to remain interesting. Do larval Drosophila meet these requirements? In a broad sense, this question can refer to effects of the mere presence of other larvae on the behaviour of a target individual. Here we focused in a more strict sense on ‘peer pressure’, that is on the question of whether the behaviour of a target individual larva is affected by what a surrounding group of larvae is doing. We found that innate olfactory preference of a target individual was neither affected (i) by the level of innate olfactory preference in the surrounding group nor (ii) by the expression of learned olfactory preference in the group. Likewise, learned olfactory preference of a target individual was neither affected (iii) by the level of innate olfactory preference of the surrounding group nor (iv) by the learned olfactory preference the group was expressing. We conclude that larval Drosophila thus do not take note of specifically what surrounding larvae are doing. This implies that in a strict sense, and to the extent tested, there is no social interaction between larvae. These results validate widely used en mass approaches to the behaviour of larval Drosophila.

The only property of reinforcement insects are commonly thought to learn about is its value. We show that larval Drosophila not only remember the value of reinforcement (How much?), but also its quality (What?). This is demonstrated both within the appetitive domain by using sugar vs amino acid as different reward qualities, and within the aversive domain by using bitter vs high-concentration salt as different qualities of punishment. From the available literature, such nuanced memories for the quality of reinforcement are unexpected and pose a challenge to present models of how insect memory is organized. Given that animals as simple as larval Drosophila, endowed with but 10,000 neurons, operate with both reinforcement value and quality, we suggest that both are fundamental aspects of mnemonic processing—in any brain.

Gustatory stimuli can support both immediate reflexive behaviour, such as choice and feeding, and can drive internal reinforcement in associative learning. For larval Drosophila, we here provide a first systematic behavioural analysis of these functions with respect to quinine as a study case of a substance which humans report as "tasting bitter". We describe the dose-effect functions for these different kinds of behaviour and find that a half-maximal effect of quinine to suppress feeding needs substantially higher quinine concentrations (2.0 mM) than is the case for internal reinforcement (0.6 mM). Interestingly, in previous studies (Niewalda et al. 2008, Schipanski et al 2008) we had found the reverse for sodium chloride and fructose/sucrose, such that dose-effect functions for those tastants were shifted towards lower concentrations for feeding as compared to reinforcement, arguing that the differences in dose-effect function between these behaviours do not reflect artefacts of the types of assay used. The current results regarding quinine thus provide a starting point to investigate how the gustatory system is organized on the cellular and/or molecular level to result in different behavioural tuning curves towards a bitter tastant.

How do physico-chemical stimulus features, perception, and physiology relate? Given the multi-layered and parallel architecture of brains, the question specifically is where physiological activity patterns correspond to stimulus features and/or perception. Perceived distances between six odour pairs are defined behaviourally from four independent odour recognition tasks. We find that, in register with the physico-chemical distances of these odours, perceived distances for 3-octanol and n-amylacetate are consistently smallest in all four tasks, while the other five odour pairs are about equally distinct. Optical imaging in the antennal lobe, using a calcium sensor transgenically expressed in only first-order sensory or only second-order olfactory projection neurons, reveals that 3-octanol and n-amylacetate are distinctly represented in sensory neurons, but appear merged in projection neurons. These results may suggest that within-antennal lobe processing funnels sensory signals into behaviourally meaningful categories, in register with the physico-chemical relatedness of the odours.