Search

The effect of repetitive training on learned actions has been a major subject in behavioural neuroscience. Many studies of instrumental conditioning in mammals, including humans, suggested that learned actions early in training are goal-driven and controlled by outcome expectancy, but they become more automatic and insensitive to reduction in the value of the outcome after extended training. It was unknown, however, whether the development of value-insensitive behaviour also occurs by extended training of Pavlovian conditioning in any animals. Here we show that crickets Gryllus bimaculatus that had received minimal training to associate an odour with water (unconditioned stimulus, US) did not exhibit conditioned response (CR) to the odour when they were given water until satiation before the test, but those that had received extended training exhibited CR even when they were satiated with water. Further pharmacological experiments suggested that octopamine neurons, the invertebrate counterparts of noradrenaline neurons, mediate US value signals and control execution of CR after minimal training, but the control diminishes with the progress of training and hence the CR becomes insensitive to US devaluation. The results suggest that repetitive sensory experiences can lead to a change from a goal-driven response to a more automatic one in crickets.

Caffeine is a plant-derived alkaloid that is generally known as a central nervous system (CNS) stimulant. In order to examine the effects of caffeine on higher CNS functions in insects, we used an appetitive olfactory learning paradigm for the cricket Gryllus bimaculatus. Crickets can form significant long-term memories (LTMs) after repetitive training sessions, during which they associate a conditioned stimulus (CS: odor) with an unconditioned stimulus (US: reward). Administration of hemolymphal injections of caffeine established LTM after only single-trial conditioning over a wide range of caffeine dosages (1.6 µµg/kg to 39 mg/kg). We investigated the physiological mechanisms underlying this enhancement of olfactory learning performance pharmacologically, focusing on three major physiological roles of caffeine: 1) inhibition of phosphodiesterase (PDE), 2) agonism of ryanodine receptors, and 3) antagonism of adenosine receptors. Application of drugs relevant to these actions resulted in significant effects on LTM formation. These results suggest that externally applied caffeine enhances LTM formation in insect olfactory learning via multiple cellular mechanisms.

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. Complete evidence for the prediction error theory, however, has not been obtained in any learning systems: Prediction error theory stems from the finding of a blocking phenomenon, but blocking can also be accounted for by other theories, such as the attentional theory. We demonstrated blocking in classical conditioning in crickets and obtained evidence to reject the attentional theory. To obtain further evidence supporting the prediction error theory and rejecting alternative theories, we constructed a neural model to match the prediction error theory, by modifying our previous model of learning in crickets, and we tested a prediction from the model: the model predicts that pharmacological intervention of octopaminergic transmission during appetitive conditioning impairs learning but not formation of reward prediction itself, and it thus predicts no learning in subsequent training. We observed such an "auto-blocking", which could be accounted for by the prediction error theory but not by other competitive theories to account for blocking. This study unambiguously demonstrates validity of the prediction error theory in associative learning.

Ca(2+)/calmodulin (CaM)-dependent protein kinase II (CaMKII) is a key molecule in many systems of learning and memory in vertebrates, but roles of CaMKII in invertebrates have not been characterized in detail. We have suggested that serial activation of NO/cGMP signaling, cyclic nucleotide-gated channel, Ca(2+)/CaM and cAMP signaling participates in long-term memory (LTM) formation in olfactory conditioning in crickets, and here we show participation of CaMKII in LTM formation and propose its site of action in the biochemical cascades. Crickets subjected to 3-trial conditioning to associate an odor with reward exhibited memory that lasts for a few days, which is characterized as protein synthesis-dependent LTM. In contrast, animals subjected to 1-trial conditioning exhibited memory that lasts for only several hours (mid-term memory, MTM). Injection of a CaMKII inhibitor prior to 3-trial conditioning impaired 1-day memory retention but not 1-hour memory retention, suggesting that CaMKII participates in LTM formation but not in MTM formation. Animals injected with a cGMP analogue, calcium ionophore or cAMP analogue prior to 1-trial conditioning exhibited 1-day retention, and co-injection of a CaMKII inhibitor impaired induction of LTM by the cGMP analogue or that by the calcium ionophore but not that by the cAMP analogue, suggesting that CaMKII is downstream of cGMP production and Ca(2+) influx and upstream of cAMP production in biochemical cascades for LTM formation. Animals injected with an adenylyl cyclase (AC) activator prior to 1-trial conditioning exhibited 1-day retention. Interestingly, a CaMKII inhibitor impaired LTM induction by the AC activator, although AC is expected to be a downstream target of CaMKII. The results suggest that CaMKII interacts with AC to facilitate cAMP production for LTM formation. We propose that CaMKII serves as a key molecule for interplay between Ca(2+) signaling and cAMP signaling for LTM formation, a new role of CaMKII in learning and memory.

The cricket (Gryllus bimaculatus) is a hemimetabolous insect that is emerging as a model organism for the study of neural and molecular mechanisms of behavioral traits. However, research strategies have been limited by a lack of genetic manipulation techniques that target the nervous system of the cricket. The development of a new method for efficient gene delivery into cricket brains, using in vivo electroporation, is described here. Plasmid DNA, which contained an enhanced green fluorescent protein (eGFP) gene, under the control of a G. bimaculatus actin (Gb'-act) promoter, was injected into adult cricket brains. Injection was followed by electroporation at a sufficient voltage. Expression of eGFP was observed within the brain tissue. Localized gene expression, targeted to specific regions of the brain, was also achieved using a combination of local DNA injection and fine arrangement of the electroporation electrodes. Further studies using this technique will lead to a better understanding of the neural and molecular mechanisms that underlie cricket behaviors., (Copyright © 2013 Elsevier Ltd. All rights reserved.)

The nitric oxide (NO)-cGMP signaling system and cAMP system play critical roles in the formation of multiple-trial induced, protein synthesis-dependent long-term memory (LTM) in many vertebrates and invertebrates. The relationship between the NO-cGMP system and cAMP system, however, remains controversial. In honey bees, the two systems have been suggested to converge on protein kinase A (PKA), based on the finding in vitro that cGMP activates PKA when sub-optimal dose of cAMP is present. In crickets, however, we have suggested that NO-cGMP pathway operates on PKA via activation of adenylyl cyclase and production of cAMP for LTM formation. To resolve this issue, we compared the effect of multiple-trial conditioning against the effect of an externally applied cGMP analog for LTM formation in crickets, in the presence of sub-optimal dose of cAMP analog and in condition in which adenylyl cyclase was inhibited. The obtained results suggest that an externally applied cGMP analog activates PKA when sub-optimal dose of cAMP analog is present, as is suggested in honey bees, but cGMP produced by multiple-trial conditioning cannot activate PKA even when sub-optimal dose of cAMP analog is present, thus indicating that cGMP produced by multiple-trial conditioning is not accessible to PKA. We conclude that the NO-cGMP system stimulates the cAMP system for LTM formation. We propose that LTM is formed by an interplay of two classes of neurons, namely, NO-producing neurons regulating LTM formation and NO-receptive neurons that are more directly involved in the formation of long-term synaptic plasticity underlying LTM formation.

One of the most extensively debated topics in educational psychology is whether punishment or reward is more effective for producing short-term and long-term behavioral changes, and it has been proposed that the effect of punishment is less durable than the effect of reward. However, no conclusive evidence to support this proposal has been obtained in any animals. We recently found that punishment memory decayed much faster than reward memory in olfactory learning and visual pattern learning in crickets. We also found that neurotransmitters conveying punishment and reward signals differ in crickets: dopaminergic and octopaminergic neurons play critical roles in conveying punishment and reward signals, respectively. In this study, we investigated whether these features are general features of cricket learning or are specific to olfactory and visual pattern learning. We found that crickets have the capability of color learning and that their color learning has the same features. Based on our findings in crickets and those reported in other species of insects, we conclude that these two features are conserved in many forms of insect learning. In mammals, aminergic neurons are known to convey reward and punishment signals in learning of a variety of sensory stimuli. We propose that the faster decay of punishment memory than reward memory observed in insects and humans reflects different cellular and biochemical processes after activation of receptors for amines conveying punishment and reward signals. The possible adaptive significance of relatively limited durability of punishment memory is proposed.

Background: In insect classical conditioning, octopamine (the invertebrate counterpart of noradrenaline) or dopamine has been suggested to mediate reinforcing properties of appetitive or aversive unconditioned stimulus, respectively. However, the roles of octopaminergic and dopaminergic neurons in memory recall have remained unclear., Results: We studied the roles of octopaminergic and dopaminergic neurons in appetitive and aversive memory recall in olfactory and visual conditioning in crickets. We found that pharmacological blockade of octopamine and dopamine receptors impaired aversive memory recall and appetitive memory recall, respectively, thereby suggesting that activation of octopaminergic and dopaminergic neurons and the resulting release of octopamine and dopamine are needed for appetitive and aversive memory recall, respectively. On the basis of this finding, we propose a new model in which it is assumed that two types of synaptic connections are formed by conditioning and are activated during memory recall, one type being connections from neurons representing conditioned stimulus to neurons inducing conditioned response and the other being connections from neurons representing conditioned stimulus to octopaminergic or dopaminergic neurons representing appetitive or aversive unconditioned stimulus, respectively. The former is called 'stimulus-response connection' and the latter is called 'stimulus-stimulus connection' by theorists studying classical conditioning in higher vertebrates. Our model predicts that pharmacological blockade of octopamine or dopamine receptors during the first stage of second-order conditioning does not impair second-order conditioning, because it impairs the formation of the stimulus-response connection but not the stimulus-stimulus connection. The results of our study with a cross-modal second-order conditioning were in full accordance with this prediction., Conclusion: We suggest that insect classical conditioning involves the formation of two kinds of memory traces, which match to stimulus-stimulus connection and stimulus-response connection. This is the first study to suggest that classical conditioning in insects involves, as does classical conditioning in higher vertebrates, the formation of stimulus-stimulus connection and its activation for memory recall, which are often called cognitive processes.

Olfactory learning in insects is a useful model for studying neural mechanisms underlying learning and memory, but memory storage capacity for olfactory learning in insects has not been studied. We investigate whether crickets are capable of simultaneously memorizing seven odour pairs. Fourteen odours were grouped into seven A/B pairs, and crickets in one group were trained to associate A odours with water reward and B odours with saline punishment for all the seven pairs. Crickets in another group were trained with the opposite stimulus arrangement. Crickets in all the groups exhibited significantly greater preference for the odours associated with water reward for all the seven odour pairs. We conclude that crickets are capable of memorizing seven odour pairs at the same time.

Biogenic amines play major roles in the regulation of behavior in vertebrates and invertebrates. Previous studies in honey bees and fruit-flies Drosophila suggested that octopamine (OA, invertebrate counterpart of noradrenaline) and dopamine (DA) participate in appetitive olfactory conditioning with sucrose reward and aversive olfactory conditioning with electric shock punishment, respectively. In order to determine whether the effects of the two chatecholamines on electric shock and sugar learning can be generalized to other kinds of appetitive and aversive reinforcers, we studied the effects of OA and DA receptor antagonists on appetitive olfactory learning with water reward, and aversive olfactory learning with saline punishment in the cricket Gryllus bimaculatus. Crickets injected with epinastine or mianserin, OA receptor antagonists, into the hemolymph exhibited an impairment of appetitive learning with water reward, while aversive learning with saline punishment remained intact. In contrast, fluphenazine, chlorpromazine or spiperone, DA receptor antagonists, impaired aversive learning without affecting appetitive learning. This finding, combined with findings in previous studies, suggests that the octopaminergic reward system and dopaminergic punishment system participate in insect olfactory learning with various appetitive and aversive reinforcements.

We studied the capability of the cricket Gryllus bimaculatus to select one of a pair of odors and to avoid the other in one context and to do the opposite in another context. One group of crickets was trained to associate one of a pair of odors (conditioned stimulus, CS1) with water reward (appetitive unconditioned stimulus, US+) and another odor (CS2) with saline solution (aversive US, US-) under illumination and to associate CS1 with US- and CS2 with US+ in the dark. Another group of crickets received training of the opposite stimulus arrangement. At 1 d after the training for 3 d, the former group significantly preferred CS1 over CS2 under illumination but preferred CS2 over CS1 in the dark, and the latter group exhibited the opposite odor preference. The results of control experiments showed that the background light condition had no significant effects on memory formation or retrieval unless it was explicitly associated with US during training. Thus, the visual context affected learning performance only when crickets were requested to use it to disambiguate the meaning of CSs and to predict USs.

The cricket Gryllus bimaculatus forms a stable olfactory memory that lasts for practically a lifetime. As a first step to elucidate the cellular mechanisms of olfactory learning and memory retention in crickets, we studied the dependency of memory retention on the de novo brain protein synthesis by injecting the protein synthesis inhibitor cycloheximide (CHX) into the head capsule. Injection of CHX inhibited (3)H-leucine incorporation into brain proteins by > 90% for 3 hr. Crickets were trained to associate peppermint odor with water (reward) and vanilla odor with saline solution (non-reward) and were injected with CHX before or at different times after training. Their odor preferences were tested at 2 hr, 1 day and 4 days after training. Memory retention at 2 hr after training was unaffected by CHX injection. However, the level of retention at 1 day and 4 days after training was lowered when CHX was injected 1 hour before training or at 1 hr or 6 hr after training. To study the time course of the development of CHX-sensitive memory phase, crickets that had been injected with CHX at 1 hr after training were tested at different times from 2 to 12 hr after training. The level of retention was unaffected up to 4 hr after training but significantly lowered at 5 hr after training, and the CHX-sensitive memory phase developed gradually during the next several hours. CHX dissociates two phases of olfactory memory in crickets: earlier protein synthesis-independent phase (< 4 hr) and later (> 5 hr) protein synthesis-dependent phase.

Temporal determinants of olfactory long-term memory retention in the cricket Gryllus bimaculatus were studied. Elementary appetitive and aversive conditioning procedures, as well as a differential conditioning procedure, were applied. In appetitive conditioning, peppermint odour was paired with a water reward. In aversive conditioning, vanilla odour was paired with saline solution. In differential conditioning, an appetitive conditioning trial was followed by an aversive conditioning trial. The odour preference of crickets was tested before and 2 h, 1 day and 4 days after training by allowing the crickets to choose between peppermint or vanilla sources. Differential conditioning or appetitive conditioning alone led to long-lasting memory retention with no significant decay from 2 h to 4 days after training, but retention after aversive conditioning was absent 1 day after training. Studies using differential conditioning have shown (i) that four trials are sufficient to cause a saturated level of acquisition, (ii) that conditioning is successful when the conditioned stimulus is presented immediately or 5 s before the onset of presentation of the unconditioned stimulus, (iii) that the optimal interval between trials is 2-5 min, and (iv) that anaesthetic treatment with CO2 given immediately after training results in memory disruption but that anaesthetic-resistant memory develops fully 20 min after training. This study demonstrates that a differential conditioning procedure is particularly effective for the formation of long-term memory.