Search

Your search keyword '"Frédéric Alexandre"' showing total 57 results
Start Over Author "Frédéric Alexandre" Topic artificial intelligence
57 results on '"Frédéric Alexandre"'

1. Vers un modèle de neurosciences cognitives computationnelles de la créativité

Author

Hugo Chateau-Laurent, Frédéric Alexandre, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Chateau-Laurent, Hugo, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest

Subjects
[INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], Prospective memory, Artificial intelligence, Explicit memory, Episodic memory, Computational cognitive neuroscience, [SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, [INFO.INFO-NE] Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], [STAT.ML] Statistics [stat]/Machine Learning [stat.ML], [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Creativity, ACM: I.: Computing Methodologies/I.2: ARTIFICIAL INTELLIGENCE, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], Cognitive control, Imagination, ACM: I.: Computing Methodologies/I.2: ARTIFICIAL INTELLIGENCE/I.2.6: Learning
Abstract

International audience; Recent progress in AI has expanded the boundaries of the cognitive functions that can be simulated, but creativity remains a challenge. Neuroscience sheds light on its mechanisms and its tight relationship with episodic memory and cognitive control, while machine learning provides preliminary models of these mechanisms. We present these lines of research and explain how they can be exploited in the domain of computational creativity in order to further expand the capabilities of AI.

Published
2021

2. Knowledge extraction from the learning of sequences in a long short term memory (LSTM) architecture

Author

Ikram Chraibi Kaadoud, Nicolas P. Rougier, Frédéric Alexandre, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2, Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)

Subjects
FOS: Computer and information sciences, Computer Science - Machine Learning, Information Systems and Management, Implicit learning, Computer science, media_common.quotation_subject, Machine Learning (stat.ML), 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], computer.software_genre, Sequence learning, Latent space, Management Information Systems, Machine Learning (cs.LG), [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [SCCO]Cognitive science, Knowledge extraction, Rule-based machine translation, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], Artificial Intelligence, Statistics - Machine Learning, 0202 electrical engineering, electronic engineering, information engineering, [INFO]Computer Science [cs], Neural and Evolutionary Computing (cs.NE), Cluster analysis, Recurrent Neural Networks, media_common, Interpretability, Grammar, business.industry, Computer Science - Neural and Evolutionary Computing, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, 020207 software engineering, Recurrent neural network, TheoryofComputation_MATHEMATICALLOGICANDFORMALLANGUAGES, 020201 artificial intelligence & image processing, Artificial intelligence, business, computer, Long Short Term Memory, Software, Natural language processing, Computer Science::Formal Languages and Automata Theory
Abstract

We introduce a general method to extract knowledge from a recurrent neural network (Long Short Term Memory) that has learnt to detect if a given input sequence is valid or not, according to an unknown generative automaton. Based on the clustering of the hidden states, we explain how to build and validate an automaton that corresponds to the underlying (unknown) automaton, and allows to predict if a given sequence is valid or not. The method is illustrated on artificial grammars (Reber's grammar variations) as well as on a real use-case whose underlying grammar is unknown., 18 pages, 17 figures

Published
2021
Full Text
View/download PDF

3. Reinforcement Symbolic Learning

Author

Chloé Mercier, Thierry Viéville, Frédéric Alexandre, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Laboratoire d'Innovation et Numérique pour l'Education (LINE), Université Nice Sophia Antipolis (1965 - 2019) (UNS), COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Université Côte d'Azur (UCA), AEx AIDE, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Université Nice Sophia Antipolis (... - 2019) (UNS)

Subjects
Models for Learning Sciences, Ontology Edit Distances, Computer science, business.industry, [SCCO.NEUR]Cognitive science/Neuroscience, [SHS.EDU]Humanities and Social Sciences/Education, Perspective (graphical), 0102 computer and information sciences, Ontology (information science), 01 natural sciences, Task (project management), Symbolic learning, Reinforcement Symbolic Learning, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], 03 medical and health sciences, 0302 clinical medicine, 010201 computation theory & mathematics, Reinforcement learning, Artificial intelligence, Reinforcement, Representation (mathematics), business, Set (psychology), 030217 neurology & neurosurgery
Abstract

International audience; Complex problem solving involves representing structured knowledge, reasoning and learning, all at once. In this prospective study, we make explicit how a reinforcement learning paradigm can be applied to a symbolic representation of a concrete problem-solving task, modeled here by an ontology. This preliminary paper is only a set of ideas while feasibility verification is still a perspective of this work.

Published
2021

4. Why, What and How to help each Citizen to Understand Artificial Intelligence?

Author

Marie-Hélène Comte, Romain Liblau, Aurelie Lagarrigue, Thierry Viéville, Frédéric Alexandre, Jade Becker, Margarida Romero, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Magic Makers, Inria Learning Lab (ILL), Inria Siège, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Laboratoire d'Innovation et Numérique pour l'Education (LINE), Université Nice Sophia Antipolis (... - 2019) (UNS), COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Université Côte d'Azur (UCA), Class´Code, Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Direction de la Culture et de l’Information Scientifiques (DCIS), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Inria Siège, and Université Nice Sophia Antipolis (1965 - 2019) (UNS)

Subjects
[SHS.EDU]Humanities and Social Sciences/Education, Learning analytics, Quantitative Evaluations, MOOC, 02 engineering and technology, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Artificial Intelligence, 0202 electrical engineering, electronic engineering, information engineering, Educational science, Sociology, Competence (human resources), Artificial intelligence for all, business.industry, 4. Education, Computational thinking, 05 social sciences, Perspective (graphical), 050301 education, Project Reports, Open Educational Resources (OERs), Scale (social sciences), 020201 artificial intelligence & image processing, Artificial intelligence, business, 0503 education, Discipline
Abstract

A critical understanding of digital technologies is an empowering competence for citizens of all ages. In this paper we introduce an open educational approach of artificial intelligence (AI) for everyone. Through a hybrid and participative MOOC we aim to develop a critical and creative perspective about the way AI is integrated in the different domains of our lives. We have built and now operate a MOOC in AI for all the citizens from 15 years old. The MOOC aims to help understanding AI foundations and applications, intended for a large public beyond the school domain, with more than 20,000 participants engaged in the MOOC after nine months. This study addresses the pedagogical methods for designing and evaluating the MOOC in AI. Through this study we raise four questions regarding citizen education in AI: Why (i.e., to which aim) sharing such citizen formation? What is the disciplinary knowledge to be shared? What are the competencies to develop? How can it be shared and evaluated? We finally share learning analytics, quantitative and qualitative evaluations and explain to which extent educational science research helps enlighten such large scale initiatives. The analysis of the MOOC in AI helps to identify that the main feedback related to AI is “fear”, because AI is unknown and mysterious to the participants. After developing playful AI simulations, the AI mechanisms become familiar for the MOOC participants and they can overcome their misconception on AI to develop a more critical point of view. This contribution describes a K-12 AI educational project or initiatives of a considerable impact, via the formation of teachers and other educators. Supplementary Information The online version contains supplementary material available at 10.1007/s13218-021-00725-7.

Published
2021
Full Text
View/download PDF

5. Augmenting Machine Learning with Flexible Episodic Memory

Author

Hugo Chateau-Laurent and Frédéric Alexandre

Subjects
Computer science, business.industry, Cognition, Cognitive neuroscience, Machine learning, computer.software_genre, Concept learning, Generalization (learning), Prospective memory, Explicit memory, Artificial intelligence, Set (psychology), business, computer, Episodic memory
Abstract

A major cognitive function is often overlooked in artificial intelligence research: episodic memory. In this paper, we relate episodic memory to the more general need for explicit memory in intelligent processing. We describe its main mechanisms and its involvement in a variety of functions, ranging from concept learning to planning. We set the basis for a computational cognitive neuroscience approach that could result in improved machine learning models. More precisely, we argue that episodic memory mechanisms are crucial for contextual decision making, generalization through consolidation and prospective memory.

Published
2021
Full Text
View/download PDF

6. A Structure of Restricted Boltzmann Machine for Modeling System Dynamics

Author

Olivier Bach, Frédéric Alexandre, Denis Penninckx, Alain Hugget, Guillaume Padiolleau, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Commissariat à l'énergie atomique et aux énergies alternatives (CEA), IEEE, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest

Subjects
Computer Science::Machine Learning, Restricted Boltzmann machine, Artificial neural network, Unsupervised Deep Learning, business.industry, Stochastic process, 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], System dynamics, 03 medical and health sciences, 0302 clinical medicine, State Representation Learning, 0202 electrical engineering, electronic engineering, information engineering, Unsupervised learning, Reinforcement learning, 020201 artificial intelligence & image processing, Artificial intelligence, business, Representation (mathematics), Feature learning, Factored Restricted Boltzmann Machine, 030217 neurology & neurosurgery
Abstract

International audience; This paper presents a new approach for learning transition function in state representation learning (SRL) for control. While state-of-the-art methods use different deterministic neural networks to learn forward and inverse state transition functions independently with auto-supervised learning, we introduce a bidirectional stochastic model to learn both transition functions. We aim at using the uncertainty of the model on its predictions as an intrinsic motivation for exploration to enhance the representation learning. More, using the same model to learn both transition functions allows sharing the parameters, which can reduce their number and should increase the embedding quality of the representation. We use a factored restricted Boltzmann machine (fRBM) based model, enhanced with dedicated structure for learning system dynamics and transitions with shared parameters. The presented work focuses on building the structure of the bidirectional transition model for unsupervised learning. Our fRBM structure is directly inspired from physics interactions between inputs and outputs in reinforcement learning framework. We compare different training algorithms for learning the model that must be able to predict observable random variables to be used in SRL framework. Our structure is not restricted to any type of observable, nevertheless in this paper we focus on learning dynamics from the OpenAI Gym environment Swinging Pendulum. We show that the proposed structure is able to learn bidirectional transition function and performs well in prediction task.

Published
2020
Full Text
View/download PDF

7. When Artificial Intelligence and Computational Neuroscience meet

Author

Philippe Gaussier, Benoît Girard, Peter Ford Dominey, Nicolas P. Rougier, Frédéric Alexandre, Mehdi Khamassi, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Institut National de la Santé et de la Recherche Médicale (INSERM), Equipes Traitement de l'Information et Systèmes (ETIS - UMR 8051), Ecole Nationale Supérieure de l'Electronique et de ses Applications (ENSEA)-Centre National de la Recherche Scientifique (CNRS)-CY Cergy Paris Université (CY), Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Architectures et modèles d'Adptation et de la cognition (AMAC), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Springer, Gaussier, Philippe, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and CY Cergy Paris Université (CY)-Centre National de la Recherche Scientifique (CNRS)-Ecole Nationale Supérieure de l'Electronique et de ses Applications (ENSEA)

Subjects
[INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], Computer science, media_common.quotation_subject, [INFO.INFO-NE] Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Computational intelligence, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], 03 medical and health sciences, 0302 clinical medicine, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Perception, [INFO.INFO-RB]Computer Science [cs]/Robotics [cs.RO], Set (psychology), 030304 developmental biology, media_common, 0303 health sciences, Computational neuroscience, business.industry, [SCCO.NEUR]Cognitive science/Neuroscience, [INFO.INFO-RB] Computer Science [cs]/Robotics [cs.RO], [SCCO.NEUR] Cognitive science/Neuroscience, Intelligent decision support system, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Cognition, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], Salient, Robot, Artificial intelligence, business, 030217 neurology & neurosurgery, [SDV.NEU.SC] Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences
Abstract

Computational Intelligence and Artificial Intelligence are both aiming at building machines and softwares capable of intelligent behavior. They are consequently prone to interactions, even if the latter is not necessarily interested in understanding how cognition emerges from the brain substrate. In this chapter, we enumerate, describe and discuss the most important fields of interactions. Some are methodological and are concerned with information representation, processing and learning. At the functional level, the focus is set on major cognitive functions like perception, navigation, decision making and language. Among the salient characteristics of the critical contributions of Computational Neuroscience to the development of intelligent systems, its systemic view of the cerebral functioning is particularly precious to model highly multimodal cognitive functions like decision making and language and to design cognitive architectures for the autonomous behavior of robots.

Published
2020

8. Pattern Separation in the Hippocampus: Distinct Circuits under Different Conditions

Author

Frédéric Alexandre, Randa Kassab, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest

Subjects
0301 basic medicine, Histology, Computer science, Process (engineering), media_common.quotation_subject, Emotions, Models, Neurological, Population, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Hippocampus, 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, Memory, Robustness (computer science), Biological neural network, Animals, Humans, Computer Simulation, Dentate gyrus, [INFO]Computer Science [cs], education, Function (engineering), Episodic memory, media_common, Neurons, Motivation, education.field_of_study, Recall, business.industry, General Neuroscience, Computational model, [SCCO.NEUR]Cognitive science/Neuroscience, Pattern recognition, [INFO.INFO-MO]Computer Science [cs]/Modeling and Simulation, 030104 developmental biology, Pattern separation, Artificial intelligence, Anatomy, Neural coding, business, 030217 neurology & neurosurgery
Abstract

International audience; Pattern separation is a fundamental hippocampal process thought to be critical for distinguishing similar episodic memories, and has long been recognized as a natural function of the dentate gyrus (DG) supporting autoassociative learning in CA3. Understanding how neural circuits within the DG-CA3 network mediate this process has received much interest, yet the exact mechanisms behind remain elusive. Here we argue for the case that sparse coding is necessary but not sufficient to ensure efficient separation and, alternatively, propose a possible interaction of distinct circuits which, nevertheless, act in synergy to produce a unitary function of pattern separation. The proposed circuits involve different functional granule-cell populations, a primary population mediates sparsification and provides recurrent excitation to the other populations which are related to additional pattern separation mechanisms with higher degrees of robustness against interference in CA3. A variety of top-down and bottom-up factors, such as motivation, emotion, and pattern similarity, controls the selection of circuitry depending on circumstances. According to this framework, a computational model is implemented and tested against model variants in a series of numerical simulations and biological experiments. The results demonstrate that the model combines fast learning, robust pattern separation and high storage capacity. It also accounts for the controversy around the involvement of the DG during memory recall, explains other puzzling findings, and makes predictions that can inform future investigations.

Published
2018
Full Text
View/download PDF

9. A biologically inspired neuronal model of reward prediction error computation

Author

Surampudi Bapi Raju, Pramod Kaushik, Maxime Carrere, Frédéric Alexandre, International Institute of Information Technology, Hyderabad [Hyderabad] (IIIT-H), Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Université d'Hyderabad, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest

Subjects
0301 basic medicine, business.industry, Computer science, Computation, Mean squared prediction error, Classical conditioning, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Machine learning, computer.software_genre, 03 medical and health sciences, 030104 developmental biology, 0302 clinical medicine, Reinforcement learning, Artificial intelligence, business, computer, 030217 neurology & neurosurgery, psychological phenomena and processes
Abstract

International audience; The neurocomputational model described here proposes that two dimensions involved in computation of reward prediction errors i.e magnitude and time could be computed separately and later combined unlike traditional reinforcement learning models. The model is built on biological evidences and is able to reproduce various aspects of classical conditioning, namely, the progressive cancellation of the predicted reward, the predictive firing from conditioned stimuli, and delineation of early rewards by showing firing for sooner early rewards and not for early rewards that occur with a longer latency in accordance with biological data.

Published
2017

10. A Modular Network Architecture Resolving Memory Interference Through Inhibition

Author

Randa Kassab and Frédéric Alexandre

Subjects
Network architecture, business.industry, Computer science, Generalization (learning), Interference theory, Context (language use), Artificial intelligence, Content-addressable memory, Modular design, Interference (wave propagation), business, Associative property
Abstract

In real learning paradigms like pavlovian conditioning, several modes of learning are associated, including generalization from cues and integration of specific cases in their context. Associative memories have been shown to be interesting neuronal models to learn quickly specific cases but they are hardly used in realistic applications because of their limited storage capacities resulting in interference when too many examples are considered. Inspired by biological considerations, we propose a modular model of associative memory including mechanisms to manipulate properly multimodal inputs and to detect and manage interference. This paper reports experiments that demonstrate the good behavior of the model in a wide series of simulations and discusses its impact both in machine learning and in biological modeling.

Published
2016
Full Text
View/download PDF

11. Beyond Machine Learning: Autonomous Learning

Author

Frédéric Alexandre, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest

Subjects
Computational Neuroscience, Active learning (machine learning), business.industry, Computer science, Intelligent decision support system, Multi-task learning, 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Machine learning, computer.software_genre, Autonomous Learning, Robot learning, Task (project management), Machine Learning, 03 medical and health sciences, 0302 clinical medicine, Computational learning theory, Inductive transfer, 0202 electrical engineering, electronic engineering, information engineering, 020201 artificial intelligence & image processing, Instance-based learning, Artificial intelligence, business, computer, 030217 neurology & neurosurgery
Abstract

International audience; Recently, Machine Learning has achieved impressive results, surpassing human performances, but these powerful algorithms are still unable to define their goals by themselves or to adapt when the task changes. In short, they are not autonomous. In this paper, we explain why autonomy is an important criterion for really powerful learning algorithms. We propose a number of characteristics that make humans more autonomous than machines when they learn. Humans have a system of memories where one memory can compensate or train another memory if needed. They are able to detect uncertainties and adapt accordingly. They are able to define their goals by themselves, from internal and external cues and are capable of self-evaluation to adapt their learning behavior. We also suggest that introducing these characteristics in the domain of Machine Learning is a critical challenge for future intelligent systems.

Published
2016
Full Text
View/download PDF

12. Modeling the sensory roles of noradrenaline in action selection

Author

Maxime Carrere, Frédéric Alexandre, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Alexandre, Frédéric

Subjects
0301 basic medicine, Sensory processing, Computer science, Brain activity and meditation, business.industry, medicine.medical_treatment, [INFO.INFO-NE] Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Sensory system, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Action selection, Neuromodulation (medicine), 03 medical and health sciences, 030104 developmental biology, 0302 clinical medicine, Action (philosophy), medicine, Autonomous learning, Artificial intelligence, Decision-making, business, Neuroscience, 030217 neurology & neurosurgery
Abstract

International audience; Noradrenaline participates in the neuromodulation of brain activity to modify the trade-off between exploration and exploitation when sensory contingencies have changed. Accordingly, attentional models of noradrenaline acting on sensory representations have been proposed. In this paper , we explore another possible action of this neuromodulator in the decision making process and report simulation results that illustrate that its role is concerned with different aspects of sensory processing. This is made possible by the extension of a classical model of action selection, to render it able to detect and to adapt to sudden changes in sensory contingencies, which is a major characteristic of autonomous learning.

Published
2016

13. A System-Level Model of Noradrenergic Function

Author

Maxime Carrere, Frédéric Alexandre, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest

Subjects
Computer science, media_common.quotation_subject, System level model, Activation function, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], decision making, Task (project management), 03 medical and health sciences, 0302 clinical medicine, Neuromodulation, Modulation (music), medicine, 0501 psychology and cognitive sciences, 050102 behavioral science & comparative psychology, Function (engineering), media_common, Mechanism (biology), business.industry, 05 social sciences, bio-inspiration, Neuromodulation (medicine), medicine.anatomical_structure, Artificial intelligence, business, Neuroscience, 030217 neurology & neurosurgery
Abstract

International audience; Neuromodulation is an interesting way to display different modes of functioning in a complex network. The effect of Noradrenaline has often been related to the exploration/exploitation trade-off and implemented in models by modulation of the gain of activation function. In this paper, we show that this mechanism is not sufficient for system-level networks and propose another way to implement it, exploiting reported inhibition of a striatal region by Noradrenaline. We describe here the corresponding model and report its performances in a reversal task.

Published
2016
Full Text
View/download PDF

14. Modeling Neuromodulation as a Framework to Integrate Uncertainty in General Cognitive Architectures

Author

Frédéric Alexandre, Maxime Carrere, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest

Subjects
0301 basic medicine, Cognitive science, Accurate estimation, Computer science, business.industry, Neuromodulation, Cognition, Cognitive architecture, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], computer.software_genre, bio-inspiration, Field (computer science), Neuromodulation (medicine), decision making, 03 medical and health sciences, Intelligent agent, 030104 developmental biology, 0302 clinical medicine, Artificial general intelligence, Artificial intelligence, business, computer, 030217 neurology & neurosurgery
Abstract

International audience; One of the most critical properties of a versatile intelligent agent is its capacity to adapt autonomously to any change in the environment without overly complexifying its cognitive architecture. In this paper, we propose that understanding the role of neuromodulation in the brain is of central interest for this purpose. More precisely, we propose that an accurate estimation of the nature of uncertainty present in the environment is performed by specific brain regions and broadcast throughout the cerebral network by neuromodulators, resulting in appropriate changes in cerebral functioning and learning modes. Better understanding the principles of these mechanisms in the brain might tremendously inspire the field of Artificial General Intelligence. The original contribution of this paper is to relate the four major neuromodulators to four fundamental dimensions of uncertainty.

Published
2016
Full Text
View/download PDF

15. No clock to rule them all

Author

Wahiba Taouali, Thierry Viéville, Frédéric Alexandre, Nicolas P. Rougier, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Scheme (programming language), Dynamic field, Central clock, Theoretical computer science, Dynamic neural fields, Computer science, Models, Neurological, Stability (learning theory), 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], USable, Whole systems, 03 medical and health sciences, 0302 clinical medicine, Artificial Intelligence, Physiology (medical), 0202 electrical engineering, electronic engineering, information engineering, Computer Simulation, computer.programming_language, Asynchronous computation, Artificial neural network, General Neuroscience, Numerical analysis, [INFO.INFO-NA]Computer Science [cs]/Numerical Analysis [cs.NA], 020201 artificial intelligence & image processing, Numerical methods, Neural Networks, Computer, computer, Neural networks, Algorithms, 030217 neurology & neurosurgery
Abstract

International audience; This article introduces general concepts and definitions related to the notion of asynchronous computation in the framework of artificial neural networks. Using the dynamic field theory as an illustrative example, we explain why one may want to perform such asynchronous computation and how one can implement it since this computational scheme draws several consequences on both the trajectories and the stability of the whole system. After giving an unequivocal definition of asynchronous computation, we present a few practically usable methods and quantitative bounds that can guarantee most of the mesoscopic properties of the system.

Published
2011
Full Text
View/download PDF

16. Incremental data-driven learning of a novelty detection model for one-class classification with application to high-dimensional noisy data

Author

Randa Kassab and Frédéric Alexandre

Subjects
Artificial neural network, business.industry, Computer science, Online machine learning, Pattern recognition, Semi-supervised learning, Machine learning, computer.software_genre, Novelty detection, Generative model, Artificial Intelligence, Robustness (computer science), One-class classification, Artificial intelligence, business, Data-driven learning, computer, Software
Abstract

Most conventional learning algorithms require both positive and negative training data for achieving accurate classification results. However, the problem of learning classifiers from only positive data arises in many applications where negative data are too costly, difficult to obtain, or not available at all. This paper describes a new machine learning approach, called ILoNDF (Incremental data-driven Learning of Novelty Detector Filter). The approach is inspired by novelty detection theory and its learning method, which typically requires only examples from one class to learn a model. One advantage of ILoNDF is the ability of its generative learning to capture the intrinsic characteristics of the training data by continuously integrating the information relating to the relative frequencies of the features of training data and their co-occurrence dependencies. This makes ILoNDF rather stable and less sensitive to noisy features which may be present in the representation of the positive data. In addition, ILoNDF does not require extensive computational resources since it operates on-line without repeated training, and no parameters need to be tuned. In this study we mainly focus on the robustness of ILoNDF in dealing with high-dimensional noisy data and we investigate the variation of its performance depending on the amount of data available for training. To make our study comparable to previous studies, we investigate four common methods: PCA residuals, Hotelling's T 2 test, an auto-associative neural network, and a one-class version of the SVM classifier (lately a favored method for one-class classification). Experiments are conducted on two real-world text corpora: Reuters and WebKB. Results show that ILoNDF tends to be more robust, is less affected by initial settings, and consistently outperforms the other methods.

Published
2008
Full Text
View/download PDF

17. Is there continuity between categorical and coordinate spatial relations coding?

Author

Christine Schiltz, Frédéric Alexandre, Yves Burnod, Claude Houssemand, and Romain Martin

Subjects
Communication, Visual perception, Working memory, business.industry, Cognitive Neuroscience, Experimental and Cognitive Psychology, Pattern recognition, Grid, Behavioral Neuroscience, Spatial relation, Categorization, Artificial intelligence, business, Psychology, Categorical variable, Spatial organization, Coding (social sciences)
Abstract

We ask the question whether the coding of categorical versus coordinate spatial relations depends on different neural networks showing hemispheric specialization or whether there is continuity between these two coding types. The 'continuous spatial coding' hypothesis would mean that the two coding types rely essentially on the same neural network consisting of more general-purpose processes, such as visuo-spatial attention, but with a different weighting of these general processes depending on exact task requirements. With event-related fMRI, we have studied right-handed male subjects performing a grid/no-grid visuo-spatial working memory task inducing categorical and coordinate spatial relations coding. Our data support the 'continuous spatial coding' hypothesis, indicating that, while based on the same fronto-parieto-occipital neural network than categorical spatial relations coding, the coding of coordinate spatial relations relies more heavily on attentional and executive processes, which could induce hemispheric differences similar to those described in the literature. The results also show that visuo-spatial working memory consists of a short-term posterior store with a capacity of up to three elements in the parietal and extrastriate cortices. This store depends on the presence of a visible space categorization and thus can be used for the coding of categorical spatial relations. When no visible space categorization is given or when more than three elements have to be coded, additional attentional and executive processes are recruited, mainly located in the dorso-lateral prefrontal cortex.

Published
2008
Full Text
View/download PDF

18. Spatio-temporal biologically inspired models for clean and noisy speech recognition

Author

Laurent Boougrain, Zouhour Neji Ben Salem, Frédéric Alexandre, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Speech perception, Computer science, ACM: I.: Computing Methodologies/I.5: PATTERN RECOGNITION/I.5.4: Applications/I.5.4.1: Signal processing, Cognitive Neuroscience, Speech recognition, 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Spatio-temporal processing, computer.software_genre, 03 medical and health sciences, 0302 clinical medicine, ACM: I.: Computing Methodologies/I.2: ARTIFICIAL INTELLIGENCE/I.2.6: Learning/I.2.6.2: Connectionism and neural nets, Artificial Intelligence, 0202 electrical engineering, electronic engineering, information engineering, business.industry, SIGNAL (programming language), Biologically inspired models, Computer Science Applications, [INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD], 020201 artificial intelligence & image processing, Artificial intelligence, business, computer, 030217 neurology & neurosurgery, Natural language processing
Abstract

International audience; Speech perception and recognition using biologically inspired models is a challenging issue not well explored yet. The paper presents two spatio-temporal biologically inspired methods for the preprocessing and learning of speech signal based on self-organization map (SOM). The experimental results are very encouraging and provide a framework that could be more studied to enhance speech perception and recognition technology.

Published
2007
Full Text
View/download PDF

19. A Heteroassociative Learning Model Robust to Interference

Author

Frédéric Alexandre, Randa Kassab, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)

Subjects
Biological data, Computer science, business.industry, Information processing, Content-addressable memory, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Catastrophic interference, Machine learning, computer.software_genre, Hippocampus, Memorization, Autoassociative memory, Robustness (computer science), Associative Memory, Artificial intelligence, business, Interference, computer, Associative property
Abstract

Best Paper Award; International audience; Neuronal models of associative memories are recurrent networks able to learn quickly patterns as stable states of the network. Their main acknowledged weakness is related to catastrophic interference when too many or too close examples are stored. Based on biological data we have recently proposed a model resistant to some kinds of interferences related to heteroassociative learning. In this paper we report numerical experiments that highlight this robustness and demonstrate very good performances of memorization. We also discuss convergence of interests for such an adaptive mechanism for biological modeling and information processing in the domain of machine learning.

Published
2015

20. From biological to numerical experiments in systemic neuroscience: a simulation platform

Author

Nicolas Denoyelle, Florian Pouget, Thierry Viéville, Frédéric Alexandre, Maxime Carrere, Topology-Aware System-Scale Data Management for High-Performance Computing (TADAAM), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), Mnemonic Synergy (Mnemosyne), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), A.R. Londral, P. Encarnação, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Computational Neuroscience, 0303 health sciences, Computational neuroscience, Computer science, business.industry, Representation (systemics), Virtual Reality, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Cognition, Benchmarking, Virtual reality, External Data Representation, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], 03 medical and health sciences, 0302 clinical medicine, Artificial intelligence, Neural coding, business, Neuroscience, 030217 neurology & neurosurgery, Simulation, 030304 developmental biology, Complement (set theory)
Abstract

International audience; Studying and modeling the brain as a whole is a real challenge. For such systemic models (in contrast to models of one brain area or aspect), there is a real need for new tools designed to perform complex numerical experiments, beyond usual tools distributed in the computer science and neuroscience communities. Here, we describe an effective solution, freely available on line and already in use, to validate such models of the brain functions. We explain why this is the best choice, as a complement to robotic setup, and what are the general requirements for such a benchmarking platform. In this experimental setup, the brainy-bot implementing the model to study is embedded in a simplified but realistic controlled environment. From visual, tactile and olfactory input, to body, arm and eye motor command, in addition to vital interoceptive cues, complex survival behaviors can be experimented. We also discuss here algorithmic high-level cognitive modules, making the job of building biologically plausible bots easier. The key point is to possibly alternate the use of symbolic representation and of complementary and usual neural coding. As a consequence, algorithmic principles have to be considered at higher abstract level, beyond a given data representation, which is an interesting challenge.

Published
2015

21. Modeling pavlovian conditioning with multiple neuronal populations

Author

Frédéric Alexandre, Maxime Carrere, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)

Subjects
Flexibility (engineering), Artificial neural network, Quantitative Biology::Neurons and Cognition, business.industry, Computer science, Classical conditioning, Sensory system, Context (language use), [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Machine learning, computer.software_genre, Trial and error, Robustness (computer science), Artificial intelligence, business, computer
Abstract

International audience; Artificial Neural Networks are often used as black boxes to implement behavioral functions, developed by trials and errors, fed with sensory inputs and controlled by some criteria of performance. This is the case for pavlovian conditioning where important sensory information is non ambiguous and where the error of prediction is to be minimized. These past years, taking into account critical conditioning behaviors entailed complexifying the neuronal functioning and learning rules. This resulted in networks still simple at the architectural level but with a dynamics difficult to master. Instead, we propose a new neuronal model using uniform and classical neuronal dynamics, with a more complex architecture based on recent findings in neuroscience. Results reported in this paper confirm the good behavior of the model and justify the complex architecture by the greater robustness and flexibility of the model.

Published
2015
Full Text
View/download PDF

22. [Untitled]

Author

Maria Gonzalez, Frédéric Alexandre, Gilbert Stein, Vincent Bouchot, Andor L.W. Lips, Daniel Cassard, and Laurent Bougrain

Subjects
Geographic information system, Artificial neural network, business.industry, Computer science, Perceptron, computer.software_genre, Mineral resource classification, Mineral exploration, Knowledge extraction, Information system, Domain knowledge, Data mining, Artificial intelligence, business, computer, General Environmental Science
Abstract

This study is concerned with understanding of the formation of ore deposits (precious and base metals) and contributes to the exploration and discovery of new occurrences using artificial neural networks. From the different digital data sets available in BRGM's GIS Andes (a comprehensive metallogenic continental-scale Geographic Information System) 25 attributes are identified as known factors or potential factors controlling the formation of gold deposits in the Andes Cordillera. Various multilayer perceptrons were applied to discriminate possible ore deposits from barren sites. Subsequently, because artificial neural networks can be used to construct a revised model for knowledge extraction, the optimal brain damage algorithm by LeCun was applied to order the 25 attributes by their relevance to the classification. The approach demonstrates how neural networks can be used efficiently in a practical problem of mineral exploration, where general domain knowledge alone is insufficient to satisfactorily model the potential controls on deposit formation using the available information in continent-scale information systems.

Published
2003
Full Text
View/download PDF

23. Knowledge extraction using artificial neural networks: application to radar target identification

Author

Jean-Francois Remm, Frédéric Alexandre, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
interprétation de signal, Computer science, pruning, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], Computer Science::Neural and Evolutionary Computation, Feature extraction, multilayered perceptron, knowledge extraction, 02 engineering and technology, Signal, Transfer function, law.invention, Knowledge extraction, law, 0202 electrical engineering, electronic engineering, information engineering, Electrical and Electronic Engineering, Radar, signal interpretation, élagage, perceptron multicouches, Signal processing, Artificial neural network, business.industry, 020206 networking & telecommunications, Pattern recognition, Perceptron, Identification (information), extraction de connaissances, Control and Systems Engineering, Signal Processing, 020201 artificial intelligence & image processing, Computer Vision and Pattern Recognition, Artificial intelligence, business, Software, radar
Abstract

Article dans revue scientifique avec comité de lecture.; International audience; Artificial neural networks are efficient for performing signal processing but are not able to explain their decision nor to extract knowledge from data. We propose here a way to extract rules and hints from the hidden layers of a multilayered perceptron. The network is first pruned and then the progressive use of a simpler transfer function can allow such knowledge extraction. This method has been successfully applied to radar signal identification.

Published
2002
Full Text
View/download PDF

24. Feature, Configuration, History : a bio-inspired framework for information representation in neural networks

Author

Frédéric Alexandre, Maxime Carrere, Randa Kassab, Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), ANR-10-INTB-0204,KEOpS,Algorithmes pour la modélisation du système visuel: de la vision naturelle aux applications numériques.(2010), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Structure (mathematical logic), Computational Neuroscience, Computational neuroscience, Artificial neural network, business.industry, Computer science, Information processing, Representation (systemics), [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Machine learning, computer.software_genre, medicine.anatomical_structure, Feature (computer vision), Pavlovian Conditioning, medicine, Granularity, Artificial intelligence, Sensory cortex, Information Representation, business, computer
Abstract

International audience; Artificial Neural Networks are very efficient adaptive models but one of their recognized weaknesses is about information representation, often carried out in an input vector without a structure. Beyond the classical elaboration of a hierarchical representation in a series of layers, we report here inspiration from neuroscience and argue for the design of heterogenous neural networks, processing information at feature, configuration and history levels of granularity, and interacting very efficiently for high-level and complex decision making. This framework is built from known characteristics of the sensory cortex, the hippocampus and the prefrontal cortex and is exemplified here in the case of pavlovian conditioning, but we propose that it can be advantageously applied in a wider extent, to design flexible and versatile information processing with neuronal computation.

Published
2014

25. Connectionist-Symbolic Integration

Author

Frédéric Alexandre and Ron Sun

Subjects
Connectionism, Computer science, business.industry, Hybrid system, Stochastic grammar, Artificial intelligence, Cognitive architecture, DUAL (cognitive architecture), business, Agent architecture, Symbolic integration, Abductive reasoning
Abstract

Contents: Preface. R. Sun, An Introduction to Hybrid Connectionist-Symbolic Models. Part I: Reviews and Overviews M. Hilario, An Overview of Strategies for Neurosymbolic Integration. R. Khosla, T. Dillon, Task Structure Level Symbolic-Connectionist Architecture. Y. Lallement, F. Alexandre, Cognitive Aspects of Neurosymbolic Integration. L. Magdalena, A First Approach to a Taxonomy of Fuzzy-Neural Systems. Part II: Learning in Multi-Module Systems T. Johnson, J. Zhang, H. Wang, A Hybrid Learning Model of Abductive Reasoning. R. Sun, T. Peterson, A Hybrid Agent Architecture for Reactive Sequential Decision Making. M. Malek, B. Amy, A Preprocessing Model for Integrating Case-Based Reasoning and Prototype-Based Neural Network. B. Orsier, A. Labbi, A Step Toward Fully Integrated Hybrid Systems. J.C. Gonzalez, J.R. Velasco, C.A. Iglesias, A Distributed Platform for Symbolic-Connectionist Interoperation. Part III: Representing Symbolic Knowledge. B. Kokinov, Micro-Level Hybridization in the Cognitive Architecture Dual. S. Stevenson, An Integrated Symbolic/Connectionist Parsing Architecture. X. Wu, M. McTear, P. Ojha, H. Dai, A Hybrid System Framework for Disambiguating Word Senses. N.S. Park, D. Robertson, A Localist Network Architecture for Logical Inference. J. Austin, A Distributed Associative Memory for Symbolic Reasoning. E. Mjolsness, Symbolic Neural Networks Derived From Stochastic Grammar Domain Models. Part IV: Acquiring Distributed Representation. T.A. Plate, Structure Matching and Transformation With Distributed Representations. A. Sperduti, A. Starita, C. Goller, Distributed Representations for Terms in Hybrid Reasoning Systems. R. Krosley, M. Misra, Symbolic Distributed Representations. Part V: Epilog F. Alexandre, An Analysis of Connectionist-Symbolic Integration.

Published
2013
Full Text
View/download PDF

26. How OWE architectures encode contextual effects in artificial neural networks

Author

Nicolas Pican and Frédéric Alexandre

Subjects
Numerical Analysis, General Computer Science, Artificial neural network, business.industry, Computer science, Process (engineering), Applied Mathematics, Computer Science::Neural and Evolutionary Computation, Estimator, Context (language use), Space (commercial competition), Machine learning, computer.software_genre, Backpropagation, Theoretical Computer Science, Set (abstract data type), Discriminant, Modeling and Simulation, Artificial intelligence, business, GeneralLiterature_REFERENCE(e.g.,dictionaries,encyclopedias,glossaries), computer
Abstract

Artificial neural networks (ANNs) are widely used for classification tasks where discriminant cues and also contextual parameters are proposed as ANN inputs. When the input space is too large to enable a robust, time limited learning, a classical solution consists in designing a set of ANNs for different context domains. We have proposed a new learning algorithm, the lateral contribution learning algorithm (LCLA), based on the backpropagation learning algorithm, which allows for such a solution with a reduced learning time and more efficient performances thanks to lateral influences between networks. This attractive, but heavy solution has been improved thanks to the orthogonal weight estimator (OWE) technique, an original architectural technique which, under light constraints, merges the set of ANNs in one ANN whose weights are dynamically estimated, for each example, by others ANNs, fed by the context. This architecture allows to give a very rich and interesting interpretation of the weight landscape. We illustrate this interpretation with two examples: a mathematical function estimation and a process modelization used in neurocontrol.

Published
1996
Full Text
View/download PDF

27. Artificial neural networks for the presetting of a steel temper mill

Author

P. Bresson, Frédéric Alexandre, and Nicolas Pican

Subjects
Artificial neural network, Connectionism, Computer science, business.industry, Computer Science::Neural and Evolutionary Computation, General Engineering, Mill, Artificial intelligence, business, Hybrid model
Abstract

Studies about presetting temper mills have traditionally used mathematical tools. But artificial neural networks can help solve the problem of modeling complex functions in high-dimensional spaces. On-line implementation of an ANN at a temper mill plant has led to a hybrid model that mixes symbolic and connectionist modules.

Published
1996
Full Text
View/download PDF

28. Visual Target Selection Emerges from a Bio-inspired Network Topology

Author

Nicolas P. Rougier, Frédéric Alexandre, Wahiba Taouali, Taouali, Wahiba, J. Kacprzyk, Neuromimetic intelligence (CORTEX), Inria Nancy - Grand Est, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Department of Complex Systems, Artificial Intelligence & Robotics (LORIA - AIS), Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS), Mnemonic Synergy (Mnemosyne), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Institut des Maladies Neurodégénératives [Bordeaux] (IMN), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)

Subjects
genetic structures, Process (engineering), Computer science, Visual Atten- tion, [INFO.INFO-NE] Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Network topology, 050105 experimental psychology, Superior Colliculus, 03 medical and health sciences, 0302 clinical medicine, 0501 psychology and cognitive sciences, Computer vision, Selection (genetic algorithm), [INFO.INFO-BI] Computer Science [cs]/Bioinformatics [q-bio.QM], Biological data, [SDV.BIBS] Life Sciences [q-bio]/Quantitative Methods [q-bio.QM], business.industry, Orientation (computer vision), Superior colliculus, 05 social sciences, Robotics, [SDV.BIBS]Life Sciences [q-bio]/Quantitative Methods [q-bio.QM], Ocular Saccades, Saccadic masking, Dynamic Neural Field, Artificial intelligence, [INFO.INFO-BI]Computer Science [cs]/Bioinformatics [q-bio.QM], business, 030217 neurology & neurosurgery
Abstract

International audience; The orientation of sensors toward regions of interest of the environment is an important motor activity, monitored by ancient struc- tures of the brainstem. Particularly, the superior colliculus is known to be deeply involved in visual saccadic behavior. Target selection relies on various hints including exogenous information about the nature and the position of candidate targets and endogenous information about current motivations. We present a model of the collicular structure based on bio- logical data, the speci city of which is related to the homogeneity of the underlying substratum of computation. This makes it more suitable to process massive visual ows on a distributed architecture, as it could be requested in a realistic task in autonomous robotics. The present model is restricted to the exogenous part of the visual pathway, from the retina to the superior colliculus. A realistic behavior for the selection of exogenous targets is reported here

Published
2012

29. An on-line learning algorithm for the orthogonal weight estimation of MLP

Author

Nicolas Pican, Jean-Claude Fort, and Frédéric Alexandre

Subjects
Computer Science::Machine Learning, Wake-sleep algorithm, Computer Networks and Communications, Active learning (machine learning), Computer science, business.industry, General Neuroscience, Population-based incremental learning, Computer Science::Neural and Evolutionary Computation, Stability (learning theory), Estimator, Context (language use), Semi-supervised learning, Perceptron, Artificial Intelligence, Computer Science::Computer Vision and Pattern Recognition, Artificial intelligence, business, Algorithm, Software
Abstract

We propose an on-line learning algorithm for Multi Layered Perceptrons (MLP) with an Orthogonal Weight Estimator (OWE) architecture. Such an architecture allows to dynamically and efficiently estimate the weights of a MLP in context dependent behaviour problems. The proposed learning algorithm attempts to solve the problem of time-consuming in the learning phase encountered to train these weight estimators.

Published
1994
Full Text
View/download PDF

30. Reinforcement learning and dimensionality reduction: A model in computational neuroscience

Author

Nishal P. Shah and Frédéric Alexandre

Subjects
Computational neuroscience, Computer science, business.industry, Dimensionality reduction, 05 social sciences, Analogy, Action selection, 050105 experimental psychology, Reduction (complexity), 03 medical and health sciences, 0302 clinical medicine, Basal ganglia, Principal component analysis, Reinforcement learning, 0501 psychology and cognitive sciences, Artificial intelligence, business, 030217 neurology & neurosurgery, Curse of dimensionality
Abstract

Basal Ganglia, a group of sub-cortical neuronal nuclei in the brain, are commonly described as the neuronal substratum to Reinforcement Learning. Since the seminal work by Schultz [1], a huge amount of work has been done to deepen that analogy, from functional and anatomic points of view. Nevertheless, a noteworthy architectural hint has been hardly explored: the outstanding reduction of dimensionality from the input to the output of the basal ganglia. Bar-Gad et al. [2] have suggested that this transformation could correspond to a Principal Component Analysis but did not explore the full functional consequences of this hypothesis. In this paper, we propose to study this mechanism within a model more realistic from a computational neuroscience point of view. Particularly, we show its feasibility when the loop is closed, in the framework of Action Selection.

Published
2011
Full Text
View/download PDF

31. Can Self-Organization Emerge through Dynamic Neural Fields Computation?

Author

Frédéric Alexandre, Lucian Alecu, Hervé Frezza-Buet, SUPELEC-Campus Metz, Ecole Supérieure d'Electricité - SUPELEC (FRANCE), Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Computer science, Computation, [SCCO.COMP]Cognitive science/Computer science, Neural fields, 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Field (computer science), 03 medical and health sciences, 0302 clinical medicine, Self organisation, Artificial Intelligence, 0202 electrical engineering, electronic engineering, information engineering, cognitive systems, Layer (object-oriented design), Flexibility (engineering), Self-organization, Quantitative Biology::Neurons and Cognition, business.industry, Perspective (graphical), self-organization, Human-Computer Interaction, 020201 artificial intelligence & image processing, dynamic neural fields, Artificial intelligence, business, 030217 neurology & neurosurgery, Software
Abstract

International audience; In this paper, dynamic neural fields are used to develop key features of a cortically-inspired computational module. Under the perspective of designing computational systems that can exhibit the flexibility and genericity of the cortical substrate, using neural field as the competition layer for self-organizing modules has to be considered. However, despite the fact that they serve as a biologically-inspired model, applying dynamic neural fields to drive self-organization is not straightforward. In order to address that issue, an original method for evaluating neural field equations is proposed, based on statistical measurements of the field behavior in some scenarios. Limitations of classical neural field equations are then quantified, and an original field equation is proposed to overcome these difficulties. The performance of the proposed field model is discussed in comparison with some previously considered models, leading to the promotion of the proposed model as a suitable mean for processing competition in cortex-like computation for cognitive systems.

Published
2011
Full Text
View/download PDF

32. Effects of a Modulatory Feedback upon the BCM learning rule

Author

Frédéric Alexandre, Thomas Girod, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
business.industry, General Neuroscience, lcsh:QP351-495, Feed forward, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Machine learning, computer.software_genre, lcsh:RC321-571, 03 medical and health sciences, Cellular and Molecular Neuroscience, 0302 clinical medicine, lcsh:Neurophysiology and neuropsychology, Learning rule, Path (graph theory), 030212 general & internal medicine, Artificial intelligence, business, Psychology, computer, lcsh:Neurosciences. Biological psychiatry. Neuropsychiatry, 030217 neurology & neurosurgery
Abstract

International audience; By applying a modulatory feedback upon the BCM learning rule, we show that it is possible to introduce a bias in the learning process, thus promoting a certain kind of selectivity on the feedforward path.

Published
2009

33. Cortical basis of communication: local computation, coordination, attention

Author

Frédéric Alexandre, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Eye Movements, Computer science, Cognitive Neuroscience, media_common.quotation_subject, Models, Neurological, Computational neurosciences, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], 050105 experimental psychology, Feedback, 03 medical and health sciences, 0302 clinical medicine, Cognition, Thalamus, Artificial Intelligence, Perception, Neural Pathways, medicine, Visual attention, Humans, 0501 psychology and cognitive sciences, Attention, media_common, Cognitive science, Cerebral Cortex, Neurons, Computational neuroscience, Artificial neural network, Communication, 05 social sciences, Representation (systemics), Eye movement, Information flow, Model of the cortex, medicine.anatomical_structure, Cerebral cortex, Coordination, Visual Perception, Neural Networks, Computer, 030217 neurology & neurosurgery, Algorithms
Abstract

International audience; Human communication emerges from cortical processing, known to be implemented on a regular repetitive neuronal substratum. The supposed genericity of cortical processing has elicited a series of modeling works in computational neuroscience that underline the information flows driven by the cortical circuitry. In the minimalist framework underlying the current theories for the embodiment of cognition, such a generic cortical processing is exploited for the coordination of poles of representation, as it is reported in this paper for the case of visual attention. Interestingly, this case emphasize how abstract internal referents are built to conform to memory requirements. This paper proposes that these referents are the basis for communication in humans, which is firstly a coordination and an attentional procedure with regard to their congeners.

Published
2009

34. The cortical column: A new processing unit for multilayered networks

Author

Jean-Paul Haton, Frédéric Alexandre, Yves Burnod, and F. Guyot

Subjects
business.industry, Computer science, Process (engineering), Cognitive Neuroscience, Sensory system, Type (model theory), Machine learning, computer.software_genre, medicine.anatomical_structure, Connectionism, Artificial Intelligence, Simple (abstract algebra), Learning rule, Pattern recognition (psychology), medicine, Artificial intelligence, business, Unit (ring theory), Cortical column, computer
Abstract

We propose in this paper a new connectionist unit that matches a biological model of the cortical column. The architectural and functional characteristics of this unit have been designed in the simplest manner in order to simulate human-like reasoning, and to be as similar as possible to the main known features of real intracortical networks. We use a new type of learning rule which can easily take into account goal-oriented combinations of actions in behavioral programs. These learning rules are both simple and biologically plausible. We show in this paper that such units can be used in multilayered networks to perform pattern recognition, with feedback connections effecting an attentive gating of sensory information flow. Computer simulations were performed to assess the ability of a multilayered network made of these biologically inspired units to perform standard speech and visual recognition. Such simulations show levels of performance equivalent to the best currently available connectionist networks for typical human-like problems, with very fast learning and recognition processes. Furthermore, this type of “cortical” unit can be used in more general multilayered networks with units controlling different types of external processing, in order to learn programs of actions which may be included in the process of recognition.

Published
1991
Full Text
View/download PDF

35. From physiological principles to computational models of the cortex

Author

Frédéric Alexandre, Jérémy Fix, Nicolas P. Rougier, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), and Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)

Subjects
Exploit, Computer science, Models, Neurological, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Machine learning, computer.software_genre, 050105 experimental psychology, 03 medical and health sciences, 0302 clinical medicine, Robustness (computer science), Physiology (medical), Animals, Humans, 0501 psychology and cognitive sciences, Computer Simulation, Visual search, Cerebral Cortex, Neurons, Computational model, Biological data, Computational neuroscience, business.industry, General Neuroscience, 05 social sciences, Computational Biology, Grid, Asynchronous communication, Evoked Potentials, Visual, Artificial intelligence, business, computer, 030217 neurology & neurosurgery
Abstract

Understanding the brain goes through the assimilation of an increasing amount of biological data going from single cell recording to brain imaging studies and behavioral analysis. The description of cognition at these three levels provides us with a grid of analysis that can be exploited for the design of computational models. Beyond data related to specific tasks to be emulated by models, each of these levels also lays emphasis on principles of computation that must be obeyed to really implement biologically inspired computations. Similarly, the advantages of such a joint approach are twofold: computational models are a powerful tool to experiment brain theories and assess them on the implementation of realistic tasks, such as visual search tasks. They are also a way to explore and exploit an original formalism of asynchronous, distributed and adaptive computations with such precious properties as self-organization, emergence, robustness and more generally abilities to cope with an intelligent interaction with the world. In this article, we first discuss three levels at which a cortical circuit might be observed to provide a modeler with sufficient information to design a computational model and illustrate this principle with an application to the control of visual attention.

Published
2007
Full Text
View/download PDF

36. A Distributed Model of Spatial Visual Attention

Author

Julien Vitay, Nicolas P. Rougier, Frédéric Alexandre, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP), S. Wermter, G. Palm and M. Elshaw, and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Artificial neural network, Computer science, business.industry, 05 social sciences, Central nervous system, Sensory system, Robotics, [INFO.INFO-RO]Computer Science [cs]/Operations Research [cs.RO], [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], 050105 experimental psychology, Domain (software engineering), 03 medical and health sciences, 0302 clinical medicine, medicine.anatomical_structure, Salient, medicine, Key (cryptography), [SDV.NEU]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC], 0501 psychology and cognitive sciences, Computer vision, Artificial intelligence, Biomimetics, business, Massively parallel, 030217 neurology & neurosurgery
Abstract

International audience; Although biomimetic autonomous robotics relies on the massively parallel architecture of the brain, a key issue for designers is to temporally organize behaviour. The distributed representation of the sensory information has to be coherently processed to generate relevant actions. In the visuomotor domain, we propose here a model of visual exploration of a scene by the means of localized computations in neural populations whose architecture allows the emergence of a coherent behaviour of sequential scanning of salient stimuli. It has been implemented on a real robotic platform exploring a moving and noisy scene including several identical targets.

Published
2005
Full Text
View/download PDF

37. Towards Word Semantics from Multi-modal Acoustico-Motor Integration: Application of the Bijama Model to the Setting of Action-Dependant Phonetic Representations

Author

Olivier Ménard, Frédéric Alexandre, Hervé Frezza-Buet, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), and Stefan Wermter and Günther Palm and Mark Elshaw

Subjects
Artificial neural network, Computer science, Process (engineering), business.industry, Association (object-oriented programming), Phonetics, 02 engineering and technology, Semantics, computer.software_genre, 03 medical and health sciences, 0302 clinical medicine, Modal, Learning rule, 0202 electrical engineering, electronic engineering, information engineering, 020201 artificial intelligence & image processing, continuum neural field theory self-organized maps multi-modal, Artificial intelligence, business, computer, 030217 neurology & neurosurgery, Word (computer architecture), Natural language processing
Abstract

This paper presents a computational self-organizing model of multi-modal information, inspired from cortical maps. It shows how the organization in a map can be influenced by the same process occurring in other maps. We illustrate this approach on a phonetic - motor association, that shows that the organization of words can integrate motor constraints, as observed in humans.

Published
2005
Full Text
View/download PDF

38. Analysis of vigilance states by neural networks

Author

Mohamed Hedi Bedoui, Mohamed Dogui, Frédéric Alexandre, and B.K. Khalifa

Subjects
Signal processing, Learning vector quantization, Artificial neural network, medicine.diagnostic_test, Computer science, business.industry, media_common.quotation_subject, Pattern recognition, Electroencephalography, Machine learning, computer.software_genre, Connectionism, medicine, Unsupervised learning, Detection theory, Artificial intelligence, business, computer, Vigilance (psychology), media_common
Abstract

The main aim in this paper is to study an algorithm of vigilance detection from a minimal number of EEG electrodes, easy to implement on programmable devices, to be used in ambulatory and real everyday life conditions. The connectionist unsupervised approach is summarized in this paper. From the unsupervised classification obtained, a connectionist supervised classification algorithm, the learning vector quantization (LVQ), is used for two different tasks. Firstly, the artefacted states are detected and removed. Secondly, the states deprived of artefacts are then classified in order to decide for the state of vigilance. Connectionist methods with supervised and unsupervised training were used to discriminate the EEG signals characterizing the vigilance states. An artificial neuronal model with a minimal architecture minimizes the complexity and allows implementation. It demonstrates that information, pertinent enough to characterize vigilance states, can be extracted from EEG signal recorded from a single electrode It should also be noted that the intervention of the expert is fundamental in this approach to differentiate nonartefacted vigilance states and artefacted vigilance states.

Published
2004
Full Text
View/download PDF

39. Unsupervised extraction of temporal evolution patterns on an electric arc furnace process

Author

Frédéric Alexandre, Georges Schutz, Serge Gillé, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), and Société de l'Electricité, de l'Electronique, et des Technologies de l'Information et de la Communication - France

Subjects
codage, Feature extraction, system diagnosis, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], 02 engineering and technology, diagnostique de systèmes, analyse de série temporelles, 020204 information systems, 0202 electrical engineering, electronic engineering, information engineering, Signal encoding, Cluster analysis, Electric arc furnace, extraction de formes, business.industry, réseaux de neurones, pattern recognition, Industrial research, Pattern recognition, neural networks, encoding, self-organising maps, cartes auto-organisatrices, Geography, dynamic time warping, time series analysis, Artificial intelligence, business, Coding (social sciences)
Abstract

Colloque avec actes et comité de lecture. internationale.; International audience; This article presents a study performed in the scope of an industrial research project supported by the ECSC. Unsupervised methods of signal encoding and unsupervised extraction of evolution pattern are presented. The main advantages are the ability of proposed clustering method to process arbitrary long input vectors and the adapted coding method that is based on feature extraction of the analysed signals. First results obtained on electric arc furnace data are shown || Cet article présente une étude réalisée dans le cadre d'un projet industriel de recherche subventionné par la CECA. Des méthodes non-supervisées de codage et d'extraction de prototypes d'évolution sont présentées. Les principaux avantages sont l'habilité

Published
2004

40. Optimal Brain Surgeon Variants for Feature Selection

Author

Laurent Bougrain, Frédéric Alexandre, Mohammed Attik, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Computer science, Feature extraction, pruning, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], Feature selection, 02 engineering and technology, 010501 environmental sciences, 01 natural sciences, symbols.namesake, feature selection, 0202 electrical engineering, electronic engineering, information engineering, Taylor series, élagage, 0105 earth and related environmental sciences, Artificial neural network, business.industry, réseaux de neurones, Pattern recognition, neural networks, sélection de variables, obs, Multilayer perceptron, symbols, 020201 artificial intelligence & image processing, Artificial intelligence, business
Abstract

Colloque avec actes et comité de lecture. internationale.; International audience; This paper presents three pruning algorithms based on Optimal Brain Surgeon (OBS) and Unit-Optimal Brain Surgeon (Unit-OBS). The first variant performs a backward selection by successively removing single weights from the input variables to the hidden units in a fully connected multilayer perceptron (MLP) for variable selection. The second one removes a subset of non-significant weights in one step. The last one combines the two properties presented above. Simulation results obtained on the Monk's problem illustrate the specificities of each method described in this paper according to the preserved variables and the preserved weights.

Published
2004

41. From Natural to Artificial Intelligence: Numerical processing for cognitive tasks

Author

Hervé Frezza-Buet, Frédéric Alexandre, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), and Paul Bourgine and Jean-Pierre Nadal

Subjects
Cognitive model, cognition, Elementary cognitive task, renforcement, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], 02 engineering and technology, Machine learning, computer.software_genre, 050105 experimental psychology, Knowledge integration, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, Associative property, reinforcement, Artificial neural network, business.industry, économie, 05 social sciences, Cognition, economics, Modular design, approche évolutionnaire, evolutionary approach, Unsupervised learning, 020201 artificial intelligence & image processing, Artificial intelligence, business, Psychology, computer, artificial neural networks, réseaux de neurones artificiels
Abstract

Contribution à un ouvrage.; Cognitive modeling can be derived from expert knowledge integration or experimental data analysis. This chapter introduces these two main ways of modeling and concentrates on the latter aspect and the related numerical tools together with their possible role. More precisely, the evolutionary approach is presented for optimization and tuning, artificial neural networks for associative reasoning and the stochastic approach for planning. We then conclude on the need for a modular framework, integrating these numerical and other symbolic tools.

Published
2004

42. Unsupervised connectionist clustering algorithms for a better supervised prediction: application to a radio communication problem

Author

Frédéric Alexandre, Laurent Bougrain, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), and International Neural Networks Society

Subjects
Self-organizing map, Neural gas, radio-communication, catégorisation, Computer science, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], forecasting, 02 engineering and technology, computer.software_genre, Domain (software engineering), 0202 electrical engineering, electronic engineering, information engineering, prédiction, télécommunication, Cluster analysis, Computer Science::Databases, Artificial neural network, business.industry, réseaux de neurones, Pattern recognition, neural networks, 020202 computer hardware & architecture, Multilayer perceptron, 020201 artificial intelligence & image processing, Data mining, Artificial intelligence, business, computer, Subspace topology, clustering
Abstract

Colloque avec actes et comité de lecture.; Most models concerned with real-world applications can be improved in structuring data and incorporating knowledge about the domain. In our problem of radio electrical wave dying down prediction for mobile communication, a geographic database can be divided in contextual subsets, each representing an homogeneous domain where a predictive model performs better. More precisely, by clustering the input space, a predictive model (here a multilayer perceptron) can be trained on each subspace. Various unsupervised algorithms for clustering were evaluated (Kohonen's maps. Desieno's algorithm, Neural gas, Growing Neural Gas, Buhmann's algorithm) to obtain class homogeneous enough to decrease the predictive error of the radio electrical wave prediction

Published
2003
Full Text
View/download PDF

43. Toward a continuous model of the cortical column: Application to speech recognition

Author

Jean-Paul Haton, F. Guyot, and Frédéric Alexandre

Subjects
Nervous system, medicine.anatomical_structure, Artificial neural network, Computer science, Continuous modelling, business.industry, Speech recognition, medicine, Artificial intelligence, Hidden Markov model, business, Speech processing, Cortical column
Abstract

The authors propose a novel approach to neuronlike models that consists in simulating cortical columns, i.e. associations of neurons having a specific, functional activity. This model is built according to a theory which is consistent with neurobiological data. The model is implemented through a network of columns that simulate the inherently parallel functioning of the nervous system. A description is given of this model, and the experimental conditions in which it is now being tested are described. >

Published
2003
Full Text
View/download PDF

44. Integration of context in process models used for neuro-control

Author

Frédéric Alexandre and Nicolas Pican

Subjects
Structure (mathematical logic), Connectionism, Computer science, business.industry, Context (language use), Artificial intelligence, Work in process, Control (linguistics), Space (mathematics), business, Catastrophic interference
Abstract

We propose a new architectural model to deal with applications where the input space is very complex and high-dimensional. This solution is inspired from a classical connectionist approach and avoids saturation (A. Guez et al., 1988) due to the use of another connectionist structure, for memory storage. This model is very useful for control problems where input spaces are often complex and heterogeneous. >

Published
2002
Full Text
View/download PDF

45. Highly adaptive neural networks for adaptive neuro-control: the OWE architecture

Author

Frédéric Alexandre and Nicolas Pican

Subjects
Context model, Adaptive control, Artificial neural network, Computer science, Process (engineering), business.industry, Context (language use), Machine learning, computer.software_genre, Network topology, Control theory, Adaptive system, Artificial intelligence, business, computer
Abstract

The purpose of this work is to deal with real world applications where the size of the problem and the influence of contextual parameters can lead to inefficiency of control including neuro-control. Indeed, the size of real world problems is often very high, especially if numerous contextual parameters are used. This often leads to a prohibitive size for neural networks taken in their monolithic version. On the other hand, the absence of this context will destinate the work to a specific domain of application. These remarks are all the more accurate as we know that this contextual parameters generally have a continuous effect on the process and that they could be considered as specific modulators of the application. We present here a learning algorithm for neuro-controllers with reduced number of inputs. In fact, the contextual parameters are only used to estimate the synaptic weights of the neuro-controller with other NNs. Moreover, the present version is an online economic solution to this problem. >

Published
2002
Full Text
View/download PDF

46. Tools and experiments for hybrid neuro-symbolic processing

Author

Frédéric Alexandre

Subjects
Artificial neural network, Computer science, business.industry, Information processing, Machine learning, computer.software_genre, Fuzzy logic, Domain (software engineering), Range (mathematics), Connectionism, Artificial intelligence, business, Symbolic processing, computer
Abstract

Symbolic and connectionist tools are widely used in the artificial intelligence (AI) domain. Both approaches report weaknesses to address the full range of capabilities required by this domain, and are often combined to overcome some limitations, but no extensive efforts have been done to give a wider view of the problem. More precisely, many ad hoc hybrid models were built from symbolic and connectionist tools, but little was said about the choice, integration and combination of such tools. Such was the goal of the European ESPRIT project MIX. We report the main conclusions of this project, together with its results on a real-world application.

Published
2002
Full Text
View/download PDF

47. 170 MHz field strength prediction in urban environment using neural nets

Author

Alexandre Caminada, Frédéric Alexandre, T. Balandier, and V. Lemoine

Subjects
Electromagnetic field, Artificial neural network, Computer science, business.industry, Field strength, Artificial intelligence, business, Machine learning, computer.software_genre, computer, Urban environment
Abstract

In this paper, a semi-empirical model of field strength prediction combining theoretical results of propagation loss algorithms and artificial neural networks is considered. This approach expects to overcome some limitations inherent in existing semi-empirical models: linear behaviour of the statistical analysis used in the construction of the models, unfitness for learning new situations. The good results obtained in a dense urban area show that neural networks are a very efficient empirical method to compute new kinds of models which integrate theoretical and experimental data.

Published
2002
Full Text
View/download PDF

48. From a biological to a computational model for the autonomous behavior of an animat

Author

Frédéric Alexandre, Hervé Frezza-Buet, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP), and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Information Systems and Management, Computer science, biologically inspired model, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], cortical column, 02 engineering and technology, 050105 experimental psychology, Theoretical Computer Science, Domain (software engineering), Animat, Artificial Intelligence, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, connectionism, Set (psychology), connexionnisme, business.industry, 05 social sciences, Computer Science Applications, Automaton, colonne corticale, cortex, Control and Systems Engineering, Robot, 020201 artificial intelligence & image processing, Artificial intelligence, modèle d'inspiration biologique, Autonomous system (mathematics), business, artificial neural networks, réseaux de neurones artificiels, Software
Abstract

Endowing an autonomous system like a robot with intelligent behavior is a difficult problem for several reasons. First, behavior is such a wide topic that a general framework paradigm of inspiration must be chosen in order to obtain a consistent model. Such a framework can be for example biological modeling or an artificial intelligence approach. Second, a general framework is not sufficient to determine a fully specified program to be implemented in a robot. Many choices, tuning and tests must be carried out before obtaining a robust system. This paper describes this. First, a biological model is presented, based on the definition of cortex-like automata, representing elementary functions in the perceptive, motor or associative domain. These automata are connected in a network whose architecture, functioning and learning rules are described in a cortical framework. Second, the computational model derived from that biological model is specified. The way units exchange and compute variables through links is explained, with reference to corresponding biological elements. It is then easier to report experiments allowing an autonomous system to learn regularities of a simple environment and to exploit them to satisfy some internal drives. Even if additional biological hints can be added, this model allow us to better understand how a biological model can be implemented and how biological properties can emerge from a distributed set of units.

Published
2002
Full Text
View/download PDF

49. Integration of Biologically Inspired Temporal Mechanisms into a Cortical Framework for Sequence Processing

Author

Frédéric Alexandre, Nicolas Rougier, Hervé Frezza-Buet, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP), none, and Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Dynamic time warping, traitement de séquences, Computer science, media_common.quotation_subject, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], connexionism, 02 engineering and technology, temporal mechanisms, 03 medical and health sciences, 0302 clinical medicine, Connectionism, sequence processing, Perception, Learning rule, 0202 electrical engineering, electronic engineering, information engineering, Pattern matching, Dimension (data warehouse), media_common, Data processing, business.industry, Task (computing), cortex, connectionnisme, 020201 artificial intelligence & image processing, Artificial intelligence, business, mécanismes temporels, 030217 neurology & neurosurgery
Abstract

Contribution à un ouvrage.; Whereas classical connectionist models can hardly cope with difficult dynamic tasks with a strong temporal factor, many temporal mechanisms inspired with neurobiological data has been proposed in the past and yield efficient time processing properties. The goal of this chapter is to show that, beyond these isolated mechanisms, their integration in a more general architectural and functional framework can potentiate their power and make them usable for non trivial behavioral tasks. We propose a cerebral framework, from the neuronal to the behavioral level, and give some applicative illustrations that underline the encouraging results obtained today.

Published
2000

50. Modeling prefrontal functions for robot navigation

Author

Frédéric Alexandre, Hervé Frezza-Buet, Neuromimetic intelligence (CORTEX), INRIA Lorraine, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS)-Université Henri Poincaré - Nancy 1 (UHP)-Université Nancy 2-Institut National Polytechnique de Lorraine (INPL)-Centre National de la Recherche Scientifique (CNRS), and Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique de Lorraine (INPL)-Université Nancy 2-Université Henri Poincaré - Nancy 1 (UHP)

Subjects
0303 health sciences, Quantitative Biology::Neurons and Cognition, Goal orientation, Computer science, business.industry, frontal cortex, neural planning, [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], Mobile robot, Computer Science::Robotics, 03 medical and health sciences, planification neuronale, 0302 clinical medicine, medicine.anatomical_structure, Action (philosophy), cortex frontal, Cortex (anatomy), medicine, Robot, Artificial intelligence, Motion planning, Prefrontal cortex, business, 030217 neurology & neurosurgery, 030304 developmental biology
Abstract

Colloque avec actes et comité de lecture.; This paper presents a model of cooperation between representations of correlation in the associative cortex and goal oriented representations of action in the prefrontal cortex. The model is applied to robot navigation and gives a framework for addressing planning with numerical neural techniques.

Published
1999

Catalog

Books, media, physical & digital resources
See catalog results