1. Integrative Benchmarking to Advance Neurally Mechanistic Models of Human Intelligence
- Author
-
Robert Ajemian, Jonas Kubilius, James J. DiCarlo, Martin Schrimpf, Michael J. Lee, and N. Apurva Ratan Murty
- Subjects
0301 basic medicine ,Computer science ,Intelligence ,Models, Neurological ,Domain (software engineering) ,03 medical and health sciences ,0302 clinical medicine ,Humans ,Cognitive science ,Science & Technology ,Computational neuroscience ,Human intelligence ,General Neuroscience ,Perspective (graphical) ,Neurosciences ,Brain ,Motor control ,computer.file_format ,Benchmarking ,030104 developmental biology ,Behavioral data ,Neural Networks, Computer ,Neurosciences & Neurology ,Executable ,Life Sciences & Biomedicine ,computer ,030217 neurology & neurosurgery - Abstract
A potentially organizing goal of the brain and cognitive sciences is to accurately explain domains of human intelligence as executable, neurally mechanistic models. Years of research have led to models that capture experimental results in individual behavioral tasks and individual brain regions. We here advocate for taking the next step: integrating experimental results from many laboratories into suites of benchmarks that, when considered together, push mechanistic models toward explaining entire domains of intelligence, such as vision, language, and motor control. Given recent successes of neurally mechanistic models and the surging availability of neural, anatomical, and behavioral data, we believe that now is the time to create integrative benchmarking platforms that incentivize ambitious, unified models. This perspective discusses the advantages and the challenges of this approach and proposes specific steps to achieve this goal in the domain of visual intelligence with the case study of an integrative benchmarking platform called Brain-Score. ispartof: NEURON vol:108 issue:3 pages:413-423 ispartof: location:United States status: published
- Published
- 2020
- Full Text
- View/download PDF