Back to Search Start Over

Reconstructing visual illusory experiences from human brain activity.

Authors :
Cheng, Fan L.
Tomoyasu Horikawa
Kei Majima
Misato Tanaka
Abdelhack, Mohamed
Aoki, Shuntaro C.
Jin Hirano
Yukiyasu Kamitani
Source :
Science Advances. 11/17/2023, Vol. 9 Issue 46, p1-13. 13p.
Publication Year :
2023

Abstract

Visual illusions provide valuable insights into the brain's interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain's internal representations of the world. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
23752548
Volume :
9
Issue :
46
Database :
Academic Search Index
Journal :
Science Advances
Publication Type :
Academic Journal
Accession number :
173638850
Full Text :
https://doi.org/10.1126/sciadv.adj3906