Coherence Research of Audio-Visual Cross-Modal Based on HHT.

Visual and aural modes are two main manners that human utilize to senses the world. Their relationship is investigated in this work. EEG experiments involving mixed aural and visual modes are designed, utilizing Hilbert-Huang Transform (HHT) and electroencephalogram (EEG) signal processing techniques. During EEG data processing, I-EEMD method of similar weighted average waveform extension is proposed to decompose the EEG signals, specifically accounting for the problem of end effects and mode mixing existing in the traditional HHT. The main components of are obtained after decomposing the signals including mixed modes with I-EEMD respectively. The correlation coefficient of consistent and inconsistent mixed signal is calculated, and the comparison is made. Investigation on the comparison condition of the correlation coefficient indicates that there is coherence in both the visual and aural modes. [ABSTRACT FROM AUTHOR]