Search

Crossmodal correspondences refer to the fact that certain domains of features in different sensory modalities are associated with each other. Here, we investigated the crossmodal correspondences between speech sounds and visual shapes. Specifically, we tested whether the classification dimensions of English vowels (front–central–back) and consonants (voiced–voiceless, sonorant–obstruent, and stop–continuant) correspond to visual shapes along a bipolar rounded–angular dimension. We adapted eighteen meaningless pseudowords from a previous study that corresponded to either the round or the sharp concept. On each trial, the participants heard one of the pseudowords and saw a rounded shape and an angular shape presented side-by-side on the monitor. Participants judged which shape provided a better match to the spoken pseudoword. A logistic regression was conducted in order to elucidate the effectiveness of classification dimensions of phonemes when predicting variations in the sound–shape matchings. The results demonstrated that the sound–shape matchings were predictable using front–central–back dimensions of vowels, and voiced–voiceless and stop–continuant dimensions of consonants. Hence, we verified that sound–shape matching is underpinned by contrasting dimensions in both vowels and consonants, therefore demonstrating crossmodal correspondences at the phonetic level.

Background: Metformin use reportedly reduces cancer risk and improves survival in lung cancer patients. This study aimed to investigate the effect of metformin use in patients with diabetes mellitus (DM) and lung cancer receiving epidermal growth factor receptor-tyrosine kinase inhibitor (EGFR-TKI) therapy. Methods: A nationwide, population-based cohort study was conducted using the Taiwan National Health Insurance Research Database. From January 1, 2004, to December 31, 2012, a total of 373 metformin and 1260 non-metformin lung cancer cohorts with type 2 DM and EGFR-TKI treatment were studied. Results: Metformin use was significantly associated with a reduced risk of death (hazard ratio: 0.73, 95% confidence interval [CI]: 0.62-0.85, P < .001), as well as a significantly longer median progression-free survival (9.2 months, 95% CI: 8.6-11.7, vs 6.4 months, 95% CI: 5.9-7.2 months, P < .001) and median overall survival (33.4 months, 95% CI: 29.4-40.2, vs 25.4 months, 95% CI: 23.7-27.2 months, P < 0.001). Conclusions: In conclusion, metformin may potentially enhance the therapeutic effect and increase survival in type 2 DM patients with lung cancer receiving EGFR-TKI therapy.

We examined the novel crossmodal semantic congruency effect on bistable figures in which a static stimulus gives rise to two competing percepts that alternate over time. Participants viewed the bistable figure “my wife or my mother-in-law” while listening to the voice of an old woman or a young lady speaking in an unfamiliar language. They had to report whether they saw the old woman, the young lady, or a mixed percept. Robust crossmodal semantic congruency effects in the measures of the first percept and the predominance duration were observed. The possibilities that the participants simply responded to, and/or that they fixed at the location in favor of, the percept congruent with the sound that they happened to hear were ruled out. When the participants were instructed to maintain their attention to a specific view, a strong top-down modulation on the perception of bistable figure was observed, although the audiovisual semantic congruency effect still remained. These results thus demonstrate that top-down attention (ie,, selection and/or voluntary control) modulates the audiovisual semantic congruency effect. As the alternating percepts in bistable figures indicate competition for conscious perception, this study has important implications for the multifaceted interactions between multisensory processing, attention, and consciousness.

Environments typically convey contextual information via several different sensory modalities. Here, we report a study designed to investigate the crossmodal semantic modulation of visual perception using the binocular rivalry paradigm. The participants viewed a dichoptic figure consisting of a bird and a car presented to each eye, while also listening to either a bird singing or car engine revving. Participants' dominant percepts were modulated by the presentation of a soundtrack associated with either bird or car, as compared to the presentation of a soundtrack irrelevant to both visual figures (tableware clattering together in a restaurant). No such crossmodal semantic effect was observed when the participants maintained an abstract semantic cue in memory. We then further demonstrate that crossmodal semantic modulation can be dissociated from the effects of high-level attentional control over the dichoptic figures and of low-level luminance contrast of the figures. In sum, we demonstrate a novel crossmodal effect in terms of crossmodal semantic congruency on binocular rivalry. This effect can be considered a perceptual grouping or contextual constraint on human visual awareness through mid-level crossmodal excitatory connections embedded in the multisensory semantic network.

We examined the crossmodal effect of the presentation of a simultaneous sound on visual detection and discrimination sensitivity using the equivalent noise paradigm (Dosher & Lu, 1998). In each trial, a tilted Gabor patch was presented in either the first or second of two intervals consisting of dynamic 2D white noise with one of seven possible contrast levels. The results revealed that the sensitivity of participants' visual detection and discrimination performance were both enhanced by the presentation of a simultaneous sound, though only close to the noise level at which participants' target contrast thresholds started to increase with the increasing noise contrast. A further analysis of the psychometric function at this noise level revealed that the increase in sensitivity could not be explained by the reduction of participants' uncertainty regarding the onset time of the visual target. We suggest that this crossmodal facilitatory effect may be accounted for by perceptual enhancement elicited by a simultaneously-presented sound, and that the crossmodal facilitation was easier to observe when the visual system encountered a level of noise that happened to be close to the level of internal noise embedded within the system.