Search

Resting-state functional connectivity (FC) is widely used in multivariate pattern analysis of functional magnetic resonance imaging (fMRI), including identifying the locations of putative brain functional borders, predicting individual phenotypes, and diagnosing clinical mental diseases. However, limited attention has been paid to the analysis of functional interactions from a frequency perspective. In this study, by contrasting coherence-based and correlation-based FC with two machine learning tasks, we observed that measuring FC in the frequency domain helped to identify finer functional subregions and achieve better pattern discrimination capability relative to the temporal correlation. This study has proven the feasibility of coherence in the analysis of fMRI, and the results indicate that modeling functional interactions in the frequency domain may provide richer information than that in the time domain, which may provide a new perspective on the analysis of functional neuroimaging., (© 2024 The Author(s). Human Brain Mapping published by Wiley Periodicals LLC.)

Federated learning has shown its unique advantages in many different tasks, including brain image analysis. It provides a new way to train deep learning models while protecting the privacy of medical image data from multiple sites. However, previous studies suggest that domain shift across different sites may influence the performance of federated models. As a solution, we propose a gradient matching federated domain adaptation (GM-FedDA) method for brain image classification, aiming to reduce domain discrepancy with the assistance of a public image dataset and train robust local federated models for target sites. It mainly includes two stages: 1) pretraining stage; we propose a one-common-source adversarial domain adaptation (OCS-ADA) strategy, i.e., adopting ADA with gradient matching loss to pretrain encoders for reducing domain shift at each target site (private data) with the assistance of a common source domain (public data) and 2) fine-tuning stage; we develop a gradient matching federated (GM-Fed) fine-tuning method for updating local federated models pretrained with the OCS-ADA strategy, i.e., pushing the optimization direction of a local federated model toward its specific local minimum by minimizing gradient matching loss between sites. Using fully connected networks as local models, we validate our method with the diagnostic classification tasks of schizophrenia and major depressive disorder based on multisite resting-state functional MRI (fMRI), respectively. Results show that the proposed GM-FedDA method outperforms other commonly used methods, suggesting the potential of our method in brain imaging analysis and other fields, which need to utilize multisite data while preserving data privacy.

Objective. Brain-computer interface (BCI) systems with large directly accessible instruction sets are one of the difficulties in BCI research. Research to achieve high target resolution (⩾100) has not yet entered a rapid development stage, which contradicts the application requirements. Steady-state visual evoked potential (SSVEP) based BCIs have an advantage in terms of the number of targets, but the competitive mechanism between the target stimulus and its neighboring stimuli is a key challenge that prevents the target resolution from being improved significantly. Approach. In this paper, we reverse the competitive mechanism and propose a frequency spatial multiplexing method to produce more targets with limited frequencies. In the proposed paradigm, we replicated each flicker stimulus as a 2 × 2 matrix and arrange the matrices of all frequencies in a tiled fashion to form the interaction interface. With different arrangements, we designed and tested three example paradigms with different layouts. Further we designed a graph neural network that distinguishes between targets of the same frequency by recognizing the different electroencephalography (EEG) response distribution patterns evoked by each target and its neighboring targets. Main results. Extensive experiment studies employing eleven subjects have been performed to verify the validity of the proposed method. The average classification accuracies in the offline validation experiments for the three paradigms are 89.16%, 91.38%, and 87.90%, with information transfer rates (ITR) of 51.66, 53.96, and 50.55 bits/min, respectively. Significance. This study utilized the positional relationship between stimuli and did not circumvent the competing response problem. Therefore, other state-of-the-art methods focusing on enhancing the efficiency of SSVEP detection can be used as a basis for the present method to achieve very promising improvements., (Creative Commons Attribution license.)

Previous resting-state functional magnetic resonance imaging (rs-fMRI) studies have widely explored the temporal connection changes in the human brain following long-term sleep deprivation (SD). However, the frequency-specific topological properties of sleep-deprived functional networks remain virtually unclear. In this study, thirty-seven healthy male subjects underwent resting-state fMRI during rested wakefulness (RW) and after 36 hours of SD, and we examined frequency-specific spectral connection changes (0.01-0.08 Hz, interval = 0.01 Hz) caused by SD. First, we conducted a multivariate pattern analysis combining linear SVM classifiers with a robust feature selection algorithm, and the results revealed that accuracies of 74.29%-84.29% could be achieved in the classification between RW and SD states in leave-one-out cross-validation at different frequency bands, moreover, the spectral connection at the lowest and highest frequency bands exhibited higher discriminative power. Connection involving the cingulo-opercular network increased most, while connection involving the default-mode network decreased most following SD. Then we performed a graph-theoretic analysis and observed reduced low-frequency modularity and high-frequency global efficiency in the SD state. Moreover, hub regions, which were primarily situated in the cerebellum and the cingulo-opercular network after SD, exhibited high discriminative power in the aforementioned classification consistently. The findings may indicate the frequency-dependent effects of SD on the functional network topology and its efficiency of information exchange, providing new insights into the impact of SD on the human brain., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier Inc. All rights reserved.)

Electroencephalogram (EEG) emotion recognition plays an important role in human-computer interaction. An increasing number of algorithms for emotion recognition have been proposed recently. However, it is still challenging to make efficient use of emotional activity knowledge. In this paper, based on prior knowledge that emotion varies slowly across time, we propose a temporal-difference minimizing neural network (TDMNN) for EEG emotion recognition. We use maximum mean discrepancy (MMD) technology to evaluate the difference in EEG features across time and minimize the difference by a multibranch convolutional recurrent network. State-of-the-art performances are achieved using the proposed method on the SEED, SEED-IV, DEAP and DREAMER datasets, demonstrating the effectiveness of including prior knowledge in EEG emotion recognition., Competing Interests: Conflict of interestThe authors declare that they did not receive support from any organization for the submitted work and have no known competing financial or proprietary interests that could have influenced the work reported in this paper., (© The Author(s) 2023.)

Long-term manned spaceflight and extraterrestrial planet settlement become the focus of space powers. However, the potential influence of closed and socially isolating spaceflight on the brain function remains unclear. A 180-day controlled ecological life support system integrated experiment was conducted, establishing a spaceflight analog environment to explore the effect of long-term socially isolating living. Three crewmembers were enrolled and underwent resting-state fMRI scanning before and after the experiment. We performed both seed-based and network-based analyses to investigate the functional connectivity (FC) changes of the default mode network (DMN), considering its key role in multiple higher-order cognitive functions. Compared with normal controls, the leader of crewmembers exhibited significantly reduced within-DMN and between-DMN FC after the experiment, while two others exhibited opposite trends. Moreover, individual differences of FC changes were further supported by evidence from behavioral analyses. The findings may shed new light on the development of psychological protection for space exploration., Competing Interests: The authors declare no competing interests., (© 2024 The Authors. Published by Elsevier Inc.)

Early screening is essential for effective intervention and treatment of individuals with mental disorders. Functional magnetic resonance imaging (fMRI) is a noninvasive tool for depicting neural activity and has demonstrated strong potential as a technique for identifying mental disorders. Due to the difficulty in data collection and diagnosis, imaging data from patients are rare at a single site, whereas abundant healthy control data are available from public datasets. However, joint use of these data from multiple sites for classification model training is hindered by cross-domain distribution discrepancy and diverse label spaces. Herein, we propose few-shot domain-adaptive anomaly detection (FAAD) to achieve cross-site anomaly detection of brain images based on only a few labeled samples. We introduce domain adaptation to mitigate cross-domain distribution discrepancy and jointly align the general and conditional feature distributions of imaging data across multiple sites. We utilize fMRI data of healthy subjects in the Human Connectome Project (HCP) as the source domain and fMRI images from six independent sites, including patients with mental disorders and demographically matched healthy controls, as target domains. Experiments showed the superiority of the proposed method compared with binary classification, traditional anomaly detection methods, and several recognized domain adaptation methods.

The cognitive and behavioral functions of the human brain are supported by its frequency multiplexing mechanism. However, there is limited understanding of the dynamics of the functional network topology. This study aims to investigate the frequency-specific topology of the functional human brain using 7T rs-fMRI data. Frequency-specific parcellations were first performed, revealing frequency-dependent dynamics within the frontoparietal control, parietal memory, and visual networks. An intrinsic functional atlas containing 456 parcels was proposed and validated using stereo-EEG. Graph theory analysis suggested that, in addition to the task-positive vs. task-negative organization observed in static networks, there was a cognitive control system additionally from a frequency perspective. The reproducibility and plausibility of the identified hub sets were confirmed through 3T fMRI analysis, and their artificial removal had distinct effects on network topology. These results indicate a more intricate and subtle dynamics of the functional human brain and emphasize the significance of accurate topography., Competing Interests: The authors declare no competing interests., (© 2024 The Author(s).)

Predicting cognitive load is a crucial issue in the emerging field of human-computer interaction and holds significant practical value, particularly in flight scenarios. Although previous studies have realized efficient cognitive load classification, new research is still needed to adapt the current state-of-the-art multimodal fusion methods. Here, we proposed a feature selection framework based on multiview learning to address the challenges of information redundancy and reveal the common physiological mechanisms underlying cognitive load. Specifically, the multimodal signal features (EEG, EDA, ECG, EOG, & eye movements) at three cognitive load levels were estimated during multiattribute task battery (MATB) tasks performed by 22 healthy participants and fed into a feature selection-multiview classification with cohesion and diversity (FS-MCCD) framework. The optimized feature set was extracted from the original feature set by integrating the weight of each view and the feature weights to formulate the ranking criteria. The cognitive load prediction model, evaluated using real-time classification results, achieved an average accuracy of 81.08% and an average F1-score of 80.94% for three-class classification among 22 participants. Furthermore, the weights of the physiological signal features revealed the physiological mechanisms related to cognitive load. Specifically, heightened cognitive load was linked to amplified δ and θ power in the frontal lobe, reduced α power in the parietal lobe, and an increase in pupil diameter. Thus, the proposed multimodal feature fusion framework emphasizes the effectiveness and efficiency of using these features to predict cognitive load.

Learning-based multi-view stereo (MVS) has by far centered around 3D convolution on cost volumes. Due to the high computation and memory consumption of 3D CNN, the resolution of output depth is often considerably limited. Different from most existing works dedicated to adaptive refinement of cost volumes, we opt to directly optimize the depth value along each camera ray, mimicking the range (depth) finding of a laser scanner. This reduces the MVS problem to ray-based depth optimization which is much more light-weight than full cost volume optimization. In particular, we propose RayMVSNet which learns sequential prediction of a 1D implicit field along each camera ray with the zero-crossing point indicating scene depth. This sequential modeling, conducted based on transformer features, essentially learns the epipolar line search in traditional multi-view stereo. We devise a multi-task learning for better optimization convergence and depth accuracy. We found the monotonicity property of the SDFs along each ray greatly benefits the depth estimation. Our method ranks top on both the DTU and the Tanks & Temples datasets over all previous learning-based methods, achieving an overall reconstruction score of 0.33 mm on DTU and an F-score of 59.48% on Tanks & Temples. It is able to produce high-quality depth estimation and point cloud reconstruction in challenging scenarios such as objects/scenes with non-textured surface, severe occlusion, and highly varying depth range. Further, we propose RayMVSNet++ to enhance contextual feature aggregation for each ray through designing an attentional gating unit to select semantically relevant neighboring rays within the local frustum around that ray. This improves the performance on datasets with more challenging examples (e.g., low-quality images caused by poor lighting conditions or motion blur). RayMVSNet++ achieves state-of-the-art performance on the ScanNet dataset. In particular, it attains an AbsRel of 0.058m and produces accurate results on the two subsets of textureless regions and large depth variation.

We study the problem of extracting accurate correspondences for point cloud registration. Recent keypoint-free methods have shown great potential through bypassing the detection of repeatable keypoints which is difficult to do especially in low-overlap scenarios. They seek correspondences over downsampled superpoints, which are then propagated to dense points. Superpoints are matched based on whether their neighboring patches overlap. Such sparse and loose matching requires contextual features capturing the geometric structure of the point clouds. We propose Geometric Transformer, or GeoTransformer for short, to learn geometric feature for robust superpoint matching. It encodes pair-wise distances and triplet-wise angles, making it invariant to rigid transformation and robust in low-overlap cases. The simplistic design attains surprisingly high matching accuracy such that no RANSAC is required in the estimation of alignment transformation, leading to 100 times acceleration. Extensive experiments on rich benchmarks encompassing indoor, outdoor, synthetic, multiway and non-rigid demonstrate the efficacy of GeoTransformer. Notably, our method improves the inlier ratio by 18 ∼ 31 percentage points and the registration recall by over 7 points on the challenging 3DLoMatch benchmark.

Insufficient annotated data and minor lung lesions pose big challenges for computed tomography (CT)-aided automatic COVID-19 diagnosis at an early outbreak stage. To address this issue, we propose a Semi-Supervised Tri-Branch Network (SS-TBN). First, we develop a joint TBN model for dual-task application scenarios of image segmentation and classification such as CT-based COVID-19 diagnosis, in which pixel-level lesion segmentation and slice-level infection classification branches are simultaneously trained via lesion attention, and individual-level diagnosis branch aggregates slice-level outputs for COVID-19 screening. Second, we propose a novel hybrid semi-supervised learning method to make full use of unlabeled data, combining a new double-threshold pseudo labeling method specifically designed to the joint model and a new inter-slice consistency regularization method specifically tailored to CT images. Besides two publicly available external datasets, we collect internal and our own external datasets including 210,395 images (1,420 cases versus 498 controls) from ten hospitals. Experimental results show that the proposed method achieves state-of-the-art performance in COVID-19 classification with limited annotated data even if lesions are subtle, and that segmentation results promote interpretability for diagnosis, suggesting the potential of the SS-TBN in early screening in insufficient labeled data situations at the early stage of a pandemic outbreak like COVID-19.

In many dynamic environment applications, with the evolution of data collection ways, the data attributes are incremental and the samples are stored with accumulated feature spaces gradually. For instance, in the neuroimaging-based diagnosis of neuropsychiatric disorders, with emerging of diverse testing ways, we get more brain image features over time. The accumulation of different types of features will unavoidably bring difficulties in manipulating the high-dimensional data. It is challenging to design an algorithm to select valuable features in this feature incremental scenario. To address this important but rarely studied problem, we propose a novel Adaptive Feature Selection method (AFS). It enables the reusability of the feature selection model trained on previous features and adapts it to fit the feature selection requirements on all features automatically. Besides, an ideal l 0 -norm sparse constraint for feature selection is imposed with a proposed effective solving strategy. We present the theoretical analyses about the generalization bound and convergence behavior. After tackling this problem in a one-shot case, we extend it to the multi-shot scenario. Plenty of experimental results demonstrate the effectiveness of reusing previous features and the superior of l 0 -norm constraint in various aspects, together with its effectiveness in discriminating schizophrenic patients from healthy controls.

Introduction: Spontaneous low-frequency oscillations play a key role in brain activity. However, the underlying mechanism and origin of low-frequency oscillations remain under debate., Methods: Optical imaging and an electrophysiological recording system were combined to investigate spontaneous oscillations in the hemodynamic parameters and neuronal activity of awake and anesthetized mice after N ω -nitro-L-arginine methyl ester (L-NAME) administration., Results: The spectrum of local field potential (LFP) signals was significantly changed by L-NAME, which was further corroborated by the increase in energy and spatial synchronization. The important finding was that L-NAME triggered regular oscillations in both LFP signals and hemodynamic signals. Notably, the frequency peak of hemodynamic signals can be different from that of LFP oscillations in awake mice., Discussion: A model of the neurovascular system was proposed to interpret this mismatch of peak frequencies, supporting the view that spontaneous low-frequency oscillations arise from multiple sources., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Li, He, Zhang, Li, Zhu, Jiao and Hu.)

Dividing a pre-defined brain region into several heterogenous subregions is crucial for understanding its functional segregation and integration. Due to the high dimensionality of brain functional features, clustering is often postponed until dimensionality reduction in traditional parcellation frameworks occurs. However, under such stepwise parcellation, it is very easy to fall into the dilemma of local optimum since dimensionality reduction could not take into account the requirement of clustering. In this study, we developed a new parcellation framework based on the discriminative embedded clustering (DEC), combining subspace learning and clustering in a common procedure with alternative minimization adopted to approach global optimum. We tested the proposed framework in functional connectivity-based parcellation of the hippocampus. The hippocampus was parcellated into three spatial coherent subregions along the anteroventral-posterodorsal axis; the three subregions exhibited distinct functional connectivity changes in taxi drivers relative to non-driver controls. Moreover, compared with traditional stepwise methods, the proposed DEC-based framework demonstrated higher parcellation consistency across different scans within individuals. The study proposed a new brain parcellation framework with joint dimensionality reduction and clustering; the findings might shed new light on the functional plasticity of hippocampal subregions related to long-term navigation experience.

3D symmetry detection is a fundamental problem in computer vision and graphics. Most prior works detect symmetry when the object model is fully known, few studies symmetry detection on objects with partial observation, such as single RGB-D images. Recent work addresses the problem of detecting symmetries from incomplete data with a deep neural network by leveraging the dense and accurate symmetry annotations. However, due to the tedious labeling process, full symmetry annotations are not always practically available. In this work, we present a 3D symmetry detection approach to detect symmetry from single-view RGB-D images without using symmetry supervision. The key idea is to train the network in a weakly-supervised learning manner to complete the shape based on the predicted symmetry such that the completed shape be similar to existing plausible shapes. To achieve this, we first propose a discriminative variational autoencoder to learn the shape prior in order to determine whether a 3D shape is plausible or not. Based on the learned shape prior, a symmetry detection network is present to predict symmetries that produce shapes with high shape plausibility when completed based on those symmetries. Moreover, to facilitate end-to-end network training and multiple symmetry detection, we introduce a new symmetry parametrization for the learning-based symmetry estimation of both reflectional and rotational symmetry. The proposed approach, coupled symmetry detection with shape completion, essentially learns the symmetry-aware shape prior, facilitating more accurate and robust symmetry detection. Experiments demonstrate that the proposed method is capable of detecting reflectional and rotational symmetries accurately, and shows good generality in challenging scenarios, such as objects with heavy occlusion and scanning noise. Moreover, it achieves state-of-the-art performance, improving the F1-score over the existing supervised learning method by 2%-11% on the ShapeNet and ScanNet datasets.

Brain cartography has expanded substantially over the past decade. In this regard, resting-state functional connectivity (FC) plays a key role in identifying the locations of putative functional borders. However, scant attention has been paid to the dynamic nature of functional interactions in the human brain. Indeed, FC is typically assumed to be stationary across time, which may obscure potential or subtle functional boundaries, particularly in regions with high flexibility and adaptability. In this study, we developed a dynamic FC (dFC)-based parcellation framework, established a new functional human brain atlas termed D-BFA (DFC-based Brain Functional Atlas), and verified its neurophysiological plausibility by stereo-EEG data. As the first dFC-based whole-brain atlas, the proposed D-BFA delineates finer functional boundaries that cannot be captured by static FC, and is further supported by good correspondence with cytoarchitectonic areas and task activation maps. Moreover, the D-BFA reveals the spatial distribution of dynamic variability across the brain and generates more homogenous parcels compared with most alternative parcellations. Our results demonstrate the superiority and practicability of dFC in brain parcellation, providing a new template to exploit brain topographic organization from a dynamic perspective. The D-BFA will be publicly available for download at https://github.com/sliderplm/D-BFA-618., (© The Author(s) 2022. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.)

Accumulating evidence suggests that the brain is highly dynamic; thus, investigation of brain dynamics especially in brain connectivity would provide crucial information that stationary functional connectivity could miss. This study investigated temporal expressions of spatial modes within the default mode network (DMN), salience network (SN) and cognitive control network (CCN) using a reliable data-driven co-activation pattern (CAP) analysis in two independent data sets. We found enhanced CAP-to-CAP transitions of the SN in patients with MDD. Results suggested enhanced flexibility of this network in the patients. By contrast, we also found reduced spatial consistency and persistence of the DMN in the patients, indicating reduced variability and stability in individuals with MDD. In addition, the patients were characterized by prominent activation of mPFC. Moreover, further correlation analysis revealed that persistence and transitions of RCCN were associated with the severity of depression. Our findings suggest that functional connectivity in the patients may not be simply attenuated or potentiated, but just alternating faster or slower among more complex patterns. The aberrant temporal-spatial complexity of intrinsic fluctuations reflects functional diaschisis of resting-state networks as characteristic of patients with MDD., (© 2022. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany.)

Visual navigation and three-dimensional (3D) scene reconstruction are essential for robotics to interact with the surrounding environment. Large-scale scenarios and computational robustness are great challenges facing the research community to achieve this goal. This paper raises a pose-only imaging geometry representation and algorithms that might help solve these challenges. The pose-only representation, equivalent to the classical multiple-view geometry, is discovered to be linearly related to camera global translations, which allows for efficient and robust camera motion estimation. As a result, the spatial feature coordinates can be analytically reconstructed and do not require nonlinear optimization. Comprehensive experiments demonstrate that the computational efficiency of recovering the scene and associated camera poses is significantly improved by 2-4 orders of magnitude.

In image processing, images are usually composed of partial views due to the uncertainty of collection and how to efficiently process these images, which is called incomplete multi-view learning, has attracted widespread attention. The incompleteness and diversity of multi-view data enlarges the difficulty of annotation, resulting in the divergence of label distribution between the training and testing data, named as label shift. However, existing incomplete multi-view methods generally assume that the label distribution is consistent and rarely consider the label shift scenario. To address this new but important challenge, we propose a novel framework termed as Incomplete Multi-view Learning under Label Shift (IMLLS). In this framework, we first give the formal definitions of IMLLS and the bidirectional complete representation which describes the intrinsic and common structure. Then, a multilayer perceptron which combines the reconstruction and classification loss is employed to learn the latent representation, whose existence, consistency and universality are proved with the theoretical satisfaction of label shift assumption. After that, to align the label distribution, the learned representation and trained source classifier are used to estimate the importance weight by designing a new estimation scheme which balances the error generated by finite samples in theory. Finally, the trained classifier reweighted by the estimated weight is fine-tuned to reduce the gap between the source and target representations. Extensive experimental results validate the effectiveness of our algorithm over existing state-of-the-arts methods in various aspects, together with its effectiveness in discriminating schizophrenic patients from healthy controls.

Objective: Cortical tremor/myoclonus is the hallmark feature of benign adult familial myoclonic epilepsy (BAFME), the mechanism of which remains elusive. A hypothesis is that a defective control in the preexisting cerebellar-motor loop drives cortical tremor. Meanwhile, the basal ganglia system might also participate in BAFME. This study aimed to discover the structural basis of cortical tremor/myoclonus in BAFME., Methods: Nineteen patients with BAFME type 1 (BAFME1) and 30 matched healthy controls underwent T1-weighted and diffusion tensor imaging scans. FreeSurfer and spatially unbiased infratentorial template (SUIT) toolboxes were utilized to assess the motor cortex and the cerebellum. Probabilistic tractography was generated for two fibers to test the hypothesis: the dentato-thalamo-(M1) (primary motor cortex) and globus pallidus internus (GPi)-thalamic projections. Average fractional anisotropy (FA), axial diffusivity (AD), mean diffusivity (MD), and radial diffusivity (RD) of each tract were extracted., Results: Cerebellar atrophy and dentate nucleus alteration were observed in the patients. In addition, patients with BAFME1 exhibited reduced AD and FA in the left and right dentato-thalamo-M1 nondecussating fibers, respectively false discovery rate (FDR) correction q < .05. Cerebellar projections showed negative correlations with somatosensory-evoked potential P25-N33 amplitude and were independent of disease duration and medication. BAFME1 patients also had increased FA and decreased MD in the left GPi-thalamic projection. Higher FA and lower RD in the right GPi-thalamic projection were also observed (FDR q < .05)., Significance: The present findings support the hypothesis that the cerebello-thalamo-M1 loop might be the structural basis of cortical tremor in BAFME1. The basal ganglia system also participates in BAFME1 and probably serves a regulatory role., (© 2022 International League Against Epilepsy.)

Higher mammals' primary visual cortex exhibits columnar organization, where neurons with similar response preferences are clustered. In contrast, rodents are presumed to lack this fine-scale organization; their neurons appear to be randomly arranged, described as a salt-and-pepper map. However, recent studies suggested a weak but significant spatial clustering of tuning in the salt-and-pepper map, similar to columnar organization. Thus, the salt-and-pepper map possesses the characteristics of both columnar organization and random arrangement. This raises the question about whether this mixed organization is attributed to different types of neurons. Here, we examined the tuning of primary visual cortical neurons in awake mice with a two-photon calcium imaging dataset, which were released by Allen Institute MindScope Program. First, we demonstrated that neurons with similar response preferences were clustered by showing that neighboring neurons tended to have similar orientation and temporal frequency preferences. Then, we compared the clustering of tuning between simple cells and complex cells and found the clustering of tuning among simple cells was significantly more prominent than that among complex cells. Furthermore, the simple/complex cell classification correlated with the stability of neuronal response. Neurons with stable responses were arranged independent of their tuning similarity, whereas unstable neurons were clustered according to their tuning similarity. These findings might represent a balance between efficiency and robustness: relatively independent tuning among stable neurons represents visual information efficiently, whereas unstable neurons with similar response preferences are clustered to obtain a robust representation with population codes., Competing Interests: Declaration of Competing Interest The authors declare that they have no conflict of interest., (Copyright © 2022 Elsevier Inc. All rights reserved.)

The human cerebral cortex is vastly expanded relative to nonhuman primates and rodents, leading to a functional orderly topography of brain networks. Here, we show that functional topography may be associated with gene expression heterogeneity. The neocortex exhibits greater heterogeneity in gene expression, with a lower expression of housekeeping genes, a longer mean path length, fewer clusters, and a lower degree of ordering in networks than archicortical and subcortical areas in human, rhesus macaque, and mouse brains. In particular, the cerebellar cortex displays greater heterogeneity in gene expression than cerebellar deep nuclei in the human brain, but not in the mouse brain, corresponding to the emergence of novel functions in the human cerebellar cortex. Moreover, the cortical areas with greater heterogeneity, primarily located in the multimodal association cortex, tend to express genes with higher evolutionary rates and exhibit a higher degree of functional connectivity measured by resting-state fMRI, implying that such a spatial distribution of gene expression may be shaped by evolution and is favourable for the specialization of higher cognitive functions. Together, the cross-species imaging and genetic findings may provide convergent evidence to support the association between the orderly topography of brain function networks and gene expression., (© 2022. The Author(s).)

Unsupervised domain adaptation (UDA) aims at learning a classifier for an unlabeled target domain by transferring knowledge from a labeled source domain with a related but different distribution. Most existing approaches learn domain-invariant features by adapting the entire information of the images. However, forcing adaptation of domain-specific variations undermines the effectiveness of the learned features. To address this problem, we propose a novel, yet elegant module, called the deep ladder-suppression network (DLSN), which is designed to better learn the cross-domain shared content by suppressing domain-specific variations. Our proposed DLSN is an autoencoder with lateral connections from the encoder to the decoder. By this design, the domain-specific details, which are only necessary for reconstructing the unlabeled target data, are directly fed to the decoder to complete the reconstruction task, relieving the pressure of learning domain-specific variations at the later layers of the shared encoder. As a result, DLSN allows the shared encoder to focus on learning cross-domain shared content and ignores the domain-specific variations. Notably, the proposed DLSN can be used as a standard module to be integrated with various existing UDA frameworks to further boost performance. Without whistles and bells, extensive experimental results on four gold-standard domain adaptation datasets, for example: 1) Digits; 2) Office31; 3) Office-Home; and 4) VisDA-C, demonstrate that the proposed DLSN can consistently and significantly improve the performance of various popular UDA frameworks.

Limited sample size hinders the application of deep learning in brain image analysis, and transfer learning is a possible solution. However, most pretrained models are 2D based and cannot be applied directly to 3D brain images. In this study, we propose a novel framework to apply 2D pretrained models to 3D brain images by projecting surface-based cortical morphometry into planar images using computational geometry mapping. Firstly, 3D cortical meshes are reconstructed from magnetic resonance imaging (MRI) using FreeSurfer and projected into 2D planar meshes with topological preservation based on area-preserving geometry mapping. Then, 2D deep models pretrained on ImageNet are adopted and fine-tuned for cortical image classification on morphometric shape metrics. We apply the framework to sex classification on the Human Connectome Project dataset and autism spectrum disorder (ASD) classification on the Autism Brain Imaging Data Exchange dataset. Moreover, a 2-stage transfer learning strategy is suggested to boost the ASD classification performance by using the sex classification as an intermediate task. Our framework brings significant improvement in sex classification and ASD classification with transfer learning. In summary, the proposed framework builds a bridge between 3D cortical data and 2D models, making 2D pretrained models available for brain image analysis in cognitive and psychiatric neuroscience., (© The Author(s) 2021. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.)

Current brain cognitive models are insufficient in handling outliers and dynamics of electroencephalogram (EEG) signals. This article presents a novel self-paced dynamic infinite mixture model to infer the dynamics of EEG fatigue signals. The instantaneous spectrum features provided by ensemble wavelet transform and Hilbert transform are extracted to form four fatigue indicators. The covariance of log likelihood of the complete data is proposed to accurately identify similar components and dynamics of the developed mixture model. Compared with its seven peers, the proposed model shows better performance in automatically identifying a pilot's brain workload.

In epidemiological studies, type 2 diabetes mellitus (T2DM) has been associated with cognitive impairment and dementia, but studies about functional network connectivity in T2DM without cognitive impairment are limited. This study aimed to explore network connectivity alterations that may help enhance our understanding of damage-associated processes in T2DM. MRI data were analyzed from 82 patients with T2DM and 66 normal controls. Clinical, biochemical, and neuropsychological assessments were conducted in parallel with resting-state functional magnetic resonance imaging, and the cognitive status of the patients was assessed using the Montreal Cognitive Assessment-B (MoCA-B) score. Independent component analysis revealed a positive correlation between the salience network and the visual network and a negative connection between the left executive control network and the default mode network in patients with T2DM. The differences in dynamic brain network connectivity were observed in the precuneus, visual, and executive control networks. Internal network connectivity was primarily affected in the thalamus, inferior parietal lobe, and left precuneus. Hemoglobin A1c level, body mass index, MoCA-B score, and grooved pegboard (R) assessments indicated significant differences between the two groups ( p < 0.05). Our findings show that key changes in functional connectivity in diabetes occur in the precuneus and executive control networks that evolve before patients develop cognitive deficits. In addition, the current study provides useful information about the role of the thalamus, inferior parietal lobe, and precuneus, which might be potential biomarkers for predicting the clinical progression, assessing the cognitive function, and further understanding the neuropathology of T2DM., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Wu, Kang, Su, Liu, Fan, Ma, Tan, Huang, Feng, Chen, Lyu, Zeng, Qiu and Hu.)

Brain-controlled wheelchairs are one of the most promising applications that can help people gain mobility after their normal interaction pathways have been compromised by neuromuscular diseases. The feasibility of using brain signals to control wheelchairs has been well demonstrated by healthy people in previous studies. However, most potential users of brain-controlled wheelchairs are people suffering from severe physical disabilities or who are in a "locked-in" state. To further validate the clinical practicability of our previously proposed P300-based brain-controlled wheelchair, in this study, 10 subjects with severe spinal cord injuries participated in three experiments and completed ten predefined tasks in each experiment. The average accuracy and information transfer rate (ITR) were 94.8% and 4.2 bits/min, respectively. Moreover, we evaluated the physiological and cognitive burdens experienced by these individuals before and after the experiments. There were no significant changes in vital signs during the experiment, indicating minimal physiological and cognitive burden. The patients' average systolic blood pressure before and after the experiment was 113±13.7 mmHg and 114±11.9 mmHg, respectively (P = 0.122). The patients' average heart rates before and after the experiment were 79±8.4/min and 79±8.2/min, respectively (P = 0.147). The average task load, measured by the National Aeronautics and Space Administration task load index, ranged from 10.0 to 25.5. The results suggest that the proposed P300-based brain-controlled wheelchair is safe and reliable; additionally, it does not significantly increase the patient's physical and mental task burden, demonstrating its potential value in clinical applications. Our study promotes the development of a more practical brain-controlled wheelchair system.

Objective: Dim target detection in remote sensing images is a significant and challenging problem. In this work, we seek to explore event-related brain responses of dim target detection tasks and extend the brain-computer interface (BCI) systems to this task for efficiency enhancement., Methods: We develop a BCI paradigm named Asynchronous Visual Evoked Paradigm (AVEP), in which subjects are required to search the dim targets within satellite images when their scalp electroencephalography (EEG) signals are simultaneously recorded. In the paradigm, stimulus onset time and target onset time are asynchronous because subjects need enough time to confirm whether there are targets of interest in the presented serial images. We further propose a Domain adaptive and Channel-wise attention-based Time-domain Convolutional Neural Network (DC-tCNN) to solve the single-trial EEG classification problem for the AVEP task. In this model, we design a multi-scale CNN module combined with a channel-wise attention module to effectively extract event-related brain responses underlying EEG signals. Meanwhile, domain adaptation is proposed to mitigate cross-subject distribution discrepancy., Results: The results demonstrate the superior performance and better generalizability of this model in classifying the single-trial EEG data of AVEP task in contrast to typical EEG deep learning networks. Visualization analyses of spatiotemporal features also illustrate the effectiveness and interpretability of our proposed paradigm and learning model., Conclusion: The proposed paradigm and model can effectively explore ambiguous event-related brain responses on EEG-based dim target detection tasks., Significance: Our work can provide a valuable reference for BCI-based image detection of dim targets.

The goal of Facial Kinship Verification (FKV) is to automatically determine whether two individuals have a kin relationship or not from their given facial images or videos. It is an emerging and challenging problem that has attracted increasing attention due to its practical applications. Over the past decade, significant progress has been achieved in this new field. Handcrafted features and deep learning techniques have been widely studied in FKV. The goal of this paper is to conduct a comprehensive review of the problem of FKV. We cover different aspects of the research, including problem definition, challenges, applications, benchmark datasets, a taxonomy of existing methods, and state-of-the-art performance. In retrospect of what has been achieved so far, we identify gaps in current research and discuss potential future research directions., (© The Author(s) 2022.)

Pilots' brain fatigue status recognition faces two important issues. They are how to extract brain cognitive features and how to identify these fatigue characteristics. In this article, a gamma deep belief network is proposed to extract multilayer deep representations of high-dimensional cognitive data. The Dirichlet distributed connection weight vector is upsampled layer by layer in each iteration, and then the hidden units of the gamma distribution are downsampled. An effective upper and lower Gibbs sampler is formed to realize the automatic reasoning of the network structure. In order to extract the 3-D instantaneous time-frequency distribution spectrum of electroencephalogram (EEG) signals and avoid signal modal aliasing, this article also proposes a smoothed pseudo affine Wigner-Ville distribution method. Finally, experimental results show that our model achieves satisfactory results in terms of both recognition accuracy and stability.

Objectives: To develop and validate a machine learning model for the prediction of adverse outcomes in hospitalized patients with COVID-19., Methods: We included 424 patients with non-severe COVID-19 on admission from January 17, 2020, to February 17, 2020, in the primary cohort of this retrospective multicenter study. The extent of lung involvement was quantified on chest CT images by a deep learning-based framework. The composite endpoint was the occurrence of severe or critical COVID-19 or death during hospitalization. The optimal machine learning classifier and feature subset were selected for model construction. The performance was further tested in an external validation cohort consisting of 98 patients., Results: There was no significant difference in the prevalence of adverse outcomes (8.7% vs. 8.2%, p = 0.858) between the primary and validation cohorts. The machine learning method extreme gradient boosting (XGBoost) and optimal feature subset including lactic dehydrogenase (LDH), presence of comorbidity, CT lesion ratio (lesion%), and hypersensitive cardiac troponin I (hs-cTnI) were selected for model construction. The XGBoost classifier based on the optimal feature subset performed well for the prediction of developing adverse outcomes in the primary and validation cohorts, with AUCs of 0.959 (95% confidence interval [CI]: 0.936-0.976) and 0.953 (95% CI: 0.891-0.986), respectively. Furthermore, the XGBoost classifier also showed clinical usefulness., Conclusions: We presented a machine learning model that could be effectively used as a predictor of adverse outcomes in hospitalized patients with COVID-19, opening up the possibility for patient stratification and treatment allocation., Key Points: • Developing an individually prognostic model for COVID-19 has the potential to allow efficient allocation of medical resources. • We proposed a deep learning-based framework for accurate lung involvement quantification on chest CT images. • Machine learning based on clinical and CT variables can facilitate the prediction of adverse outcomes of COVID-19., (© 2021. European Society of Radiology.)

Functional connectivity, representing a statistical coupling relationship between different brain regions or electrodes, is an influential concept in clinical medicine and cognitive neuroscience. Electroencephalography-derived functional connectivity (EEG-FC) provides relevant characteristic information about individual differences in cognitive tasks and personality traits. However, it remains unclear whether these individual-dependent EEG-FCs remain relatively permanent across long-term sessions. This manuscript utilizes machine learning algorithms to explore the individual specificity and permanence of resting-state EEG connectivity patterns. We performed six recordings at different intervals during a six-month period to examine the variation and permanence of resting-state EEG-FC over a long period. The results indicated that the EEG-FC networks are quite subject-specific with a high-precision identification accuracy of greater than 90%. Meanwhile, the individual specificity remained stable and only varied slightly after six months. Furthermore, the specificity is mainly derived from the internal connectivity of the frontal lobe. Our work demonstrates the existence of specific and permanent EEG-FC patterns in the brain, providing potential information for biometric applications.

Machine learning methods have been frequently applied in the field of cognitive neuroscience in the last decade. A great deal of attention has been attracted to introduce machine learning methods to study the autism spectrum disorder (ASD) in order to find out its neurophysiological underpinnings. In this paper, we presented a comprehensive review about the previous studies since 2011, which applied machine learning methods to analyze the functional magnetic resonance imaging (fMRI) data of autistic individuals and the typical controls (TCs). The all-round process was covered, including feature construction from raw fMRI data, feature selection methods, machine learning methods, factors for high classification accuracy, and critical conclusions. Applying different machine learning methods and fMRI data acquired from different sites, classification accuracies were obtained ranging from 48.3% up to 97%, and informative brain regions and networks were located. Through thorough analysis, high classification accuracies were found to usually occur in the studies which involved task-based fMRI data, single dataset for some selection principle, effective feature selection methods, or advanced machine learning methods. Advanced deep learning together with the multi-site Autism Brain Imaging Data Exchange (ABIDE) dataset became research trends especially in the recent 4 years. In the future, advanced feature selection and machine learning methods combined with multi-site dataset or easily operated task-based fMRI data may appear to have the potentiality to serve as a promising diagnostic tool for ASD., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2021 Liu, Li and Hu.)

Background: Persistent neurocognitive deficits are often associated with poor outcomes of major depressive disorder (MDD). Executive dysfunction is the most common cognitive deficit in MDD. However, it remains unclear which subcomponent of executive dysfunction is state-independent with distinct neural substrates., Methods: A comprehensive neurocognitive test battery was used to assess four subcomponents of executive function (working memory, inhibition, shifting, and verbal fluency) in 95 MDD patients and 111 matched healthy controls (HCs). After 6 months of paroxetine treatment, 56 patients achieved clinical remission (rMDD) and completed the second-time neurocognitive test. Network-based statistics analysis was utilized to explore the changes in functional connectivity (FC)., Results: Compared with the HCs, all the four subcomponents of MDD patients were significantly impaired. After treatment, there was a significant improvement in working memory, inhibition, and verbal fluency in the rMDD group. And shifting and verbal fluency of the rMDD group remained impaired compared with the HCs. Fifteen functional connections were interrupted in the MDD group, and 11 connections remained in a disrupted state after treatment. Importantly, verbal fluency was negatively correlated with the disrupted FC between the right dorsal prefrontal cortex and the left inferior parietal lobule in patients with MDD and remitted MDD., Limitations: The correlation analysis of the association between cognitive impairment and connectivity alterations precluded us from making causal inferences., Conclusions: Verbal fluency is the potential state-independent cognitive deficit with distinct neural basis in patients with MDD., (Copyright © 2021. Published by Elsevier B.V.)

Until now, dynamic functional connectivity (dFC) based on functional magnetic resonance imaging is typically estimated on a set of predefined regions of interest (ROIs) derived from an anatomical or static functional atlas which follows an implicit assumption of functional homogeneity within ROIs underlying temporal fluctuation of functional coupling, potentially leading to biases or underestimation of brain network dynamics. Here, we presented a novel computational method based on dynamic functional connectivity degree (dFCD) to derive meaningful brain parcellations that can capture functional homogeneous regions in temporal variance of functional connectivity. Several spatially distributed but functionally meaningful areas that are well consistent with known intrinsic connectivity networks were identified through independent component analysis (ICA) of time-varying dFCD maps. Furthermore, a systematical comparison with commonly used brain atlases, including the Anatomical Automatic Labeling template, static ICA-driven parcellation and random parcellation, demonstrated that the ROI-definition strategy based on the proposed dFC-driven parcellation could better capture the interindividual variability in dFC and predict observed individual cognitive performance (e.g., fluid intelligence, cognitive flexibility, and sustained attention) based on chronnectome. Together, our findings shed new light on the functional organization of resting brains at the timescale of seconds and emphasized the significance of a dFC-driven and voxel-wise functional homogeneous parcellation for network dynamics analyses in neuroscience., (© 2020 The Authors. Human Brain Mapping published by Wiley Periodicals LLC.)

In real-world applications, not all instances in the multiview data are fully represented. To deal with incomplete data, incomplete multiview learning (IML) rises. In this article, we propose the joint embedding learning and low-rank approximation (JELLA) framework for IML. The JELLA framework approximates the incomplete data by a set of low-rank matrices and learns a full and common embedding by linear transformation. Several existing IML methods can be unified as special cases of the framework. More interestingly, some linear transformation-based complete multiview methods can be adapted to IML directly with the guidance of the framework. Thus, the JELLA framework improves the efficiency of processing incomplete multiview data, and bridges the gap between complete multiview learning and IML. Moreover, the JELLA framework can provide guidance for developing new algorithms. For illustration, within the framework, we propose the IML with the block-diagonal representation (IML-BDR) method. Assuming that the sampled examples have an approximate linear subspace structure, IML-BDR uses the block-diagonal structure prior to learning the full embedding, which would lead to more correct clustering. A convergent alternating iterative algorithm with the successive over-relaxation optimization technique is devised for optimization. The experimental results on various datasets demonstrate the effectiveness of IML-BDR.

Major depressive disorder (MDD) is a prevailing chronic mental disorder with lifetime recurring episodes. Recurrent depression (RD) has been reported to be associated with greater severity of depression, higher relapse rate and prominent functioning impairments than first-episode depression (FED), suggesting the progressive nature of depression. However, there is still little evidence regarding brain functional connectome. In this study, 95 medication-free MDD patients (35 with FED and 60 with RD) and 111 matched healthy controls (HCs) underwent resting-state functional magnetic resonance imaging (fMRI) scanning. After six months of treatment with paroxetine, 56 patients achieved clinical remission and finished their second scan. Network-based statistics analysis was used to explore the changes in functional connectivity. The results revealed that, compared with HCs, patients with FED exhibited hypoconnectivity in the somatomotor, default mode and dorsal attention networks, and RD exhibited hyperconnectivity in the somatomotor, salience, executive control, default mode and dorsal attention networks, as well as within and between salience and executive control networks. Moreover, the disrupted components in patients with current MDD did not change significantly when the patients achieved remission after treatment, and sub-hyperconnectivity and sub-hypoconnectivity were still found in those with remitted RD. Additionally, the hypoconnectivity in FED and hyperconnectivity in RD were associated with the number of episodes and total illness duration. This study provides initial evidence supporting that impairment of intrinsic functional connectivity across the course of depression is a progressive process.

Antisocial behavior (ASB) is believed to have neural substrates; however, the association between ASB and functional brain networks remains unclear. The temporal variability of the functional connectivity (or dynamic FC) derived from resting-state functional MRI has been suggested as a useful metric for studying abnormal behaviors including ASB. This is the first study using low-frequency fluctuations of the dynamic FC to unravel potential system-level neural correlates with ASB. Specifically, we individually associated the dynamic FC patterns with the ASB scores (measured by Antisocial Process Screening Device) of the male offenders (age: 23.29 ± 3.36 years) based on machine learning. Results showed that the dynamic FCs were associated with individual ASB scores. Moreover, we found that it was mainly the inter-network dynamic FCs that were negatively associated with the ASB severity. Three major high-order cognitive functional networks and the sensorimotor network were found to be more associated with ASB. We further found that impaired behavior in the ASB subjects was mainly associated with decreased FC dynamics in these networks, which may explain why ASB subjects usually have impaired executive control and emotional processing functions. Our study shows that temporal variation of the FC could be a promising tool for ASB assessment, treatment, and prevention., (© 2020 The Authors. Human Brain Mapping published by Wiley Periodicals LLC.)

Inverse synthetic aperture radar (ISAR) imaging for the sparse aperture data is affected by considerable artifacts, because under-sampling of data produces high-level grating and side lobes. Noting the ISAR image generally exhibits strong sparsity, it is often obtained by sparse signal recovery (SSR) in case of sparse aperture. The image obtained by SSR, however, is often dominated by strong isolated scatterers, resulting in difficulty to recognize the structure of target. This paper proposes a novel approach to enhance the ISAR image obtained from the sparse aperture data. Although the scatterers of target are isolated in the ISAR image, they should be associated with the neighborhood to reflect some intrinsic structural information of the target. A convolutional reweighted l 1 minimization model, therefore, is proposed to model the structural sparsity of ISAR image. Specifically, the ISAR image is reconstructed by solving a sequence of reweighted l 1 problems, where the weight of each pixel used for the next iteration is calculated from the convolution of its neighbor values in the current solution. The problem is solved by the alternating direction of multipliers (ADMM) and linearized approximation, respectively, to improve the computational efficiency. Experimental results based on both simulated and measured data validate that the proposed algorithm is effective to enhance the ISAR image, robust to noise, and more impressively, very efficient to implement.

Unsupervised Domain Adaptation (UDA) aims to learn a classifier for the unlabeled target domain by leveraging knowledge from a labeled source domain with a different but related distribution. Many existing approaches typically learn a domain-invariant representation space by directly matching the marginal distributions of the two domains. However, they ignore exploring the underlying discriminative features of the target data and align the cross-domain discriminative features, which may lead to suboptimal performance. To tackle these two issues simultaneously, this paper presents a Joint Clustering and Discriminative Feature Alignment (JCDFA) approach for UDA, which is capable of naturally unifying the mining of discriminative features and the alignment of class-discriminative features into one single framework. Specifically, in order to mine the intrinsic discriminative information of the unlabeled target data, JCDFA jointly learns a shared encoding representation for two tasks: supervised classification of labeled source data, and discriminative clustering of unlabeled target data, where the classification of the source domain can guide the clustering learning of the target domain to locate the object category. We then conduct the cross-domain discriminative feature alignment by separately optimizing two new metrics: 1) an extended supervised contrastive learning, i.e., semi-supervised contrastive learning 2) an extended Maximum Mean Discrepancy (MMD), i.e., conditional MMD, explicitly minimizing the intra-class dispersion and maximizing the inter-class compactness. When these two procedures, i.e., discriminative features mining and alignment are integrated into one framework, they tend to benefit from each other to enhance the final performance from a cooperative learning perspective. Experiments are conducted on four real-world benchmarks (e.g., Office-31, ImageCLEF-DA, Office-Home and VisDA-C). All the results demonstrate that our JCDFA can obtain remarkable margins over state-of-the-art domain adaptation methods. Comprehensive ablation studies also verify the importance of each key component of our proposed algorithm and the effectiveness of combining two learning strategies into a framework.

The recent global outbreak and spread of coronavirus disease (COVID-19) makes it an imperative to develop accurate and efficient diagnostic tools for the disease as medical resources are getting increasingly constrained. Artificial intelligence (AI)-aided tools have exhibited desirable potential; for example, chest computed tomography (CT) has been demonstrated to play a major role in the diagnosis and evaluation of COVID-19. However, developing a CT-based AI diagnostic system for the disease detection has faced considerable challenges, which is mainly due to the lack of adequate manually-delineated samples for training, as well as the requirement of sufficient sensitivity to subtle lesions in the early infection stages. In this study, we developed a dual-branch combination network (DCN) for COVID-19 diagnosis that can simultaneously achieve individual-level classification and lesion segmentation. To focus the classification branch more intensively on the lesion areas, a novel lesion attention module was developed to integrate the intermediate segmentation results. Furthermore, to manage the potential influence of different imaging parameters from individual facilities, a slice probability mapping method was proposed to learn the transformation from slice-level to individual-level classification. We conducted experiments on a large dataset of 1202 subjects from ten institutes in China. The results demonstrated that 1) the proposed DCN attained a classification accuracy of 96.74% on the internal dataset and 92.87% on the external validation dataset, thereby outperforming other models; 2) DCN obtained comparable performance with fewer samples and exhibited higher sensitivity, especially in subtle lesion detection; and 3) DCN provided good interpretability on the loci of infection compared to other deep models due to its classification guided by high-level semantic information. An online CT-based diagnostic platform for COVID-19 derived from our proposed framework is now available., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2020. Published by Elsevier B.V.)

The micro-Doppler (m-D) effect caused by micro-motion degrades the readability of the inverse synthetic aperture radar (ISAR) image. To achieve well-focused ISAR image of the target with the micro-motion part, this paper proposes a novel approach for the removal of m-D effect of ISAR image. Note that the range profiles of the rigid body are similar to each other, making the respective data matrix low-rank. Those of the micro-motion part, in contrary, generally fluctuate in different range cells, whose data matrix is sparse. Therefore, the removal of m-D effect can be naturally solved by the robust principal component analysis (RPCA)-a convenient convex program to decompose an auxiliary matrix into a low-rank matrix and a sparse one. In RPCA, the rank of a matrix is described by the nuclear norm, which is convex but leads to a suboptimal solution. To address it, we utilize a nonconvex surrogate, i.e., the summation of logistic function of the singular values of a matrix, to approximate the rank. Moreover, the range profiles of the rigid body are generally locally similar. To capture this geometric structured information, we further introduce a Laplacian regularization into the model. Then, the Laplacian regularized nonconvex low-rank (LRNL) model is solved efficiently by the linearized alternating direction method (ADM). Extensive experimental results based on both simulated and measured data demonstrate the effectiveness of the proposed approach on the removal of m-D effect of ISAR image.

Some brain abnormalities persist at the remission phase, that is, the state-independent abnormalities, which may be one of the reasons for the high recurrence of major depressive disorder (MDD). Hence, it is of great significance to identify state-independent abnormalities of MDD through longitudinal investigation. Ninety-nine MDD patients and 118 healthy controls (HCs) received diffusion tensor imaging scanning at baseline. After 6-month antidepressant treatment, 68 patients received a second scan, among which 59 patients achieved full clinical remission. Differences in whole-brain structural connectivity (SC) between patients with MDD at baseline and HCs were estimated by two-sample t -tests. Masked with significantly changed SCs in MDD, two-sample t -tests were conducted between the remitted MDD subgroup at follow-up and HCs, and paired t -tests were implemented to compare the differences of SC in the remitted MDD subgroup before and after treatment. Significantly decreased SC between the right insula and the anterior temporal cortex (ATC), between the right ATC and the posterior temporal cortex (PTC), between the left ATC and the auditory cortex as well as increased connectivity between the right posterior cingulate cortex (PCC) and the left medial parietal cortex (MPC) were observed in the MDD group compared with the HC group at baseline ( p < 0.05, FDR corrected). The decreased connectivity between the right insula and the ATC and increased connectivity between the right PCC and the left MPC persisted in the remitted MDD subgroup at follow-up ( p < 0.05, FDR corrected). The decreased SC between the right insula and the ATC and increased SC between the right PCC and left MPC showed state-independent characters, which may be implicated in the sustained negative attention bias and motor retardation in MDD. In contrast, the decreased SC between the right ATC and the PTC and between the left ATC and the auditory cortex seemed to be state-dependent., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2020 Fan, Liu, Zeng, Dong, Su, Peng, Shen, Lu, Sun, Zhang, Wang, Raj, Liu, Hu and Li.)

Increasing evidence has suggested that the dynamic properties of functional brain networks are related to individual behaviors and cognition traits. However, current fMRI-based approaches mostly focus on statistical characteristics of the windowed correlation time course, potentially overlooking subtle time-varying patterns in dynamic functional connectivity (dFC). Here, we proposed the use of an end-to-end deep learning model that combines the convolutional neural network (CNN) and long short-term memory (LSTM) network to capture temporal and spatial features of functional connectivity sequences simultaneously. The results on a large cohort (Human Connectome Project, n = 1,050) demonstrated that our model could achieve a high classification accuracy of about 93% in a gender classification task and prediction accuracies of 0.31 and 0.49 (Pearson's correlation coefficient) in fluid and crystallized intelligence prediction tasks, significantly outperforming previously reported models. Furthermore, we demonstrated that our model could effectively learn spatiotemporal dynamics underlying dFC with high statistical significance based on the null hypothesis estimated using surrogate data. Overall, this study suggests the advantages of a deep learning model in making full use of dynamic information in resting-state functional connectivity, and highlights the potential of time-varying connectivity patterns in improving the prediction of individualized characterization of demographics and cognition traits., (Copyright © 2020 Fan, Su, Qin, Hu and Shen.)

This project aims to explore if stronger functional connectivity (FC) exists in the maximal BOLD response of EEG/fMRI analysis when it is concordant with seizure-onset-zone (SOZ). Twenty-six patients with drug-resistant focal epilepsy who had an EEG/fMRI and later underwent stereo-EEG implantation were included. Different types of IEDs were labeled in scalp EEG and IED-related maximal BOLD responses were evaluated separately, each constituting one study. After evaluating concordance between maximal BOLD and SOZ, twenty-seven studies were placed in the concordant group and eight in the discordant group. We evaluated the local connectivity and ipsilaterally distant connectivity difference between the maximal BOLD and the contralateral homotopic region. Significantly stronger local FC was found for the maximal BOLD in the concordant group (p < 0.05, Bonferroni corrected). 52% of the studies in the concordant group and 13% in the discordant group had a significant difference compared to healthy subjects (p < 0.05, uncorrected). The finding suggests that, when concordant with the SOZ, the maximal BOLD is more likely to have stronger local FC compared to its contralateral counterpart. This asymmetry in functional connectivity may help to noninvasively improve the specificity of EEG/fMRI analysis.

In the mammalian visual system, early stages of visual form perception begin with orientation selective neurons in primary visual cortex (V1). In many species (including humans, monkeys, tree shrews, cats, and ferrets), these neurons are organized in pinwheel-like orientation columns. To study the functional organization within orientation pinwheels, it is important to target pinwheel subdomains precisely. We therefore developed a technique to provide a quantitative determination of the location of pinwheel centers (PCs). Previous studies relied solely on blood vessel images of the cortical surface to guide electrode penetrations to PCs in orientation maps. However, considerable spatial error remained using this method. In the present study, we improved the accuracy of targeting PCs by ensuring perpendicularity of electrodes and by utilizing the orientation tuning of local field potentials (LFP) recorded at or near the optically determined positions., Competing Interests: Competing interestsThe authors declare that they have no competing interests., (Copyright © 2020 The Authors; exclusive licensee Bio-protocol LLC.)

Background: Even with continuous antidepressant treatment, residual symptoms and the risk of relapse can persist in remitted major depressive disorder (MDD) patients. Hence, having a clear recognition of the persistent abnormalities of the underlying neural substrate in MDD through a longitudinal investigation is of great importance., Methods: A total of 127 adult medication-free MDD patients with an acute depressive episode and 118 matched healthy controls (HCs) underwent diffusion tensor imaging. Over a 6-month treatment course, 62 remitted patients underwent a second scan. Remission was defined as a 24-item Hamilton Depression Rating Scale (HAMD 24 ) score ≤7 for at least two weeks. Diffusion tensor imaging was performed with a 3.0 T scanner. Differences in whole-brain fractional anisotropy (FA) between MDD patients and HCs were assessed by an independent t -test using gender, age, and education as covariates., Results: Significant FA reductions in the left insula, left middle occipital gyrus, right thalamus, left pallidum and left precuneus were observed in current MDD (cMDD) patients compared with HCs. Moreover, significant FA reductions in the left insula were observed in remitted (rMDD) patients compared to HCs. However, no significant differences in FA values were found when comparing cMDD and rMDD patients., Conclusions: The abnormalities in the insula showed state-independent characteristics, while the abnormalities in the middle occipital gyrus, thalamus, pallidum and precuneus seemed to be state-dependent impairments in MDD patients., (Copyright © 2020 Dong, Liu, Zeng, Fan, Lu, Sun, Zhang, Wang, Guo, Zhao, Yan, Li, Guo, Zhang, Liu, Hu and Li.)

This paper asks whether integrating multimodal EEG and fMRI data offers a better characterisation of functional brain architectures than either modality alone. This evaluation rests upon a dynamic causal model that generates both EEG and fMRI data from the same neuronal dynamics. We introduce the use of Bayesian fusion to provide informative (empirical) neuronal priors - derived from dynamic causal modelling (DCM) of EEG data - for subsequent DCM of fMRI data. To illustrate this procedure, we generated synthetic EEG and fMRI timeseries for a mismatch negativity (or auditory oddball) paradigm, using biologically plausible model parameters (i.e., posterior expectations from a DCM of empirical, open access, EEG data). Using model inversion, we found that Bayesian fusion provided a substantial improvement in marginal likelihood or model evidence, indicating a more efficient estimation of model parameters, in relation to inverting fMRI data alone. We quantified the benefits of multimodal fusion with the information gain pertaining to neuronal and haemodynamic parameters - as measured by the Kullback-Leibler divergence between their prior and posterior densities. Remarkably, this analysis suggested that EEG data can improve estimates of haemodynamic parameters; thereby furnishing proof-of-principle that Bayesian fusion of EEG and fMRI is necessary to resolve conditional dependencies between neuronal and haemodynamic estimators. These results suggest that Bayesian fusion may offer a useful approach that exploits the complementary temporal (EEG) and spatial (fMRI) precision of different data modalities. We envisage the procedure could be applied to any multimodal dataset that can be explained by a DCM with a common neuronal parameterisation., (Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.)

Motor imagery (MI) is a mental representation of motor behavior and has been widely used in electroencephalogram based brain-computer interfaces (BCIs). Several studies have demonstrated the efficacy of MI-based BCI-feedback training in post-stroke rehabilitation. However, in the earliest stage of the training, calibration data typically contain insufficient discriminability, resulting in unreliable feedback, which may decrease subjects' motivation and even hinder their training. To improve the performance in the early stages of MI training, a novel hybrid BCI paradigm based on MI and P300 is proposed in this study. In this paradigm, subjects are instructed to imagine writing the Chinese character following the flash order of the desired Chinese character displayed on the screen. The event-related desynchronization/synchronization (ERD/ERS) phenomenon is produced with writing based on one's imagination. Simultaneously, the P300 potential is evoked by the flash of each stroke. Moreover, a fusion method of P300 and MI classification is proposed, in which unreliable P300 classifications are corrected by reliable MI classifications. Twelve healthy naïve MI subjects participated in this study. Results demonstrated that the proposed hybrid BCI paradigm yielded significantly better performance than the single-modality BCI paradigm. The recognition accuracy of the fusion method is significantly higher than that of P300 ( p  < 0.05) and MI ( p  < 0.01). Moreover, the training data size can be reduced through fusion of these two modalities., (© Springer Nature B.V. 2019.)