Search

Abstract The image‐to‐image translation (I2IT) task aims to transform images from the source domain into the specified target domain. State‐of‐the‐art CycleGAN‐based translation algorithms typically use cycle consistency loss and latent regression loss to constrain translation. In this work, it is demonstrated that the model parameters constrained by the cycle consistency loss and the latent regression loss are equivalent to optimizing the medians of the data distribution and the generative distribution. In addition, there is a style bias in the translation. This bias interacts between the generator and the style encoder and visually exhibits translation errors, e.g. the style of the generated image is not equal to the style of the reference image. To address these issues, a new I2IT model termed high‐quality‐I2IT (HQ‐I2IT) is proposed. The optimization scheme is redesigned to prevent the model from optimizing the median of the data distribution. In addition, by separating the optimization of the generator and the latent code estimator, the redesigned model avoids error interactions and gradually corrects errors during training, thereby avoiding learning the median of the generated distribution. The experimental results demonstrate that the visual quality of the images produced by HQ‐I2IT is significantly improved without changing the generator structure, especially when guided by the reference images. Specifically, the Fréchet inception distance on the AFHQ and CelebA‐HQ datasets are reduced from 19.8 to 10.2 and from 23.8 to 17.0, respectively.

Abstract Emotions have specific effects on behavior. At present, studies are increasingly interested in how emotions affect driving behavior. We designed the experiment by combing driving tasks and eye tracking. DSM-V assessment scale was applied to evaluate the depression and manic for participants. In order to explore the dual impacts of emotional issues and cognitive load on attention mechanism, we defined the safety-related region as the area of interest (AOI) and quantified the concentration of eye tracking data. Participants with depression issues had lower AOI sample percentage and shorter AOI fixation duration under no external cognitive load. During our experiment, the depression group had the lowest accuracy in arithmetic quiz. Additionally, we used full connected network to detect the depression group from the control group, reached 83.33%. Our experiment supported that depression have negative influences on driving behavior. Participants with depression issues reduced attention to the safety-related region under no external cognitive load, they were more prone to have difficulties in multitasking when faced with high cognitive load. Besides, participants tended to reallocate more attention resources to the central area under high cognitive load, a phenomenon we called "visual centralization" in driving behavior.

Differences in field of view may occur during unmanned aerial remote sensing imaging applications with acousto-optic tunable filter (AOTF) spectral imagers using zoom lenses. These differences may stem from image size deformation caused by the zoom lens, image drift caused by AOTF wavelength switching, and drone platform jitter. However, they can be addressed using hyperspectral image registration. This article proposes a new coarse-to-fine remote sensing image registration framework based on feature and optical flow theory, comparing its performance with that of existing registration algorithms using the same dataset. The proposed method increases the structure similarity index by 5.2 times, reduces the root mean square error by 3.1 times, and increases the mutual information by 1.9 times. To meet the real-time processing requirements of the AOTF spectrometer in remote sensing, a development environment using VS2023+CUDA+OPENCV was established to improve the demons registration algorithm. The registration algorithm for the central processing unit+graphics processing unit (CPU+GPU) achieved an acceleration ratio of ~30 times compared to that of a CPU alone. Finally, the real-time registration effect of spectral data during flight was verified. The proposed method demonstrates that AOTF hyperspectral imagers can be used in real-time remote sensing applications on unmanned aerial vehicles.

In recent years, the incidence of thyroid cancer has rapidly increased. To address the issue of the inefficient diagnosis of thyroid cancer during surgery, we propose a rapid method for the diagnosis of benign and malignant thyroid nodules based on hyperspectral technology. Firstly, using our self-developed thyroid nodule hyperspectral acquisition system, data for a large number of diverse thyroid nodule samples were obtained, providing a foundation for subsequent diagnosis. Secondly, to better meet clinical practical needs, we address the current situation of medical hyperspectral image classification research being mainly focused on pixel-based region segmentation, by proposing a method for nodule classification as benign or malignant based on thyroid nodule hyperspectral data blocks. Using 3D CNN and VGG16 networks as a basis, we designed a neural network algorithm (V3Dnet) for classification based on three-dimensional hyperspectral data blocks. In the case of a dataset with a block size of 50 × 50 × 196, the classification accuracy for benign and malignant samples reaches 84.63%. We also investigated the impact of data block size on the classification performance and constructed a classification model that includes thyroid nodule sample acquisition, hyperspectral data preprocessing, and an algorithm for thyroid nodule classification as benign and malignant based on hyperspectral data blocks. The proposed model for thyroid nodule classification is expected to be applied in thyroid surgery, thereby improving surgical accuracy and providing strong support for scientific research in related fields.

With the continuous development of infrared technology, the application of infrared imagery is increasingly widespread. Nonetheless, infrared imagery suffers from low contrast and high noise characteristics, making it challenging to detect and recognize infrared small targets. Frequently, existing deep learning-based infrared target detection methods solely employ spatial information, neglecting frequency domain information, thereby creating susceptibility to background clutter interference and low detection accuracy in complex scenes. Here, a deep learning-based method is proposed that combines frequency domain clutter suppression and spatial feature extraction to detect infrared small targets. Firstly, the spatial domain infrared image is transformed into the frequency domain using block discrete cosine transform (DCT). Secondly, the frequency domain information is filtered using an attention mechanism to adaptively enhance the targets and suppress the background clutter. Finally, the compressed attention map is transformed back to the spatial domain and inputted into a lightweight neural network for spatial feature extraction and fusion to obtain detection results. This approach enhances detection accuracy, and reduces computational complexity and storage space, thereby making it practical and deployable. Experimental outcomes demonstrate strong detection capabilities on public datasets, and significant advantages over traditional and existing deep learning methods.

Encephalitis is a disease typically caused by viral infections or autoimmunity. The most common type of autoimmune encephalitis is anti-N-methyl-D-aspartate receptor (NMDAR) antibody-mediated, known as anti-NMDA receptor encephalitis, which is a rare disease. Specific EEG patterns, including “extreme delta brush” (EDB), have been reported in patients with anti-NMDA receptor encephalitis. The aim of this study was to develop an intelligent diagnostic model for encephalitis based on EEG signals. A total of 131 Participants were selected based on reasonable inclusion criteria and divided into three groups: health control (35 participants), viral encephalitis (58 participants), and anti NMDAR receptor encephalitis (55 participants). Due to the low prevalence of anti-NMDAR receptor encephalitis, it took several years to collect participants’ EEG signals while they were in an awake state. EEG signals were collected and analyzed following the international 10–20 system layout. We proposed a model called Temporal Transformer-Spatial Graph Convolutional Network (TT-SGCN), which consists of a Preprocess Module, a Temporal Transformer Module (TTM), and a Spatial Graph Convolutional Module (SGCM). The raw EEG signal was preprocessed according to traditional procedures, including filtering, averaging, and Independent Component Analysis (ICA) method. The EEG signal was then segmented and transformed using short-time Fourier transform (STFT) to produce concatenated power density (CPD) maps, which served as inputs for the proposed model. TTM extracted the time-frequency features of each channel, and SGCM fused these features using graph convolutional methods based on the location of electrodes. The model was evaluated in two experiments: classification of the three groups and pairwise classification among the three groups. The model was trained using two stages and achieved the performance, with an accuracy of 82.23%, recall of 80.75%, precision of 82.51%, and F1 score of 81.23% in the classification of the three groups. The proposed model has the potential to become an intelligent auxiliary diagnostic tool for encephalitis.

Lanthanide nanomaterials have garnered significant attention from researchers among the main near-infrared (NIR) fluorescent nanomaterials due to their excellent chemical and fluorescence stability, narrow emission band, adjustable luminescence color, and long lifetime. In recent years, with the preparation, functional modification, and fluorescence improvement of lanthanide materials, great progress has been made in their application in the biomedical field. This review focuses on the latest progress of lanthanide nanomaterials in tumor diagnosis and treatment, as well as the interaction mechanism between fluorescence and biological tissues. We introduce a set of efficient strategies for improving the fluorescence properties of lanthanide nanomaterials and discuss some representative in-depth research work in detail, showcasing their superiority in early detection of ultra-small tumors, phototherapy, and real-time guidance for surgical resection. However, lanthanide nanomaterials have only realized a portion of their potential in tumor applications so far. Therefore, we discuss promising methods for further improving the performance of lanthanide nanomaterials and their future development directions.

Multi-spectral imaging technologies have made great progress in the past few decades. The development of snapshot cameras equipped with a specific multi-spectral filter array (MSFA) allow dynamic scenes to be captured on a miniaturized platform across multiple spectral bands, opening up extensive applications in quantitative and visualized analysis. However, a snapshot camera based on MSFA captures a single band per pixel; thus, the other spectral band components of pixels are all missed. The raw images, which are captured by snapshot multi-spectral imaging systems, require a reconstruction procedure called demosaicing to estimate a fully defined multi-spectral image (MSI). With increasing spectral bands, the challenge of demosaicing becomes more difficult. Furthermore, the existing demosaicing methods will produce adverse artifacts and aliasing because of the adverse effects of spatial interpolation and the inadequacy of the number of layers in the network structure. In this paper, a novel multi-spectral demosaicing method based on a deep convolution neural network (CNN) is proposed for the reconstruction of full-resolution multi-spectral images from raw MSFA-based spectral mosaic images. The CNN is integrated with the channel attention mechanism to protect important channel features. We verify the merits of the proposed method using 5 × 5 raw mosaic images on synthetic as well as real-world data. The experimental results show that the proposed method outperforms the existing demosaicing methods in terms of spatial details and spectral fidelity.

To meet the demand for rapid bacterial detection in clinical practice, this study proposed a joint determination model based on spectral database matching combined with a deep learning model for the determination of positive–negative bacterial infection in directly smeared urine samples. Based on a dataset of 8124 urine samples, a standard hyperspectral database of common bacteria and impurities was established. This database, combined with an automated single-target extraction, was used to perform spectral matching for single bacterial targets in directly smeared data. To address the multi-scale features and the need for the rapid analysis of directly smeared data, a multi-scale buffered convolutional neural network, MBNet, was introduced, which included three convolutional combination units and four buffer units to extract the spectral features of directly smeared data from different dimensions. The focus was on studying the differences in spectral features between positive and negative bacterial infection, as well as the temporal correlation between positive–negative determination and short-term cultivation. The experimental results demonstrate that the joint determination model achieved an accuracy of 97.29%, a Positive Predictive Value (PPV) of 97.17%, and a Negative Predictive Value (NPV) of 97.60% in the directly smeared urine dataset. This result outperformed the single MBNet model, indicating the effectiveness of the multi-scale buffered architecture for global and large-scale features of directly smeared data, as well as the high sensitivity of spectral database matching for single bacterial targets. The rapid determination solution of the whole process, which combines directly smeared sample preparation, joint determination model, and software analysis integration, can provide a preliminary report of bacterial infection within 10 min, and it is expected to become a powerful supplement to the existing technologies of rapid bacterial detection.

Removing noise from acquired images is a crucial step in various image processing and computer vision tasks. However, the existing methods primarily focus on removing specific noise and ignore the ability to work across modalities, resulting in limited generalization performance. Inspired by the iterative procedure of image processing used by professionals, we propose a pixel-wise crossmodal image-denoising method based on deep reinforcement learning to effectively handle noise across modalities. We proposed a similarity reward to help teach an optimal action sequence to model the step-wise nature of the human processing process explicitly. In addition, We designed an action set capable of handling multiple types of noise to construct the action space, thereby achieving successful crossmodal denoising. Extensive experiments against state-of-the-art methods on publicly available RGB, infrared, and terahertz datasets demonstrate the superiority of our method in crossmodal image denoising.

As spectral resolution increases, the dimension of the Doppler Asymmetric Spatial Heterodyne (DASH) interferometer increases. The existing approach for stably mounting the interferometer is limited to mounting a normal-sized DASH interferometer. In this study, a novel and stable structure is proposed, with its effecti1veness exemplified for a near-infrared (NIR) DASH interferometer. The mathematical model of a flexible structure was established. The parameters of the support structure were optimized by requiring the mechanical stress of the flexible structure and shear stress at the bonding surface to be less than the strength value. The spring constants were optimally designed to adjust natural frequency and minimize stress. The finite element analysis (FEA) results show that the maximum mechanical stress was 65.56 MPa. The maximum shear stress was 3.4 MPa. All stress values had a high safety margin. The mechanical material and adhesive area were optimally designed. Therefore, the thermal resistance of the structure was improved by 7.5 times. The test results indicate that the proposed flexible support structure could satisfy the requirements of the launch environment. The results from FEA and vibration tests were consistent with the model calculation results. Compared to existing structures, the mechanical performance and thermal resistance were improved.

Abstract Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the issue of feature entanglement may occur while modelling multiple aircraft classes. Our solution to this issue was a novel first-generation realistic aircraft type simulation system (ATSS-1) based on the RS images. It realised fine modelling of the seven aircraft types based on a real scene by establishing an adaptive weighted conditional attention generative adversarial network and joint geospatial embedding (GE) network. An adaptive weighted conditional batch normalisation attention block solved the subclass entanglement by reassigning the intra-class-wise characteristic responses. Subsequently, an asymmetric residual self-attention module was developed by establishing a remote region asymmetric relationship for mining the finer potential spatial representation. The mapping relationship between the input RS scene and the potential space of the generated samples was explored through the GE network construction that used the selected prior distribution z, as an intermediate representation. A public RS dataset (OPT-Aircraft_V1.0) and two public datasets (MNIST and Fashion-MNIST) were used for simulation model testing. The results demonstrated the effectiveness of ATSS-1, promoting further development of realistic automatic RS simulation.

Abstract Spatial resolution is a key factor of quantitatively evaluating the quality of magnetic resonance imagery (MRI). Super-resolution (SR) approaches can improve its spatial resolution by reconstructing high-resolution (HR) images from low-resolution (LR) ones to meet clinical and scientific requirements. To increase the quality of brain MRI, we study a robust residual-learning SR network (RRLSRN) to generate a sharp HR brain image from an LR input. Due to the Charbonnier loss can handle outliers well, and Gradient Difference Loss (GDL) can sharpen an image, we combined the Charbonnier loss and GDL to improve the robustness of the model and enhance the texture information of SR results. Two MRI datasets of adult brain, Kirby 21 and NAMIC, were used to train and verify the effectiveness of our model. To further verify the generalizability and robustness of the proposed model, we collected eight clinical fetal brain MRI 2D data for evaluation. The experimental results have shown that the proposed deep residual-learning network achieved superior performance and high efficiency over other compared methods.

Human pose estimation refers to accurately estimating the position of the human body from a single RGB image and detecting the location of the body. It serves as the basis for several computer vision tasks, such as human tracking, 3D reconstruction, and autonomous driving. Improving the accuracy of pose estimation has significant implications for the advancement of computer vision. This paper addresses the limitations of single-branch networks in pose estimation. It presents a top-down single-target pose estimation approach based on multi-branch self-calibrating networks combined with graph convolutional neural networks. The study focuses on two aspects: human body detection and human body pose estimation. The human body detection is for athletes appearing in sports competitions, followed by human body pose estimation, which is divided into two methods: coordinate regression-based and heatmap test-based. To improve the accuracy of the heatmap test, the high-resolution feature map output from HRNet is used for deconvolution to improve the accuracy of single-target pose estimation recognition.

Detection of early morphological changes in the brain and early diagnosis are important for Alzheimer’s disease (AD), and high-resolution magnetic resonance imaging (MRI) can be used to help diagnose and predict the disease. In this paper, we proposed two improved ResNet algorithms that introduced the Contextual Transformer (CoT) module, group convolution, and Channel Shuffle mechanism into the traditional ResNet residual blocks. The CoT module is used to replace the 3 × 3 convolution in the residual block to enhance the feature extraction capability of the residual block, while the Channel Shuffle mechanism is used to reorganize the feature maps of different groups in the input layer to improve the communication between the feature maps from different groups. Images of 503 subjects, including 116 healthy controls (HC), 187 subjects with mild cognitive impairment (MCI), and 200 subjects with AD, were selected and collated from the ADNI database, and then, the data were pre-processed and sliced. After that, 10,060 slices were obtained and the three groups of AD, MCI and HC were classified using the improved algorithms. The experiments showed that the refined ResNet-18-based algorithm improved the top-1 accuracy by 2.06%, 0.33%, 1.82%, and 1.52% over the traditional ResNet-18 algorithm for four medical image classification tasks, namely AD: MCI, AD: HC, MCI: HC, and AD: MCI: HC, respectively. The enhanced ResNet-50-based algorithm improved the top-1 accuracy by 1.02%, 2.92%, 3.30%, and 1.31%, respectively, over the traditional ResNet-50 algorithm in four medical image classification tasks, demonstrating the effectiveness of the CoT module replacement and the inclusion of the channel shuffling mechanism, as well as the competitiveness of the improved algorithms.

BackgroundPsychological issues are common among adolescents, which have a significant impact on their growth and development. However, the underlying neural mechanisms of viewing visual stimuli in adolescents are poorly understood.Materials and MethodsThis study applied the Chinese version of the DSM-V self-assessment scales to evaluate 73 adolescents’ psychological characteristics for depressive and manic emotional issues. Combined with eye-tracking and event-related potential (ERP), we explored the characteristics of their visual attention and neural processing mechanisms while freely viewing positive, dysphoric, threatening and neutral visual stimuli.ResultsCompared to controls, adolescents with depressive emotional tendencies showed more concentrated looking behavior with fixation distribution index than the controls, while adolescents with manic emotional tendencies showed no such trait. ERP data revealed individuals with depressive tendencies showed lower arousal levels toward emotional stimuli in the early stage of cognitive processing (N1 amplitude decreased) and with prolonged reaction time (N1 latency increased) than the control group. We found no significant difference between the manic group and the control group. Furthermore, the depression severity scores of the individuals with depressive tendencies were negatively correlated with the total fixation time toward positive stimuli, were negatively correlated with the fixation distribution index toward threatening stimuli, and were positively correlated with the mean N1 amplitudes while viewing dysphoric stimuli. Also, for the individuals with depressive tendencies, there was a positive correlation between the mean N1 amplitudes and the fixation time on the area of interest (AOI) while viewing dysphoric stimuli. For the individuals with manic tendencies, the manic severity scores of the individuals with manic tendencies were positively correlated with the total fixation time toward the positive stimuli. However, no significant correlations were found between the manic severity scores and N1 amplitudes, and between N1 amplitudes and eye-tracking output variables.ConclusionThis study proposes the application of eye-tracking and ERP to provide better biological evidence to alter the neural processing of emotional stimuli for adolescents with emotional issues.

(1) Background: Epilepsy is a neurological disorder that causes repeated seizures. Since electroencephalogram (EEG) patterns differ in different states (inter-ictal, pre-ictal, and ictal), a seizure can be detected and predicted by extracting various features. However, the brain connectivity network, a two-dimensional feature, is rarely studied. We aim to investigate its effectiveness for seizure detection and prediction. (2) Methods: Two time-window lengths, five frequency bands, and five connectivity measures were used to extract image-like features, which were fed into a support vector machine for the subject-specific model (SSM) and a convolutional neural networks meet transformers (CMT) classifier for the subject-independent model (SIM) and cross-subject model (CSM). Finally, feature selection and efficiency analyses were conducted. (3) Results: The classification results on the CHB-MIT dataset showed that a long window indicated better performance. The best detection accuracies of SSM, SIM, and CSM were 100.00, 99.98, and 99.27%, respectively. The highest prediction accuracies were 99.72, 99.38, and 86.17%, respectively. In addition, Pearson Correlation Coefficient and Phase Lock Value connectivity in the β and γ bands showed good performance and high efficiency. (4) Conclusions: The proposed brain connectivity features showed good reliability and practical value for automatic seizure detection and prediction, which expects to develop portable real-time monitoring equipment.

Due to optical noise, electrical noise, and compression error, data hyperspectral remote sensing equipment is inevitably contaminated by various noises, which seriously affect the applications of hyperspectral data. Therefore, it is of great significance to enhance hyperspectral imaging data quality. To guarantee the spectral accuracy during data processing, band-wise algorithms are not suitable for hyperspectral data. This paper proposes a quality enhancement algorithm based on texture search and histogram redistribution combined with denoising and contrast enhancement. Firstly, a texture-based search algorithm is proposed to improve the accuracy of denoising by improving the sparsity of 4D block matching clustering. Then, histogram redistribution and Poisson fusion are used to enhance spatial contrast while preserving spectral information. Synthesized noising data from public hyperspectral datasets are used to quantitatively evaluate the proposed algorithm, and multiple criteria are used to analyze the experimental results. At the same time, classification tasks were used to verify the quality of the enhanced data. The results show that the proposed algorithm is satisfactory for hyperspectral data quality improvement.

In the field of remote sens., change detection is an important monitoring technology. However, effectively extracting the change feature is still a challenge, especially with an unsupervised method. To solve this problem, we proposed an unsupervised transformer boundary autoencoder network (UTBANet) in this paper. UTBANet consists of a transformer structure and spectral attention in the encoder part. In addition to reconstructing hyperspectral images, UTBANet also adds a decoder branch for reconstructing edge information. The designed encoder module is used to extract features. First, the transformer structure is used for extracting the global features. Then, spectral attention can find important feature maps and reduce feature redundancy. Furthermore, UTBANet reconstructs the hyperspectral image and boundary information simultaneously through two decoders, which can improve the ability of the encoder to extract edge features. Our experiments demonstrate that the proposed structure significantly improves the performance of change detection. Moreover, comparative experiments show that our method is superior to most existing unsupervised methods.

In recent years, ship detection in satellite remote sensing images has become an important research topic. Most existing methods detect ships by using a rectangular bounding box but do not perform segmentation down to the pixel level. This paper proposes a ship detection and segmentation method based on an improved Mask R-CNN model. Our proposed method can accurately detect and segment ships at the pixel level. By adding a bottom-up structure to the FPN structure of Mask R-CNN, the path between the lower layers and the topmost layer is shortened, allowing the lower layer features to be more effectively utilized at the top layer. In the bottom-up structure, we use channel-wise attention to assign weights in each channel and use the spatial attention mechanism to assign a corresponding weight at each pixel in the feature maps. This allows the feature maps to respond better to the target’s features. Using our method, the detection and segmentation mAPs increased from 70.6% and 62.0% to 76.1% and 65.8%, respectively.

Identifying infectious pathogens quickly and accurately is significant for patients and doctors. Identifying single bacterial strains is significant in eliminating culture and speeding up diagnosis. We present an advanced optical method for the rapid detection of infectious (including common and uncommon) pathogens by combining hyperspectral microscopic imaging and deep learning. To acquire more information regarding the pathogens, we developed a hyperspectral microscopic imaging system with a wide wavelength range and fine spectral resolution. Furthermore, an end-to-end deep learning network based on feature fusion, called BI-Net, was designed to extract the species-dependent features encoded in cell-level hyperspectral images as the fingerprints for species differentiation. After being trained based on a large-scale dataset that we built to identify common pathogens, BI-Net was used to classify uncommon pathogens via transfer learning. An extensive analysis demonstrated that BI-Net was able to learn species-dependent characteristics, with the classification accuracy and Kappa coefficients being 92% and 0.92, respectively, for both common and uncommon species. Our method outperformed state-of-the-art methods by a large margin and its excellent performance demonstrates its excellent potential in clinical practice.

Objective: To explore quantitative measurements of the visual attention and neuroelectrophysiological relevance of memory deficits in temporal lobe epilepsy (TLE) by eye tracking and electroencephalography (EEG).Methods: Thirty-four TLE patients and twenty-eight healthy controls were invited to complete neurobehavioral assessments, cognitive oculomotor tasks, and 24-h video EEG (VEEG) recordings using an automated computer-based memory assessment platform with an eye tracker. Visit counts, visit time, and time of first fixation on areas of interest (AOIs) were recorded and analyzed in combination with interictal epileptic discharge (IED) characteristics from the bilateral temporal lobes.Results: The TLE patients had significantly worse Wechsler Digit Span scores [F(1, 58) = 7.49, p = 0.008]. In the Short-Term Memory Game with eye tracking, TLE patients took a longer time to find the memorized items [F(1, 57) = 17.30, p < 0.001]. They had longer first fixation [F(1, 57) = 4.06, p = 0.049] and more visit counts [F(1, 57) = 7.58, p = 0.008] on the target during the recall. Furthermore, the performance of the patients in the Digit Span task was negatively correlated with the total number of IEDs [r(28) = −0.463, p = 0.013] and the number of spikes per sleep cycle [r(28) = −0.420, p = 0.026].Conclusion: Eye tracking appears to be a quantitative, objective measure of memory evaluation, demonstrating memory retrieval deficits but preserved visual attention in TLE patients. Nocturnal temporal lobe IEDs are closely associated with memory performance, which might be the electrophysiological mechanism for memory impairment in TLE.

With the development of industrialization and urbanization, the consumption and pollution of water resources are becoming more and more serious. Water quality monitoring is an extremely important technical means to protect water resources. However, the current popular water quality monitoring methods have their shortcomings, such as a low signal-to-noise ratio of satellites, poor time continuity of unmanned aerial vehicles, and frequent maintenance of in situ underwater probes. A non-contact near-surface system that can continuously monitor water quality fluctuation is urgently needed. This study proposes an automatic near-surface water quality monitoring system, which can complete the physical equipment construction, data collection, and processing of the application scenario, prove the feasibility of the self-developed equipment and methods and obtain high-performance retrieval results of four water quality parameters, namely chemical oxygen demand (COD), turbidity, ammoniacal nitrogen (NH3-N), and dissolved oxygen (DO). For each water quality parameter, fourteen machine learning algorithms were compared and evaluated with five assessment indexes. Because the ensemble learning models combine the prediction results of multiple basic learners, they have higher robustness in the prediction of water quality parameters. The optimal determination coefficients (R2) of COD, turbidity, NH3-N, and DO in the test dataset are 0.92, 0.98, 0.95, and 0.91, respectively. The results show the superiority of near-surface remote sensing, which has potential application value in inland, coastal, and various water bodies in the future.

The modeling of compliant bridge-type displacement amplification mechanisms has challenges due to the intrinsic coupling of kinematic and mechanical behaviors. A structure load performance integrated model method for the bridge-type displacement amplification mechanism is presented. The established modeling based on Castigliano’s second theorem considers the deformations of all members, the effect of external load and the nonlinear shear effect. Compared to the finite element model (FEM) and existing models, the established modeling precisely predicts significant nonlinearity of the displacement amplification ratio (DAR) with the driving force, strong sensitivity of DAR to the external load and corresponding relationships of structural parameters with DAR, which is the closest to the FEM result over existing models. The variance-based sensitivities of structural parameters to DAR are thoroughly analyzed, indicating that sensitive structure parameters need to be focused on. Modeling applications further prove the reliability and expandability of the proposed model method. The proposed model method can provide support for the design, optimization and control of compliant systems with bridge-type displacement amplification mechanisms.

Infectious diseases have always been a major threat to the survival of humanity. Additionally, they bring an enormous economic burden to society. The conventional methods for bacteria identification are expensive, time-consuming and laborious. Therefore, it is of great importance to automatically rapidly identify pathogenic bacteria in a short time. Here, we constructed an AI-assisted system for automating rapid bacteria genus identification, combining the hyperspectral microscopic technology and a deep-learning-based algorithm Buffer Net. After being trained and validated in the self-built dataset, which consists of 11 genera with over 130,000 hyperspectral images, the accuracy of the algorithm could achieve 94.9%, which outperformed 1D-CNN, 2D-CNN and 3D-ResNet. The AI-assisted system we developed has great potential in assisting clinicians in identifying pathogenic bacteria at the single-cell level with high accuracy in a cheap, rapid and automatic way. Since the AI-assisted system can identify the pathogenic genus rapidly (about 30 s per hyperspectral microscopic image) at the single-cell level, it can shorten the time or even eliminate the demand for cultivating. Additionally, the system is user-friendly for novices.

Unmanned aerial vehicle (UAV) hyperspectral remote sensing technologies have unique advantages in high-precision quantitative analysis of non-contact water surface source concentration. Improving the accuracy of non-point source detection is a difficult engineering problem. To facilitate water surface remote sensing, imaging, and spectral analysis activities, a UAV-based hyperspectral imaging remote sensing system was designed. Its prototype was built, and laboratory calibration and a joint air–ground water quality monitoring activity were performed. The hyperspectral imaging remote sensing system of UAV comprised a light and small UAV platform, spectral scanning hyperspectral imager, and data acquisition and control unit. The spectral principle of the hyperspectral imager is based on the new high-performance acousto-optic tunable (AOTF) technology. During laboratory calibration, the spectral calibration of the imaging spectrometer and image preprocessing in data acquisition were completed. In the UAV air–ground joint experiment, combined with the typical water bodies of the Yangtze River mainstream, the Three Gorges demonstration area, and the Poyang Lake demonstration area, the hyperspectral data cubes of the corresponding water areas were obtained, and geometric registration was completed. Thus, a large field-of-view mosaic and water radiation calibration were realized. A chlorophyl-a (Chl-a) sensor was used to test the actual water control points, and 11 traditional Chl-a sensitive spectrum selection algorithms were analyzed and compared. A random forest algorithm was used to establish a prediction model of water surface spectral reflectance and water quality parameter concentration. Compared with the back propagation neural network, partial least squares, and PSO-LSSVM algorithms, the accuracy of the RF algorithm in predicting Chl-a was significantly improved. The determination coefficient of the training samples was 0.84; root mean square error, 3.19 μg/L; and mean absolute percentage error, 5.46%. The established Chl-a inversion model was applied to UAV hyperspectral remote sensing images. The predicted Chl-a distribution agreed with the field observation results, indicating that the UAV-borne hyperspectral remote sensing water quality monitoring system based on AOTF is a promising remote sensing imaging spectral analysis tool for water.

Abstract Biological research requires wide-field optical imaging techniques with resolution down to the nanometer scale to study the biological process in a sub-cell or single molecular level. To meet this requirement, wide-field structured illumination method (WFSIM) has been extensively studied. The resolution of WFSIM is determined by the period of the optical interference pattern. However, in traditional WFSIM this period is diffraction limited so that pattern having periodicity smaller than 100 nm cannot be generated and as a result achieving an imaging resolution better than 50 nm is a great challenge. Here, we demonstrate a wide-field optical nanoimaging method based on a meta-sandwich structure (MSS) model. It is found that this structure can support standing wave surface plasmons interference pattern with a period of only 31 nm for 532 nm wavelength incident light. Furthermore, the potential application of the MSS for wide-field super-resolution imaging is discussed and the simulation results show an imaging resolution of sub-20 nm can be achieved. The demonstrated method paves a new route for the improvement of the wide field optical nanoimaging, which can be applied by biological researchers to study biological process conducted in cell membrane, such as mass transportation and others.

The schlieren method of measuring far-field focal spots offers many advantages at the Shenguang III laser facility such as low cost and automatic laser-path collimation. However, current methods of far-field focal spot measurement often suffer from low precision and efficiency when the final focal spot is merged manually, thereby reducing the accuracy of reconstruction. In this paper, we introduce an improved schlieren method to construct the high dynamic-range image of far-field focal spots and improve the reconstruction accuracy and efficiency. First, a detection method based on weak light beam sampling and magnification imaging was designed; images of the main and side lobes of the focused laser irradiance in the far field were obtained using two scientific CCD cameras. Second, using a self-correlation template matching algorithm, a circle the same size as the schlieren ball was dug from the main lobe cutting image and used to change the relative region of the main lobe cutting image within a 100×100 pixel region. The position that had the largest correlation coefficient between the side lobe cutting image and the main lobe cutting image when a circle was dug was identified as the best matching point. Finally, the least squares method was used to fit the center of the side lobe schlieren small ball, and the error was less than 1 pixel. The experimental results show that this method enables the accurate, high-dynamic-range measurement of a far-field focal spot and automatic image reconstruction. Because the best matching point is obtained through image processing rather than traditional reconstruction methods based on manual splicing, this method is less sensitive to the efficiency of focal-spot reconstruction and thus offers better experimental precision.

Sanxingdui cultural relics are the precious cultural heritage of humanity with high values of history, science, culture, art and research. However, mainstream analytical methods are contacting and detrimental, which is unfavorable to the protection of cultural relics. This paper improves the accuracy of the extraction, location, and analysis of artifacts using hyperspectral methods. To improve the accuracy of cultural relic mining, positioning, and analysis, the segmentation algorithm of Sanxingdui cultural relics based on the spatial spectrum integrated network is proposed with the support of hyperspectral techniques. Firstly, region stitching algorithm based on the relative position of hyper spectrally collected data is proposed to improve stitching efficiency. Secondly, given the prominence of traditional HRNet (High-Resolution Net) models in high-resolution data processing, the spatial attention mechanism is put forward to obtain spatial dimension information. Thirdly, in view of the prominence of 3D networks in spectral information acquisition, the pyramid 3D residual network model is proposed to obtain internal spectral dimensional information. Fourthly, four kinds of fusion methods at the level of data and decision are presented to achieve cultural relic labeling. As shown by the experiment results, the proposed network adopts an integrated method of data-level and decision-level, which achieves the optimal average accuracy of identification 0.84, realizes shallow coverage of cultural relics labeling, and effectively supports the mining and protection of cultural relics. [ABSTRACT FROM AUTHOR]