Search

In various countries worldwide, the incidence of colon cancer-related deaths has been on the rise in recent years. Early detection of symptoms and identification of intestinal polyps are crucial for improving the cure rate of colon cancer patients. Automated computer-aided diagnosis (CAD) has emerged as a solution to the low efficiency of traditional methods relying on manual diagnosis by physicians. Deep learning is the latest direction of CAD development and has shown promise for colonoscopic polyp segmentation. In this paper, we present a multi-level encoder-decoder architecture for polyp segmentation based on the Transformer architecture, termed NA-SegFormer. To improve the performance of existing Transformer-based segmentation algorithms for edge segmentation on colon polyps, we propose a patch merging module with a neighbor attention mechanism based on overlap patch merging. Since colon tract polyps vary greatly in size and different datasets have different sample sizes, we used a unified focal loss to solve the problem of category imbalance in colon tract polyp data. To assess the effectiveness of our proposed method, we utilized video capsule endoscopy and typical colonoscopy polyp datasets, as well as a dataset containing surgical equipment. On the datasets Kvasir-SEG, Kvasir-Instrument and KvasirCapsule-SEG, the Dice score of our proposed model reached 94.30%, 94.59% and 82.73%, with an accuracy of 98.26%, 99.02% and 81.84% respectively. The proposed method achieved inference speed with an Frame-per-second (FPS) of 125.01. The results demonstrated that our suggested model effectively segmented polyps better than several well-known and latest models. In addition, the proposed method has advantages in trade-off between inference speed and accuracy, and it will be of great significance to real-time colonoscopic polyp segmentation. The code is available at https://github.com/promisedong/NAFormer ., (© 2024. The Author(s).)

Leukemia is a type of blood tumour that occurs because of abnormal enhancement in WBCs (white blood cells) in the bone marrow of the human body. Blood-forming tissue cancer influences the lymphatic and bone marrow system. The early diagnosis and detection of leukaemia, i.e., the accurate difference of malignant leukocytes with little expense at the beginning of the disease, is a primary challenge in the disease analysis field. Despite the higher occurrence of leukemia, there is a lack of flow cytometry tools, and the procedures accessible at medical diagnostics centres are time-consuming. Distinct researchers have implemented computer-aided diagnostic (CAD) and machine learning (ML) methods for laboratory image analysis, aiming to manage the restrictions of late leukemia analysis. This study proposes a new Falcon optimization algorithm with deep convolutional neural network for Leukemia detection and classification (FOADCNN-LDC) technique. The main objective of the FOADCNN-LDC technique is to classify and recognize leukemia. The FOADCNN-LDC technique utilizes a median filtering (MF) based noise removal process to eradicate the image noise. Besides, the FOADCNN-LDC technique employs the ShuffleNetv2 model for the feature extraction process. Moreover, the detection and classification of the leukemia process are performed by utilizing the convolutional denoising autoencoder (CDAE) model. The FOA is implemented to select the hyperparameter of the CDAE model. The simulation process of the FOADCNN-LDC approach is performed on a benchmark medical dataset. The investigational analysis of the FOADCNN-LDC approach highlighted a superior accuracy value of 99.62% over existing techniques., (© 2024. The Author(s).)

Background: Understanding the causes and mechanisms underlying musculoskeletal pain is crucial for developing effective treatments and improving patient outcomes. Self-report measures, such as the Pain Drawing Scale, involve individuals rating their level of pain on a scale. In this technique, individuals color the area where they experience pain, and the resulting picture is rated based on the depicted pain intensity. Analyzing pain drawings (PDs) typically involves measuring the size of the pain region. There are several studies focusing on assessing the clinical use of PDs, and now, with the introduction of digital PDs, the usability and reliability of these platforms need validation. Comparative studies between traditional and digital PDs have shown good agreement and reliability. The evolution of PD acquisition over the last 2 decades mirrors the commercialization of digital technologies. However, the pen-on-paper approach seems to be more accepted by patients, but there is currently no standardized method for scanning PDs., Objective: The objective of this study was to evaluate the accuracy of PD analysis performed by a web platform using various digital scanners. The primary goal was to demonstrate that simple and affordable mobile devices can be used to acquire PDs without losing important information., Methods: Two sets of PDs were generated: one with the addition of 216 colored circles and another composed of various red shapes distributed randomly on a frontal view body chart of an adult male. These drawings were then printed in color on A4 sheets, including QR codes at the corners in order to allow automatic alignment, and subsequently scanned using different devices and apps. The scanners used were flatbed scanners of different sizes and prices (professional, portable flatbed, and home printer or scanner), smartphones with varying price ranges, and 6 virtual scanner apps. The acquisitions were made under normal light conditions by the same operator., Results: High-saturation colors, such as red, cyan, magenta, and yellow, were accurately identified by all devices. The percentage error for small, medium, and large pain spots was consistently below 20% for all devices, with smaller values associated with larger areas. In addition, a significant negative correlation was observed between the percentage of error and spot size (R=-0.237; P=.04). The proposed platform proved to be robust and reliable for acquiring paper PDs via a wide range of scanning devices., Conclusions: This study demonstrates that a web platform can accurately analyze PDs acquired through various digital scanners. The findings support the use of simple and cost-effective mobile devices for PD acquisition without compromising the quality of data. Standardizing the scanning process using the proposed platform can contribute to more efficient and consistent PD analysis in clinical and research settings., (© Corrado Cescon, Giuseppe Landolfi, Niko Bonomi, Marco Derboni, Vincenzo Giuffrida, Andrea Emilio Rizzoli, Paolo Maino, Eva Koetsier, Marco Barbero. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org).)

Spiking neural membrane systems (SN P systems) are a class of bio-inspired models inspired by the activities and connectivity of neurons. Extensive studies have been made on SN P systems with synchronization-based communication, while further efforts are needed for the systems with rhythm-based communication. In this work, we design an asynchronous SN P system with resonant connections where all the enabled neurons in the same group connected by resonant connections should instantly produce spikes with the same rhythm. In the designed system, each of the three modules implements one type of the three operations associated with the edge detection of digital images, and they collaborate each other through the resonant connections. An algorithm called EDSNP for edge detection is proposed to simulate the working of the designed asynchronous SN P system. A quantitative analysis of EDSNP and the related methods for edge detection had been conducted to evaluate the performance of EDSNP. The performance of the EDSNP in processing the testing images is superior to the compared methods, based on the quantitative metrics of accuracy, error rate, mean square error, peak signal-to-noise ratio and true positive rate. The results indicate the potential of the temporal firing and the proper neuronal connections in the SN P system to achieve good performance in edge detection.

Significance: Optical coherence tomography (OCT) has emerged as the standard of care for diagnosing and monitoring the treatment of various ocular disorders due to its noninvasive nature and in vivo volumetric acquisition capability. Despite its widespread applications in ophthalmology, motion artifacts remain a challenge in OCT imaging, adversely impacting image quality. While several multivolume registration algorithms have been developed to address this issue, they are often designed to cater to one specific OCT system or acquisition protocol., Aim: We aim to generate an OCT volume free of motion artifacts using a system-agnostic registration algorithm that is independent of system specifications or protocol., Approach: We developed a B-scan registration algorithm that removes motion and corrects for both translational eye movements and rotational angle differences between volumes. Tests were carried out on various datasets obtained from two different types of custom-built OCT systems and one commercially available system to determine the reliability of the proposed algorithm. Additionally, different system specifications were used, with variations in axial resolution, lateral resolution, signal-to-noise ratio, and real-time motion tracking. The accuracy of this method has further been evaluated through mean squared error (MSE) and multiscale structural similarity index measure (MS-SSIM)., Results: The results demonstrate improvements in the overall contrast of the images, facilitating detailed visualization of retinal vasculatures in both superficial and deep vasculature plexus. Finer features of the inner and outer retina, such as photoreceptors and other pathology-specific features, are discernible after multivolume registration and averaging. Quantitative analyses affirm that increasing the number of averaged registered volumes will decrease MSE and increase MS-SSIM as compared to the reference volume., Conclusions: The multivolume registered data obtained from this algorithm offers significantly improved visualization of the retinal microvascular network as well as retinal morphological features. Furthermore, we have validated that the versatility of our methodology extends beyond specific OCT modalities, thereby enhancing the clinical utility of OCT for the diagnosis and monitoring of ocular pathologies., (© 2024 The Authors.)

Digital dental technology covers oral cone-beam computed tomography (CBCT) image processing and low-dose CBCT dental applications. A low-dose CBCT image enhancement method based on image fusion is proposed to address the need for subzygomatic small screw insertion. Specifically, firstly, a sharpening correction module is proposed, where the CBCT image is sharpened to compensate for the loss of details in the underexposed/over-exposed region. Secondly, a visibility restoration module based on type II fuzzy sets is designed, and a contrast enhancement module using curve transformation is designed. In addition to this, we propose a perceptual fusion module that fuses visibility and contrast of oral CBCT images. As a result, the problems of overexposure/underexposure, low visibility, and low contrast that occur in oral CBCT images can be effectively addressed with consistent interpretability. The proposed algorithm was analyzed in comparison experiments with a variety of algorithms, as well as ablation experiments. After analysis, compared with advanced enhancement algorithms, this algorithm achieved excellent results in low-dose CBCT enhancement and effective observation of subzygomatic small screw implantation. Compared with the best performing method, the evaluation metric is 0.07-2 higher on both datasets. The project can be found at: https://github.com/sunpeipei2024/low-dose-CBCT ., (© 2024. The Author(s).)

This paper presents an experimental evaluation of a wearable light-emitting diode (LED) transmitter in an optical camera communications (OCC) system. The evaluation is conducted under conditions of controlled user movement during indoor physical exercise, encompassing both mild and intense exercise scenarios. We introduce an image processing algorithm designed to identify a template signal transmitted by the LED and detected within the image. To enhance this process, we utilize the dynamics of controlled exercise-induced motion to limit the tracking process to a smaller region within the image. We demonstrate the feasibility of detecting the transmitting source within the frames, and thus limit the tracking process to a smaller region within the image, achieving an reduction of 87.3% for mild exercise and 79.0% for intense exercise.

The ability of a data fusion system composed of a computer vision system (CVS) and an electronic nose (e-nose) was evaluated to predict key physiochemical attributes and distinguish red-fleshed kiwifruit produced in three distinct regions in northern Iran. Color and morphological features from whole and middle-cut kiwifruits, along with the maximum responses of the 13 metal oxide semiconductor (MOS) sensors of an e-nose system, were used as inputs to the data fusion system. Principal component analysis (PCA) revealed that the first two principal components (PCs) extracted from the e-nose features could effectively differentiate kiwifruit samples from different regions. The PCA-SVM algorithm achieved a 93.33% classification rate for kiwifruits from three regions based on data from individual e-nose and CVS. Data fusion increased the classification rate of the SVM model to 100% and improved the performance of Support Vector Regression (SVR) for predicting physiochemical indices of kiwifruits compared to individual systems. The data fusion-based PCA-SVR models achieved validation R 2 values ranging from 90.17% for the Brix-Acid Ratio (BAR) to 98.57% for pH prediction. These results demonstrate the high potential of fusing artificial visual and olfactory systems for quality monitoring and identifying the geographical growing regions of kiwifruits., (© 2023. The Author(s).)

This paper presents an advanced methodology for defect prediction in radiographic images, predicated on a refined particle swarm optimization (PSO) algorithm with an emphasis on fluctuation sensitivity. Conventional PSO models with stable velocity are often beleaguered with challenges in precisely pinpointing defect regions in radiographic images, attributable to the lack of a defect-centric approach and the propensity for premature convergence. The proposed fluctuation-sensitive particle swarm optimization (FS-PSO) model, distinguished by an approximate 40% increase in particle entrapment within defect areas and an expedited convergence rate, necessitates a maximal additional time consumption of only 2.28%. The model, also characterized by reduced chaotic swarm movement, enhances efficiency through the modulation of movement intensity concomitant with the escalation in swarm size. The FS-PSO algorithm's performance was rigorously evaluated via a series of simulations and practical blade experiments. The empirical findings evince that the FS-PSO model substantially outperforms the conventional stable velocity model, particularly in terms of shape retention in defect extraction.

In the context of Shared Autonomous Vehicles, the need to monitor the environment inside the car will be crucial. This article focuses on the application of deep learning algorithms to present a fusion monitoring solution which was three different algorithms: a violent action detection system, which recognizes violent behaviors between passengers, a violent object detection system, and a lost items detection system. Public datasets were used for object detection algorithms (COCO and TAO) to train state-of-the-art algorithms such as YOLOv5. For violent action detection, the MoLa InCar dataset was used to train on state-of-the-art algorithms such as I3D, R(2+1)D, SlowFast, TSN, and TSM. Finally, an embedded automotive solution was used to demonstrate that both methods are running in real-time.

Background:  With the advances in current technology, hand gesture recognition has gained considerable attention. It has been extended to recognize more distinctive movements, such as a signature, in human-computer interaction (HCI) which enables the computer to identify a person in a non-contact acquisition environment. This application is known as in-air hand gesture signature recognition. To our knowledge, there are no publicly accessible databases and no detailed descriptions of the acquisitional protocol in this domain. Methods:  This paper aims to demonstrate the procedure for collecting the in-air hand gesture signature's database. This database is disseminated as a reference database in the relevant field for evaluation purposes. The database is constructed from the signatures of 100 volunteer participants, who contributed their signatures in two different sessions. Each session provided 10 genuine samples enrolled using a Microsoft Kinect sensor camera to generate a genuine dataset. In addition, a forgery dataset was also collected by imitating the genuine samples. For evaluation, each sample was preprocessed with hand localization and predictive hand segmentation algorithms to extract the hand region. Then, several vector-based features were extracted. Results:  In this work, classification performance analysis and system robustness analysis were carried out. In the classification analysis, a multiclass Support Vector Machine (SVM) was employed to classify the samples and 97.43% accuracy was achieved; while the system robustness analysis demonstrated low error rates of 2.41% and 5.07% in random forgery and skilled forgery attacks, respectively. Conclusions:  These findings indicate that hand gesture signature is not only feasible for human classification, but its properties are also robust against forgery attacks., Competing Interests: No competing interests were disclosed., (Copyright: © 2023 Khoh WH et al.)

Somatic cell count (SCC) is a fundamental approach for determining the quality of cattle and bovine milk. So far, different classification and recognition methods have been proposed, all with certain limitations. In this study, we introduced a new deep learning tool, i.e., an improved ResNet50 model constructed based on the residual network and fused with the position attention module and channel attention module to extract the feature information more effectively. In this paper, macrophages, lymphocytes, epithelial cells, and neutrophils were assessed. An image dataset for milk somatic cells was constructed by preprocessing to increase the diversity of samples. PolyLoss was selected as the loss function to solve the unbalanced category samples and difficult sample mining. The Adam optimization algorithm was used to update the gradient, while Warm-up was used to warm up the learning rate to alleviate the overfitting caused by small sample data sets and improve the model's generalization ability. The experimental results showed that the classification accuracy, precision rate, recall rate, and comprehensive evaluation index F value of the proposed model reached 97%, 94.5%, 90.75%, and 92.25%, respectively, indicating that the proposed model could effectively classify the milk somatic cell images, showing a better classification performance than five previous models (i.e., ResNet50, ResNet18, ResNet34, AlexNet andMobileNetv2). The accuracies of the ResNet18, ResNet34, ResNet50, AlexNet, MobileNetv2, and the new model were 95%, 93%, 93%, 56%, 37%, and 97%, respectively. In addition, the comprehensive evaluation index F1 showed the best effect, fully verifying the effectiveness of the proposed method in this paper. The proposed method overcame the limitations of image preprocessing and manual feature extraction by traditional machine learning methods and the limitations of manual feature selection, improving the classification accuracy and showing a strong generalization ability.

The recognition process of natural scenes is complicated at present, and images themselves may be complex owing to the special features of natural scenes. In this study, we use the detection and recognition of pill box text as an application scenario and design a deep-learning-based text detection algorithm for such natural scenes. We propose an end-to-end graphical text detection and recognition model and implement a detection system based on the B/S research application for pill box recognition, which uses DBNet as the text detection framework and a convolutional recurrent neural network (CRNN) as the text recognition framework. No prior image preprocessing is required in the detection and recognition processes. The recognition result from the back-end is returned to the front-end display. Compared with traditional methods, this recognition process reduces the complexity of preprocessing prior to image detection and improves the simplicity of the model application. Experiments on the detection and recognition of 100 pill boxes demonstrate that the proposed method achieves better accuracy in text localization and recognition results than the previous CTPN + CRNN method. The proposed method is significantly more accurate and easier to use than the traditional approach in terms of both training and recognition processes.

Hyperspectral Imaging (HSI) is increasingly adopted in medical applications for the usefulness of understanding the spectral signature of specific organic and non-organic elements. The acquisition of such images is a complex task, and the commercial sensors that can measure such images is scarce down to the point that some of them have limited spatial resolution in the bands of interest. This work proposes an approach to enhance the spatial resolution of hyperspectral histology samples using super-resolution. As the data volume associated to HSI has always been an inconvenience for the image processing in practical terms, this work proposes a relatively low computationally intensive algorithm. Using multiple images of the same scene taken in a controlled environment (hyperspectral microscopic system) with sub-pixel shifts between them, the proposed algorithm can effectively enhance the spatial resolution of the sensor while maintaining the spectral signature of the pixels, competing in performance with other state-of-the-art super-resolution techniques, and paving the way towards its use in real-time applications.

Intensity-modulated radiotherapy is a widely used technique for accurately targeting cancerous tumours in difficult locations using dynamically shaped beams. This is ideally accompanied by real-time independent verification. Monolithic active pixel sensors are a viable candidate for providing upstream beam monitoring during treatment. We have already demonstrated that a Monolithic Active Pixel Sensor (MAPS)-based system can fulfill all clinical requirements except for the minimum required size. Here, we report the performance of a large-scale demonstrator system consisting of a matrix of 2 × 2 sensors, which is large enough to cover almost all radiotherapy treatment fields when affixed to the shadow tray of the LINAC head. When building a matrix structure, a small dead area is inevitable. Here, we report that with a newly developed position algorithm, leaf positions can be reconstructed over the entire range with a position resolution of below ∼200 μm in the centre of the sensor, which worsens to just below 300 μm in the middle of the gap between two sensors. A leaf position resolution below 300 μm results in a dose error below 2%, which is good enough for clinical deployment.

In this paper, we describe an algorithm for accurately segmenting multiple nudfclei from clumps of non-overlapping immuno-histochemically stained histological hepatic (liver) images. This problem is notoriously difficult because of the degree of presence of stains among the multi-nucleated cells, the poor contrast of cell cytoplasm, and the presence of mucus, blood, and inflammatory cells in the images. Hepatocellular carcinoma, characterized by cellular and nuclear enlargement, nuclear pleomorphism, and multi-nucleation, poses a prominent threat. Our proposed method addresses the aforementioned issues for an automated diagnosis system by judging the presence of multiple nuclei in a two-step process: the Quickhull algorithm defines the convex hull of each cell in the image and candidate nuclei regions are located with morphological operations. A combination of features containing local minima and shape-dependent features is extracted for the detection of single or multiple nuclei in each cell with a significant reduction in the number of false positives and false negatives providing an accuracy of 89.76%., (© 2022. The Author(s) under exclusive licence to Society for Imaging Informatics in Medicine.)

Cell-based screening methods are increasingly used in diagnostics and drug development. As a result, various research groups from around the world have been working on this topic to develop methods and algorithms that increase the degree of automation of various measurement techniques. The field of computer vision is becoming increasingly important and has therefore a significant influence on the development of various processes in modern laboratories. In this work we describe an approach for detecting two height information, the phase boundary of a cell pellet and the bottom edge of the tube, and thereby a method for determining the highest point of the topology. The starting point for the development of the method described are cells obtained by various procedures and stabilized by a fixative. Centrifugation of the tube causes the cells to settle to the bottom of the tube, resulting in a cell pellet with a clear phase boundary between the cells and the fixative. For further studies, the supernatant fixative has to be removed without reducing the number of cells. The fixative is to be extracted automatically by a liquid robot, which is only possible by accurately determining the cell pellet height. Due to centrifugation, an uneven topology is formed, which is why the entire phase boundary must be examined to detect the highest point of the cell pellet. For this approach, the tube to be examined, which contains the cells and the fixative, is rotated 360° in defined small steps after centrifugation. During rotation, an image is captured in each step, after which a defined image area is separated from the center of the image and merged into a panoramic image. This produces a panoramic image of the cell topology which represents the complete phase boundary, the boundary located on the outside of the tube. This panoramic image is modified through various image processing steps to extract and detect the phase boundary. Various image processing algorithms from the OpenCV library are used. In the first step, the panoramic image is convolved with a Gaussian blur filter to reduce noise. In the following step, a black and white image is generated by a thresholding process. This black and white image, or binary image, is convolved with a Sobel operator in the x and y directions and the results are superimposed. This overlaid image shows the top edge of the cell pellet and other edges located in the image. A logical exclusion method of the obtained boundaries is used for the detection of the phase boundary. To detect the tube bottom, a multilevel model was trained in advance with an appropriate data set. This model can detect and localize in near real time the tube bottom in an image. By using the two-height information of the different boundaries, phase boundary and tube bottom, the highest point of the cell pellet can be detected. This information is then passed on to a higher-level process so that the liquid robot can approach this point with the pipette tip to remove the excess fixative. By determining the highest point, the probability of being able to remove a larger amount of fixative without reducing the number of cells is highest. This ensures that post-processing studies have the largest possible number of cells available with complete automation., Competing Interests: Declaration of Competing Interest The authors declared no potential conflicts of interest regarding the research, authorship, and/ or publication of this article., (Copyright © 2022. Published by Elsevier Inc.)

In the terms of industry, the hand-scraping method is a key technology for achieving high precision in machine tools, and the quality of scraping workpieces directly affects the accuracy and service life of the machine tool. However, most of the quality evaluation of the scraping workpieces is carried out by the scraping worker's subjective judgment, which results in differences in the quality of the scraping workpieces and is time-consuming. Hence, in this research, an edge-cloud computing system was developed to obtain the relevant parameters, which are the percentage of point (POP) and the peak point per square inch (PPI), for evaluating the quality of scraping workpieces. On the cloud computing server-side, a novel network called cascaded segmentation U-Net is proposed to high-quality segment the height of points (HOP) (around 40 μm height) in favor of small datasets training and then carries out a post-processing algorithm that automatically calculates POP and PPI. This research emphasizes the architecture of the network itself instead. The design of the components of our network is based on the basic idea of identity function, which not only solves the problem of the misjudgment of the oil ditch and the residual pigment but also allows the network to be end-to-end trained effectively. At the head of the network, a cascaded multi-stage pixel-wise classification is designed for obtaining more accurate HOP borders. Furthermore, the "Cross-dimension Compression" stage is used to fuse high-dimensional semantic feature maps across the depth of the feature maps into low-dimensional feature maps, producing decipherable content for final pixel-wise classification. Our system can achieve an error rate of 3.7% and 0.9 points for POP and PPI. The novel network achieves an Intersection over Union (IoU) of 90.2%.

The evaluation of inoculation processes of microorganisms by robotic systems as well as by lab-technicians is compensable and can be missing consistency as human judgment will depend on the individual and may therefore be biased and less effective than models and algorithms evaluating spatial patterns. To address this problem, nearest neighbor analysis was used to investigate if it could be utilized as a method to evaluate isolation processes. The nearest neighbor analysis results in a comparable numeric value on the isolation process, which can be used to assess results of different inoculation processes. In this article, images of Petri dishes and simulated plates are used to investigate the effectiveness of nearest neighbor analysis, which is a method within spatial statistics. This analysis is applied to spatial data created by applying computer vision to localize the colonies on the plates. When evaluating plates made with the streaking technique method, it was found to be ineffective as the dense parts of the distribution resulted in the computer vision being unable to locate all of the colonies. Therefore, the nearest neighbor analysis is not suitable to evaluate streaking plates and other methods to evaluate such plates should be developed. However, when evaluating Petri dishes where the spread plating technique had been applied, it was found that nearest neighbor analysis can be a useful way to systematically evaluate isolation processes., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022. Published by Elsevier Inc.)

In general, it is very difficult to visually locate blood vessels for intravenous injection or surgery. In addition, if vein detection fails, physical and mental pain occurs to the patient and leads to financial loss in the hospital. In order to prevent this problem, NIR-based vein detection technology is developing. The proposed study combines vein detection and digital hair removal to eliminate body hair, a noise that hinders the accuracy of detection, improving the performance of the entire algorithm by about 10.38% over existing systems. In addition, as a result of performing venous detection of patients without body hair, 5.04% higher performance than the existing system was detected, and the proposed study results were verified. It is expected that the use of devices to which the proposed study is applied will provide more accurate vascular maps in general situations.

Serial-section electron microscopy (ssEM) is the method of choice for studying macroscopic biological samples at extremely high resolution in three dimensions. In the nervous system, nanometer-scale images are necessary to reconstruct dense neural wiring diagrams in the brain, so -called connectomes . The data that can comprise of up to 10 8 individual EM images must be assembled into a volume, requiring seamless 2D registration from physical section followed by 3D alignment of the stitched sections. The high throughput of ssEM necessitates 2D stitching to be done at the pace of imaging, which currently produces tens of terabytes per day. To achieve this, we present a modular volume assembly software pipeline ASAP (Assembly Stitching and Alignment Pipeline) that is scalable to datasets containing petabytes of data and parallelized to work in a distributed computational environment. The pipeline is built on top of the Render Trautman and Saalfeld (2019) services used in the volume assembly of the brain of adult Drosophila melanogaster (Zheng et al. 2018). It achieves high throughput by operating only on image meta-data and transformations. ASAP is modular, allowing for easy incorporation of new algorithms without significant changes in the workflow. The entire software pipeline includes a complete set of tools for stitching, automated quality control, 3D section alignment, and final rendering of the assembled volume to disk. ASAP has been deployed for continuous stitching of several large-scale datasets of the mouse visual cortex and human brain samples including one cubic millimeter of mouse visual cortex (Yin et al. 2020); Microns Consortium et al. (2021) at speeds that exceed imaging. The pipeline also has multi-channel processing capabilities and can be applied to fluorescence and multi-modal datasets like array tomography., Competing Interests: GM, RT, DK, ET, TF, SS, RY, SK, JB, MT, WY, DB, RG, JN, EL, SS, RR, KK, SS, FC, NM No competing interests declared, EP has a competing interest in Yikes LLC, (© 2022, Mahalingam, Torres et al.)

For automated optical inspection, autofocusing microscopes play an important role in capturing clear images of the measured object. At present, the image processing part of optics-based autofocusing microscopes often has various factors, which makes it impossible to describe the image information of the semicircular (or elliptical) spot with a simple circle-finding method. Accordingly, this study has developed a novel algorithm that can quickly calculate the ideal center of the elliptical spot and effectively compensate the linearity of the focusing characteristic curve. A prototype model was used to characterize and verify the proposed algorithm. The experimental results show that by using the proposed algorithm, the autofocusing accuracy can be effectively improved to less than 1.5 μm.

Since the emergence of new coronaviruses and their variant virus, a large number of medical resources around the world have been put into treatment. In this case, the purpose of this article is to develop a handback intravenous intelligence injection robot, which reduces the direct contact between medical staff and patients and reduces the risk of infection. The core technology of hand back intravenous intelligent robot is a handlet venous vessel detection and segmentation and the position of the needle point position decision. In this paper, an image processing algorithm based on U-Net improvement mechanism (AT-U-Net) is proposed for core technology. It is investigated using a self-built dorsal hand vein database and the results show that it performs well, with an F1-score of 93.91%. After the detection of a dorsal hand vein, this paper proposes a location decision method for the needle entry point based on an improved pruning algorithm (PT-Pruning). The extraction of the trunk line of the dorsal hand vein is realized through this algorithm. Considering the vascular cross-sectional area and bending of each vein injection point area, the optimal injection point of the dorsal hand vein is obtained via a comprehensive decision-making process. Using the self-built dorsal hand vein injection point database, the accuracy of the detection of the effective injection area reaches 96.73%. The accuracy for the detection of the injection area at the optimal needle entry point is 96.50%, which lays a foundation for subsequent mechanical automatic injection.

The identification of human activities from videos is important for many applications. For such a task, three-dimensional (3D) depth images or image sequences (videos) can be used, which represent the positioning information of the objects in a 3D scene obtained from depth sensors. This paper presents a framework to create foreground-background masks from depth images for human body segmentation. The framework can be used to speed up the manual depth image annotation process with no semantics known beforehand and can apply segmentation using a performant algorithm while the user only adjusts the parameters, or corrects the automatic segmentation results, or gives it hints by drawing a boundary of the desired object. The approach has been tested using two different datasets with a human in a real-world closed environment. The solution has provided promising results in terms of reducing the manual segmentation time from the perspective of the processing time as well as the human input time.

The comprehensive production of detailed bathymetric maps is important for disaster prevention, resource exploration, safe navigation, marine salvage, and monitoring of marine organisms. However, owing to observation difficulties, the amount of data on the world's seabed topography is scarce. Therefore, it is essential to develop methods that effectively use the limited data. In this study, based on dictionary learning and sparse coding, we modified the super-resolution technique and applied it to seafloor topographical maps. Improving on the conventional method, before dictionary learning, we performed pre-processing to separate the teacher image into a low-frequency component that has a general structure and a high-frequency component that captures the detailed topographical features. We learn the topographical features by training the dictionary. As a result, the root-mean-square error (RMSE) was reduced by 30% compared with bicubic interpolation and accuracy was improved, especially in the rugged part of the terrain. The proposed method, which learns a dictionary to capture topographical features and reconstructs them using a dictionary, produces super-resolution with high interpretability.

Background: Locomotive behaviors are a rapid evaluation indicator reflecting whether the nervous system of worms is damaged, and has been proved to be sensitive to chemical toxicity. In many toxicological studies, C. elegans head thrashes is a key indicator of locomotive behaviors to measure the vitality of worms. In previous studies, the number of head thrashes was manually counted, which is time-consuming and labor-intensive., Results: This paper presents an automatic recognition and counting method for head thrashes behavior of worms from experimental videos. First, the image processing algorithm is designed for worm morphology features calculation, mean gray values of head and tail are used to locate the head of worm accurately. Next, the worm skeleton is extracted and divided into equal parts. The angle formulas are used to calculate the bending angle of the head of worm. Finally, the number of head thrashes is counted according to the bending angle of the head in each frame. The robustness of the proposed algorithm is evaluated by comparing the counting results of the manual counting. It is proved that the proposed algorithm can recognize the occurrence of head thrashes of C. elegans of different strains. In addition, the difference of the head thrashes behavior of different worm strains is analyzed, it is proved that the relationship between worm head thrashes behavior and lifespan., Conclusions: A new method is proposed to automatically count the number of head thrashes of worms. This algorithm makes it possible to count the number of head thrashes from the worm videos collected by the automatic tracking system. The proposed algorithm will play an important role in toxicological research and worm vitality research. The code is freely available at https://github.com/hthana/HTC ., (© 2022. The Author(s).)

Visual object tracking (VOT) is a vital part of various domains of computer vision applications such as surveillance, unmanned aerial vehicles (UAV), and medical diagnostics. In recent years, substantial improvement has been made to solve various challenges of VOT techniques such as change of scale, occlusions, motion blur, and illumination variations. This paper proposes a tracking algorithm in a spatiotemporal context (STC) framework. To overcome the limitations of STC based on scale variation, a max-pooling-based scale scheme is incorporated by maximizing over posterior probability. To avert target model from drift, an efficient mechanism is proposed for occlusion handling. Occlusion is detected from average peak to correlation energy (APCE)-based mechanism of response map between consecutive frames. On successful occlusion detection, a fractional-gain Kalman filter is incorporated for handling the occlusion. An additional extension to the model includes APCE criteria to adapt the target model in motion blur and other factors. Extensive evaluation indicates that the proposed algorithm achieves significant results against various tracking methods.

Template matching is a simple image detection algorithm that can easily detect different types of objects just by changing the template without tedious training procedures. Despite these advantages, template matching is not currently widely used. This is because traditional template matching is not very reliable for images that differ from the template. The reliability of template matching can be improved by using additional information (depths for the template) available from the vision sensor system. Methods of obtaining the depth of a template using stereo vision or a few (two or more) template images or a short template video via mono vision are well known in the vision literature and have been commercialized. In this strategy, this paper proposes a template matching vision sensor system that can easily detect various types of objects without prior training. To this end, by using the additional information provided by the vision sensor system, we study a method to increase the reliability of template matching, even when there is a difference in the 3D direction and size between the template and the image. Template images obtained through the vision sensor provide a depth template. Using this depth template, it is possible to predict the change of the image according to the difference in the 3D direction and the size of the object. Using the predicted changes in these images, the template is calibrated close to the given image, and then template matching is performed. For ease of use, the algorithm is proposed as a closed form solution that avoids tedious recursion or training processes. For wider application and more accurate results, the proposed method considers the 3D direction and size difference in the perspective projection model and the general 3D rotation model.

In recent years, jellyfish outbreaks have frequently occurred in offshore areas worldwide, posing a significant threat to the marine fishery, tourism, coastal industry, and personal safety. Effective monitoring of jellyfish is a vital method to solve the above problems. However, the optical detection method for jellyfish is still in the primary stage. Therefore, this paper studies a jellyfish detection method based on convolution neural network theory and digital image processing technology. This paper studies the underwater image preprocessing algorithm because the quality of underwater images directly affects the detection results. The results show that the image quality is better after applying the three algorithms namely prior defogging, adaptive histogram equalization, and multi-scale retinal enhancement, which is more conducive to detection. We establish a data set containing seven species of jellyfishes and fish. A total of 2141 images are included in the data set. The YOLOv3 algorithm is used to detect jellyfish, and its feature extraction network Darknet53 is optimized to ensure it is conducted in real-time. In addition, we introduce label smoothing and cosine annealing learning rate methods during the training process. The experimental results show that the improved algorithms improve the detection accuracy of jellyfish on the premise of ensuring the detection speed. This paper lays a foundation for the construction of an underwater jellyfish optical imaging real-time monitoring system.

In the field of underwater vision, image matching between the main two sensors (sonar and optical camera) has always been a challenging problem. The independent imaging mechanism of the two determines the modalities of the image, and the local features of the images under various modalities are significantly different, which makes the general matching method based on the optical image invalid. In order to make full use of underwater acoustic and optical images, and promote the development of multisensor information fusion (MSIF) technology, this letter proposes to apply an image attribute transfer algorithm and advanced local feature descriptor to solve the problem of underwater acousto-optic image matching. We utilize real and simulated underwater images for testing; experimental results show that our proposed method could effectively preprocess these multimodal images to obtain an accurate matching result, thus providing a new solution for the underwater multisensor image matching task.

Several noise sources, such as the Johnson-Nyquist noise, affect MR images disturbing the visualization of structures and affecting the subsequent extraction of radiomic data. We evaluate the performance of 5 denoising filters (anisotropic diffusion filter (ADF), curvature flow filter (CFF), Gaussian filter (GF), non-local means filter (NLMF), and unbiased non-local means (UNLMF)), with 33 different settings, in T2-weighted MR images of phantoms (N = 112) and neuroblastoma patients (N = 25). Filters were discarded until the most optimal solutions were obtained according to 3 image quality metrics: peak signal-to-noise ratio (PSNR), edge-strength similarity-based image quality metric (ESSIM), and noise (standard deviation of the signal intensity of a region in the background area). The selected filters were ADFs and UNLMs. From them, 107 radiomics features preservation at 4 progressively added noise levels were studied. The ADF with a conductance of 1 and 2 iterations standardized the radiomic features, improving reproducibility and quality metrics., (© 2021. Society for Imaging Informatics in Medicine.)

In this work, we present an eye-image acquisition device that can be used as an image acquisition front-end application in compact, low-cost, and easy-to-integrate products for smart-city access control applications, based on iris recognition. We present the advantages and disadvantages of iris recognition compared to fingerprint- or face recognition. We also present the main drawbacks of the existing commercial solutions and propose a concept device design for door-mounted access control systems based on iris recognition technology. Our eye-image acquisition device was built around a low-cost camera module. An integrated infrared distance measurement was used for active image focusing. FPGA image processing was used for raw-RGB to grayscale demosaicing and passive image focusing. The integrated visible light illumination meets the IEC62471 photobiological safety standard. According to our results, we present the operation of the distance-measurement subsystem, the operation of the image-focusing subsystem, examples of acquired images of an artificial toy eye under different illumination conditions, and the calculation of illumination exposure hazards. We managed to acquire a sharp image of an artificial toy eye sized 22 mm in diameter from an approximate distance of 10 cm, with 400 pixels over the iris diameter, an average acquisition time of 1 s, and illumination below hazardous exposure levels.

Significance: Polyp size is important for selecting the surveillance interval or treatment policy. Nevertheless, it is challenging to accurately estimate the polyp size during endoscopy. An easy and cost-effective function to assist in polyp size estimation is required., Aim: To propose a virtual scale function for endoscopy and evaluate its performance and expected accuracy., Approach: An adaptive virtual scale behavior was demonstrated. The measurement error of the virtual scale along the distance between the tip of the endoscope and the object plane was evaluated using graph paper. The accuracy of polyp size estimation by an expert endoscopist was compared with the accuracy of the biopsy forceps method using phantom images., Results: The measurement errors of the virtual scale were   ≤  0.7  mm when the distance to the graph paper, which faced the tip of the endoscope, varied from 4 to 30 mm. The accuracy with the virtual scale was significantly higher than that obtained with biopsy forceps (5.3  ±  5.5  %   versus 11.9  ±  9.4  %  , P  <  0.001)., Conclusions: The virtual scale function, which operates in real-time without any additional device, can be used to estimate polyp sizes easily and accurately with endoscopy.

The accuracy of photogrammetric reconstruction depends largely on the acquisition conditions and on the quality of input photographs. This paper proposes methods of improving raster images that increase photogrammetric reconstruction accuracy. These methods are based on modifying color image histograms. Special emphasis was placed on the selection of channels of the RGB and CIE L*a*b* color models for further improvement of the reconstruction process. A methodology was proposed for assessing the quality of reconstruction based on premade reference models using positional statistics. The analysis of the influence of image enhancement on reconstruction was carried out for various types of objects. The proposed methods can significantly improve the quality of reconstruction. The superiority of methods based on the luminance channel of the L*a*b* model was demonstrated. Our studies indicated high efficiency of the histogram equalization method (HE), although these results were not highly distinctive for all performed tests.

Visual inspection is an important task in manufacturing industries in order to evaluate the completeness and quality of manufactured products. An autonomous robot-guided inspection system was recently developed based on an offline programming (OLP) and RGB-D model system. This system allows a non-expert automatic optical inspection (AOI) engineer to easily perform inspections using scanned data. However, if there is a positioning error due to displacement or rotation of the object, this system cannot be used on a production line. In this study, we developed an automated position correction module to locate an object's position and correct the robot's pose and position based on the detected error values in terms of displacement or rotation. The proposed module comprised an automatic hand-eye calibration and the PnP algorithm. The automatic hand-eye calibration was performed using a calibration board to reduce manual error. After calibration, the PnP algorithm calculates the object position error using artificial marker images and compensates for the error to a new object on the production line. The position correction module then automatically maps the defined AOI target positions onto a new object, unless the target position changes. We performed experiments that showed that the robot-guided inspection system with the position correction module effectively performed the desired task. This smart innovative system provides a novel advancement by automating the AOI process on a production line to increase productivity.

Significance: Speckle noise limits the diagnostic capabilities of optical coherence tomography (OCT) images, causing both a reduction in contrast and a less accurate assessment of the microstructural morphology of the tissue., Aim: We present a speckle-noise reduction method for OCT volumes that exploits the advantages of adaptive-noise wavelet thresholding with a wavelet compounding method applied to several frames acquired from consecutive positions. The method takes advantage of the wavelet representation of the speckle statistics, calculated properly from a homogeneous sample or a region of the noisy volume., Approach: The proposed method was first compared quantitatively with different state-of-the-art approaches by being applied to three different clinical dermatological OCT volumes with three different OCT settings. The method was also applied to a public retinal spectral-domain OCT dataset to demonstrate its applicability to different imaging modalities., Results: The results based on four different metrics demonstrate that the proposed method achieved the best performance among the tested techniques in suppressing noise and preserving structural information., Conclusions: The proposed OCT denoising technique has the potential to adapt to different image OCT settings and noise environments and to improve image quality prior to clinical diagnosis based on visual assessment.

Technologies and services towards smart-vehicles and Intelligent-Transportation-Systems (ITS), continues to revolutionize many aspects of human life. This paper presents a detailed survey of current techniques and advancements in Automatic-Number-Plate-Recognition (ANPR) systems, with a comprehensive performance comparison of various real-time tested and simulated algorithms, including those involving computer vision (CV). ANPR technology has the ability to detect and recognize vehicles by their number-plates using recognition techniques. Even with the best algorithms, a successful ANPR system deployment may require additional hardware to maximize its accuracy. The number plate condition, non-standardized formats, complex scenes, camera quality, camera mount position, tolerance to distortion, motion-blur, contrast problems, reflections, processing and memory limitations, environmental conditions, indoor/outdoor or day/night shots, software-tools or other hardware-based constraint may undermine its performance. This inconsistency, challenging environments and other complexities make ANPR an interesting field for researchers. The Internet-of-Things is beginning to shape future of many industries and is paving new ways for ITS. ANPR can be well utilized by integrating with RFID-systems, GPS, Android platforms and other similar technologies. Deep-Learning techniques are widely utilized in CV field for better detection rates. This research aims to advance the state-of-knowledge in ITS (ANPR) built on CV algorithms; by citing relevant prior work, analyzing and presenting a survey of extraction, segmentation and recognition techniques whilst providing guidelines on future trends in this area.

Purpose: In order to improve the accuracy of liquid level detection in intravenous left auxiliary vein infusion and reduce the pain of patients with blood returning from intravenous infusion, we propose a deep learning based liquid level detection model of infusion levels to facilitate this operation., Method: We implemented a Yolo v3-based detection model of infusion level images in intravenous infusion, and at the same time, compare it with SURF image processing technique, RCNN, and Fast-RCNN methods., Results: The model in this paper is better than the comparison algorithm in Intersection over Union (IoU), precision, recall and test time. The liquid level detection model based on Yolo v3 has a precision of 0.9768, a recall rate of 0.9688, an IoU of 0.8943, and a test time of 2.9 s., Conclusion: The experimental results prove that the liquid level detection method based on deep learning has the characteristics of high accuracy and good real-time performance. This method can play a certain auxiliary role in the hospital environment and improve work efficiency of medical workers.

Background: Immunofluorescent confocal microscopy uses labeled antibodies as probes against specific macromolecules to discriminate between multiple cell types. For images of the developmental mouse lung, these cells are themselves organized into densely packed higher-level anatomical structures. These types of images can be challenging to segment automatically for several reasons, including the relevance of biomedical context, dependence on the specific set of probes used, prohibitive cost of generating labeled training data, as well as the complexity and dense packing of anatomical structures in the image. The use of an application ontology helps surmount these challenges by combining image data with its metadata to provide a meaningful biological context, modeled after how a human expert would make use of contextual information to identify histological structures, that constrains and simplifies the process of segmentation and object identification., Results: We propose an innovative approach for the semi-supervised analysis of complex and densely packed anatomical structures from immunofluorescent images that utilizes an application ontology to provide a simplified context for image segmentation and object identification. We describe how the logical organization of biological facts in the form of an ontology can provide useful constraints that facilitate automatic processing of complex images. We demonstrate the results of ontology-guided segmentation and object identification in mouse developmental lung images from the Bioinformatics REsource ATlas for the Healthy lung database of the Molecular Atlas of Lung Development (LungMAP1) program CONCLUSION: We describe a novel ontology-guided approach to segmentation and classification of complex immunofluorescence images of the developing mouse lung. The ontology is used to automatically generate constraints for each image based on its biomedical context, which facilitates image segmentation and classification.

Tracking and action-recognition algorithms are currently widely used in video surveillance, monitoring urban activities and in many other areas. Their development highly relies on benchmarking scenarios, which enable reliable evaluations/improvements of their efficiencies. Presently, benchmarking methods for tracking and action-recognition algorithms rely on manual annotation of video databases, prone to human errors, limited in size and time-consuming. Here, using gained experiences, an alternative benchmarking solution is presented, which employs methods and tools obtained from the computer-game domain to create simulated video data with automatic annotations. Presented approach highly outperforms existing solutions in the size of the data and variety of annotations possible to create. With proposed system, a potential user can generate a sequence of random images involving different times of day, weather conditions, and scenes for use in tracking evaluation. In the design of the proposed tool, the concept of crowd simulation is used and developed. The system is validated by comparisons to existing methods.

Time-lapse microscopy provides an unprecedented opportunity to monitor single-cell dynamics. However, tracking cells for long periods remains a technical challenge, especially for multi-day, large-scale movies with rapid cell migration, high cell density, and drug treatments that alter cell morphology/behavior. Here, we present EllipTrack, a global-local cell-tracking pipeline optimized for tracking such movies. EllipTrack first implements a global track-linking algorithm to construct tracks that maximize the probability of cell lineages. Tracking mistakes are then corrected with a local track-correction module in which tracks generated by the global algorithm are systematically examined and amended if a more probable alternative can be found. Through benchmarking, we show that EllipTrack outperforms state-of-the-art cell trackers and generates nearly error-free cell lineages for multiple large-scale movies. In addition, EllipTrack can adapt to time- and cell-density-dependent changes in cell migration speeds and requires minimal training datasets. EllipTrack is available at https://github.com/tianchengzhe/EllipTrack., Competing Interests: Declaration of Interests The authors declare no completing interests., (Copyright © 2020 The Author(s). Published by Elsevier Inc. All rights reserved.)

The foot arch index is an important index to evaluate the health of human feet and the biomechanics line, aiming at addressing the shortcomings of the low efficiency and slow speed of manual foot arch index measurement; in this work, an automatic foot arch index measurement method based on a flexible membrane pressure sensor was proposed. The distribution of plantar pressure data was obtained from the flexible membrane pressure sensor and converted into a digital image. The 8-neighborhood correlation pixel method was proposed to remove the interference of isolated noise points. In order to remove the toes' data without affecting the foot sole data, the row element association algorithm was proposed. The front and back endpoints of the foot were automatically located to obtain the foot length, and the foot arch index was also automatically obtained based on the foot arch pressure area. Whether it was a high arch foot, flat foot or normal foot, the method proposed in this paper could accurately and quickly distinguish them. The prototype was developed, and its feasibility and validity were verified by a series of tests.

In real world scenarios, the task of estimating heart rate (HR) using video plethysmography (VPG) methods is difficult because many factors could contaminate the pulse signal (i.e., a subjects' movement, illumination changes). This article presents the evaluation of a VPG system designed for continuous monitoring of the user's heart rate during typical human-computer interaction scenarios. The impact of human activities while working at the computer (i.e., reading and writing text, playing a game) on the accuracy of HR VPG measurements was examined. Three commonly used signal extraction methods were evaluated: green (G), green-red difference (GRD), blind source separation (ICA). A new method based on an excess green (ExG) image representation was proposed. Three algorithms for estimating pulse rate were used: power spectral density (PSD), autoregressive modeling (AR) and time domain analysis (TIME). In summary, depending on the scenario being studied, different combinations of signal extraction methods and the pulse estimation algorithm ensure optimal heart rate detection results. The best results were obtained for the ICA method: average RMSE = 6.1 bpm (beats per minute). The proposed ExG signal representation outperforms other methods except ICA ( RMSE = 11.2 bpm compared to 14.4 bpm for G and 13.0 bmp for GRD). ExG also is the best method in terms of proposed success rate metric ( sRate ).

Imaging sensors are largely employed in the food processing industry for quality control. Flour from malting barley varieties is a valuable ingredient in the food industry, but its use is restricted due to quality aspects such as color variations and the presence of husk fragments. On the other hand, naked varieties present superior quality with better visual appearance and nutritional composition for human consumption. Computer Vision Systems (CVS) can provide an automatic and precise classification of samples, but identification of grain and flour characteristics require more specialized methods. In this paper, we propose CVS combined with the Spatial Pyramid Partition ensemble (SPPe) technique to distinguish between naked and malting types of twenty-two flour varieties using image features and machine learning. SPPe leverages the analysis of patterns from different spatial regions, providing more reliable classification. Support Vector Machine (SVM), k-Nearest Neighbors (k-NN), J48 decision tree, and Random Forest (RF) were compared for samples' classification. Machine learning algorithms embedded in the CVS were induced based on 55 image features. The results ranged from 75.00% (k-NN) to 100.00% (J48) accuracy, showing that sample assessment by CVS with SPPe was highly accurate, representing a potential technique for automatic barley flour classification.

Biological samples are radiation-sensitive and require imaging under low-dose conditions to minimize damage. As a result, images contain a high level of noise and exhibit signal-to-noise ratios that are typically significantly smaller than 1. Averaging techniques, either implicit or explicit, are used to overcome the limitations imposed by the high level of noise. Averaging of 2D images showing the same molecule in the same orientation results in highly significant projections. A high-resolution structure can be obtained by combining the information from many single-particle images to determine a 3D structure. Similarly, averaging of multiple copies of macromolecular assembly subvolumes extracted from tomographic reconstructions can lead to a virtually noise-free high-resolution structure. Cross-correlation methods are often used in the alignment and classification steps of averaging processes for both 2D images and 3D volumes. However, the high noise level can bias alignment and certain classification results. While other approaches may be implicitly affected, sensitivity to noise is most apparent in multireference alignments, 3D reference-based projection alignments and projection-based volume alignments. Here, the influence of the image signal-to-noise ratio on the value of the cross-correlation coefficient is analyzed and a method for compensating for this effect is provided., (open access.)

In single-particle analysis (SPA), the aim is to obtain a 3D reconstruction of a biological molecule from 2D electron micrographs to the highest level of detail or resolution as possible. Current practice is to collect large volumes of data, hoping to reach high-resolution maps through sheer numbers. However, adding more particles from a specific data set eventually leads to diminishing improvements in resolution. Understanding what these resolution limits are and how to deal with them are important in optimization and automation of SPA. This study revisits the theory of 3D reconstruction and demonstrates how the associated statistics can provide a diagnostic tool to improve SPA. Small numbers of images already give sufficient information on micrograph quality and the amount of data required to reach high resolution. Such feedback allows the microscopist to improve sample-preparation and imaging parameters before committing to extensive data collection. Once a larger data set is available, a B factor can be determined describing the suppression of the signal owing to one or more causes, such as specimen movement, radiation damage, alignment inaccuracy and structural variation. Insight into the causes of signal suppression can then guide the user to consider appropriate actions to obtain better reconstructions.

Single molecule localization microscopy is currently revolutionizing the life sciences as it offers, for the first time, insights into the organization of biological samples below the classical diffraction limit of light microscopy. While there have been numerous examples of new biological findings reported in the last decade, the technique could not reach its full potential due to a set of limitations immanent to the samples themselves. Particularly, high background signals impede the proper performance of most single-molecule identification and localization algorithms. One option is to exploit the characteristic blinking of single molecule signals, which differs substantially from the residual brightness fluctuations of the fluorescence background. To pronounce single molecule signals, we used a temporal high-pass filtering in Fourier space on a pixel-by-pixel basis. We evaluated the performance of temporal filtering by assessing statistical parameters such as true positive rate and false discovery rate. For this, ground truth signals were generated by simulations and overlaid onto experimentally derived movies of samples with high background signals. Compared to the nonfiltered case, we found an improvement of the sensitivity by up to a factor 3.5 while no significant change in the localization accuracy was observable.

Measuring the volume of bird eggs is a very important task for the poultry industry and ornithological research due to the high revenue generated by the industry. In this paper, we describe a prototype of a new metrological system comprising a 3D range camera, Microsoft Kinect (Version 2) and a point cloud post-processing algorithm for the estimation of the egg volume. The system calculates the egg volume directly from the egg shape parameters estimated from the least-squares method in which the point clouds of eggs captured by the Kinect are fitted to novel geometric models of an egg in a 3D space. Using the models, the shape parameters of an egg are estimated along with the egg's position and orientation simultaneously under the least-squares criterion. Four sets of experiments were performed to verify the functionality and the performance of the system, while volumes estimated from the conventional water displacement method and the point cloud captured by a survey-grade laser scanner serve as references. The results suggest that the method is straightforward, feasible and reliable with an average egg volume estimation accuracy 93.3% when compared to the reference volumes. As a prototype, the software part of the system was implemented in a post-processing mode. However, as the proposed processing techniques is computationally efficient, the prototype can be readily transformed into a real-time egg volume system.

The use of hyperspectral imaging (HSI) in the medical field is an emerging approach to assist physicians in diagnostic or surgical guidance tasks. However, HSI data processing involves very high computational requirements due to the huge amount of information captured by the sensors. One of the stages with higher computational load is the K-Nearest Neighbors (KNN) filtering algorithm. The main goal of this study is to optimize and parallelize the KNN algorithm by exploiting the GPU technology to obtain real-time processing during brain cancer surgical procedures. This parallel version of the KNN performs the neighbor filtering of a classification map (obtained from a supervised classifier), evaluating the different classes simultaneously. The undertaken optimizations and the computational capabilities of the GPU device throw a speedup up to 66.18× when compared to a sequential implementation.

Background: The performance of Computer Aided Diagnosis Systems for early melanoma detection relies mainly on quantitative evaluation of the geometric features corresponding to skin lesions. In these systems, diagnosis is carried out by analyzing four geometric characteristics: asymmetry (A), border (B), color (C) and dimension (D). The main objective of this study is to establish an algorithm for the measurement of asymmetry in biological entities., Methods: Binary digital images corresponding to lesions are divided into 8 segments from their centroid. For each segment, the discrete compactness value is calculated using Normalized E-Factor (NEF). The asymmetry value is obtained from the sum of the square difference of each NEF value and corresponding value of its opposite by the vertex. Two public skin cancer databases were used. 1) Lee's database with 40 digital regions evaluated by fourteen dermatologists. 2) The PH 2 database which consists of 200 images in an 8-bit RGB format. This database provides a pre-classification of asymmetry carried out by experts, and it also indicates if the lesion is a melanoma., Results: The measure was applied using two skin lesion image databases. 1) In Lee's database, Spearman test provided a value of 0.82 between diagnosis of dermatologists and asymmetry values. For the 12 binary images most likely to be melanoma, the correlation between the measurement and dermatologists was 0.98. 2) In the PH 2 database a label is provided for each binary image where the type of asymmetry is indicated. Class 0-1 corresponds to symmetry and one axis of symmetry shapes, the completely asymmetrical were assigned to Class 2, the values of sensitivity and specificity were 59.62 and 85.8% respectively between the asymmetry measured by a group of dermatologists and the proposed algorithm., Conclusions: Simple image digital features such as compactness can be used to quantify the asymmetry of a skin lesion using its digital binary image representation. This measure is stable taking into account translations, rotations, scale changes and can be applied to non-convex regions, including areas with holes.