Search

This paper presents a system that utilizes vision transformers and multimodal feedback modules to facilitate navigation and collision avoidance for the visually impaired. By implementing vision transformers, the system achieves accurate object detection, enabling the real-time identification of objects in front of the user. Semantic segmentation and the algorithms developed in this work provide a means to generate a trajectory vector of all identified objects from the vision transformer and to detect objects that are likely to intersect with the user’s walking path. Audio and vibrotactile feedback modules are integrated to convey collision warning through multimodal feedback. The dataset used to create the model was captured from both indoor and outdoor settings under different weather conditions at different times across multiple days, resulting in 27,867 photos consisting of 24 different classes. Classification results showed good performance (95% accuracy), supporting the efficacy and reliability of the proposed model. The design and control methods of the multimodal feedback modules for collision warning are also presented, while the experimental validation concerning their usability and efficiency stands as an upcoming endeavor. The demonstrated performance of the vision transformer and the presented algorithms in conjunction with the multimodal feedback modules show promising prospects of its feasibility and applicability for the navigation assistance of individuals with vision impairment.

Electroencephalography (EEG) signals have diverse applications in brain-computer interfaces (BCIs), neurological condition diagnoses, and emotion recognition across healthcare, education, and entertainment domains. This paper presents a robust method that leverages Riemannian geometry to enhance the accuracy of EEG-based emotion classification. The proposed approach involves adaptive feature extraction using principal component analysis (PCA) in the Euclidean space to capture relevant signal characteristics and improve classification performance. Covariance matrices are derived from the extracted features and projected onto the Riemannian manifold. Emotion classification is performed using the minimum distance to Riemannian mean (MDRM) classifier. The effectiveness of the method was evaluated through experiments on four datasets, DEAP, DREAMER, MAHNOB, and SEED, demonstrating its generalizability and consistent accuracy improvement across different scenarios. The classification accuracy and robustness were compared with several state-of-the-art classification methods, which supports the validity and efficacy of using Riemannian geometry for enhancing the accuracy of EEG-based emotion classification.

Accurate and robust human immune system assessment through white blood cell evaluation require computer-aided tools with pathologist-level accuracy. This work presents a multi-attention leukocytes subtype classification method by leveraging fine-grained and spatial locality attributes of white blood cell. The proposed framework comprises three main components: texture-aware/attention map generation blocks, attention regularization, and attention-based data augmentation. The developed framework is applicable to general CNN-based architectures and enhances decision making by paying specific attention to the discriminative regions of a white blood cell. The performance of the proposed method/model was evaluated through an extensive set of experiments and validation. The obtained results demonstrate the superior performance of the model achieving 99.69 % accuracy compared to other state-of-the-art approaches. The proposed model is a good alternative and complementary to existing computer diagnosis tools to assist pathologists in evaluating white blood cells from blood smear images.