Search

Deep learning for computer vision can be leveraged for interpreting surgical scenes and providing surgeons with real-time guidance to avoid complications. However, neither generalizability nor scalability of computer-vision-based surgical guidance systems have been demonstrated, especially to geographic locations that lack hardware and infrastructure necessary for real-time inference. We propose a new equipment-agnostic framework for real-time use in operating suites. Using laparoscopic cholecystectomy and semantic segmentation models for predicting safe/dangerous ("Go"/"No-Go") zones of dissection as an example use case, this study aimed to develop and test the performance of a novel data pipeline linked to a web-platform that enables real-time deployment from any edge device. To test this infrastructure and demonstrate its scalability and generalizability, lightweight U-Net and SegFormer models were trained on annotated frames from a large and diverse multicenter dataset from 136 institutions, and then tested on a separate prospectively collected dataset. A web-platform was created to enable real-time inference on any surgical video stream, and performance was tested on and optimized for a range of network speeds. The U-Net and SegFormer models respectively achieved mean Dice scores of 57% and 60%, precision 45% and 53%, and recall 82% and 75% for predicting the Go zone, and mean Dice scores of 76% and 76%, precision 68% and 68%, and recall 92% and 92% for predicting the No-Go zone. After optimization of the client-server interaction over the network, we deliver a prediction stream of at least 60 fps and with a maximum round-trip delay of 70 ms for speeds above 8 Mbps. Clinical deployment of machine learning models for surgical guidance is feasible and cost-effective using a generalizable, scalable and equipment-agnostic framework that lacks dependency on hardware with high computing performance or ultra-fast internet connection speed. [ABSTRACT FROM AUTHOR]

Dementia represents a significant global health challenge, with early screening during the preclinical stage being crucial for effective management. Traditional diagnostic biomarkers for Alzheimer's Disease, the most common form of dementia, are limited by cost and invasiveness. Mild cognitive impairment (MCI), a precursor to dementia, is currently identified through neuropsychological tests like the Montreal Cognitive Assessment (MoCA), which are not suitable for large-scale screening. Eye-tracking technology, capturing and quantifying eye movements related to cognitive behavior, has emerged as a promising tool for cognitive assessment. Subtle changes in eye movements could serve as early indicators of MCI. However, the interpretation of eye-tracking data is challenging. This study introduced a dementia screening tool, VR Eye-tracking Cognitive Assessment (VECA), using eye-tracking technology, machine learning, and virtual reality (VR) to offer a non-invasive, efficient alternative capable of large-scale deployment. VECA was conducted with 201 participants from Shenzhen Baoan Chronic Hospital, utilizing eye-tracking data captured via VR headsets to predict MoCA scores and classify cognitive impairment across different educational backgrounds. The support vector regression model employed demonstrated a high correlation (0.9) with MoCA scores, significantly outperforming baseline models. Furthermore, it established optimal cut-off scores for identifying cognitive impairment with notable sensitivity (88.5%) and specificity (83%). This study underscores VECA's potential as a portable, efficient tool for early dementia screening, highlighting the benefits of integrating eye-tracking technology, machine learning, and VR in cognitive health assessments. [ABSTRACT FROM AUTHOR]