Detecting Skin Reactions in Epicutaneous Patch Testing with Deep Learning: An Evaluation of Pre-Processing and Modality Performance

Epicutaneous patch testing is a well-established diagnostic method for identifying substances that may cause Allergic Contact Dermatitis (ACD), a common skin condition caused by exposure to environmental allergens. While the patch test remains the gold standard for identifying allergens, it is prone to observer bias and consumes valuable human resources. Deep learning models can be employed to address this challenge. In this study, we collected a dataset of 1579 multi-modal skin images from 200 patients using the Antera 3D® camera. We then investigated the feasibility of using a deep learning classifier for automating the identification of the allergens causing ACD. We propose a deep learning approach that utilizes a context-retaining pre-processing technique to improve the accuracy of the classifier. In addition, we find promise in the combination of the color image and false-color map of hemoglobin concentration to improve diagnostic accuracy. Our results showed that this approach can potentially achieve more than 86% recall and 94% specificity in identifying skin reactions, and contribute to faster and more accurate diagnosis while reducing clinician workload.