Search

Skin cancer is one of the most common cancers worldwide caused by excessive development of skin cells. Considering the rapid growth of the use of deep learning algorithms for skin cancer detection, selecting the optimal algorithm has become crucial to determining the efficiency of computer-aided diagnosis (CAD) systems developed for the healthcare sector. However, a sufficient number of criteria and parameters must be considered when selecting an ideal deep learning algorithm. A generally accepted method for benchmarking deep learning models for skin cancer classification is unavailable in the current literature. This paper presents a multi-criteria decision-making framework for evaluating and benchmarking deep learning models for skin cancer detection based on hybridisation of entropy and VIseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) methods. Twelve well-known convolution networks are evaluated and tested on eleven publicly available image datasets to achieve the target of the study. Several criteria related to deep convolutional neural networks (CNNs) architectures, including optimisation technique, transfer learning, class balancing, transfer learning, data augmentation, and network complexity, have been considered in the multi-criteria evaluation. The decision matrix (DM) is designed based on a crossover of the five evaluation criteria and twelve (CNNs) classification models on different datasets. Subsequently, in the benchmarking and ranking of deep learning classification models, multi-criteria decision making (MCDM) techniques are used. The MCDM uses a scheme that involves the integration of entropy with VIKOR approaches. For the weight calculations of evaluation criteria, entropy is applied, while VIKOR is used to benchmark and rank the models. The obtained results reveal that the InceptionResNetV2 model gained the first rank and is selected as the optimal architecture for skin cancer detection considering the five criteria investigated in our study. The presented framework achieves a significant performance in selecting the best algorithm, which could provide substantial guidance to the researcher working in the field. [ABSTRACT FROM AUTHOR]

Simple Summary: Melanoma is the most dangerous type of skin cancer. It grows quickly and has the ability to spread to any organ. This study aims to evaluate and benchmark deep learning models for automatic melanoma diagnosis considering nineteen convolutional neural networks and ten criteria. Multi-Criteria Decision Making methods (MCDMs) are exploited to conduct the benchmarking and subsequently selecting the optimal model considering the predefined criteria. The study findings would help in the model selection, designing quick and reliable diagnostic tools based on image data, and contributing to the development of more accurate and efficient point-of-care diagnostic and detection systems. Melanoma is the most invasive skin cancer with the highest risk of death. While it is a serious skin cancer, it is highly curable if detected early. Melanoma diagnosis is difficult, even for experienced dermatologists, due to the wide range of morphologies in skin lesions. Given the rapid development of deep learning algorithms for melanoma diagnosis, it is crucial to validate and benchmark these models, which is the main challenge of this work. This research presents a new benchmarking and selection approach based on the multi-criteria analysis method (MCDM), which integrates entropy and the preference ranking organization method for enrichment of evaluations (PROMETHEE) methods. The experimental study is carried out in four phases. Firstly, 19 convolution neural networks (CNNs) are trained and evaluated on a public dataset of 991 dermoscopic images. Secondly, to obtain the decision matrix, 10 criteria, including accuracy, classification error, precision, sensitivity, specificity, F1-score, false-positive rate, false-negative rate, Matthews correlation coefficient (MCC), and the number of parameters are established. Third, entropy and PROMETHEE methods are integrated to determine the weights of criteria and rank the models. Fourth, the proposed benchmarking framework is validated using the VIKOR method. The obtained results reveal that the ResNet101 model is selected as the optimal diagnosis model for melanoma in our case study data. Thus, the presented benchmarking framework is proven to be useful at exposing the optimal melanoma diagnosis model targeting to ease the selection process of the proper convolutional neural network architecture. [ABSTRACT FROM AUTHOR]