Search

Zero-shot learning represents a formidable paradigm in machine learning, wherein the crux lies in distilling and generalizing knowledge from observed classes to novel ones. The objective is to identify unfamiliar objects that were not included in the model's training, leveraging learned patterns and knowledge from previously encountered categories. As a crucial subtask of open-world object detection, zero-shot classification can also provide insights and solutions for this field. Despite its potential, current zero-shot classification models often suffer from a performance gap due to limited transfer ability and discriminative capability of learned representations. In pursuit of advancing the subpar state of zero-shot object classification, this paper introduces a novel model for image classification which can be applied to object detection, namely, self-distillation and k-nearest neighbor-based zero-shot classification method. First, we employ a diffusion detector to identify potential objects in images. Then, self-distillation and distance-based classifiers are used for distinguishing unseen objects from seen classes. The k-nearest neighbor-based cluster heads are designed to cluster the unseen objects. Extensive experiments and visualizations were conducted on publicly available datasets on the efficacy of the proposed approach. Precisely, our model demonstrates performance improvement of over 20% compared to contrastive clustering. Moreover, it achieves a precision of 0.910 and a recall of 0.842 on CIFAR-10 datasets, a precision of 0.737, and a recall of 0.688 on CIFAR-100 datasets for the macro average. Compared to a more recent model (SGFR), our model realized improvements of 10.9%, 13.3%, and 7.8% in Sacc, Uacc, and H metrics, respectively. This study aims to introduce fresh ideas into the domain of zero-shot image classification, and it can be applied to open-world object detection tasks. Our code is available at https://www.github.com/CmosWolf1/Code_implementation_for_paper_SKZC. [ABSTRACT FROM AUTHOR]

Quantification of all types of uncertainty helps to establish reliability in any analysis. This research focuses on uncertainty in two attribute levels of wetland classification and creates visualization tools to guide analysis of spatial uncertainty patterns over several scales. A novel variant of confusion matrix analysis compares the Cowardin and Hydrogeomorphic wetland classification systems, identifying areas and types of misclassification for binary and multivariate categories. The specific focus on uncertainty in the paper refers to categorical consistency, that is, agreement between the two classification systems, rather than comparing observed data to ground truth. Consistency is quantified using confusion matrix analysis. Aggregation across progressive focal windows transforms the confusion matrix into a multiscale data pyramid for quick determination of where attribute uncertainty is highly variant, and at what spatial resolutions classification inconsistencies emerge. The focal pyramids summarize precision, recall, and F1 scores to visualize classification differences across spatial scales. Findings show that the F1 scores appear most informative on agreement about wetlands misclassification at both coarse and fine attribute scales. The pyramid organizes multi-scale uncertainty in a single unified framework and can be "sliced" to view individual focal levels of attribute consistency. Results demonstrate how the confusion matrix can be used to quantify the percentage of a study area in which inconsistencies occur reflecting wetland presence and type. The research provides confusion metrics and display tools to focus attention on specific areas of large data sets where attribute uncertainty patterns may be complex, thus reducing land managers' workloads by highlighting areas of uncertainty where field checking might be appropriate, and improving analytics by providing visualization tools to quickly see where such areas occur. [ABSTRACT FROM AUTHOR]

Ransomware is a type of malicious software that encrypts a victim's files and demands payment in exchange for the decryption key. It is a rapidly growing and evolving threat that has caused significant damage and disruption to individuals and organizations around the world. In this paper, we propose a comprehensive ransomware classification approach based on the comparison of similarity matrices derived from static, dynamic analysis, and visualization. Our approach involves the use of multiple analysis techniques to extract features from ransomware samples and to generate similarity matrices based on these features. These matrices are then compared using a variety of comparison algorithms to identify similarities and differences between the samples. The resulting similarity scores are then used to classify the samples into different categories, such as families, variants, and versions. We evaluate our approach using a dataset of ransomware samples and demonstrate that it can accurately classify the samples with a high degree of accuracy. One advantage of our approach is the use of visualization, which allows us to classify and cluster large datasets of ransomware in a more intuitive and effective way. In addition, static analysis has the advantage of being fast and accurate, while dynamic analysis allows us to classify and cluster packed ransomware samples. We also compare our approach to other classification approaches based on single analysis techniques and show that our approach outperforms these approaches in terms of classification accuracy. Overall, our study demonstrates the potential of using a comprehensive approach based on the comparison of multiple analysis techniques, including static analysis, dynamic analysis, and visualization, for the accurate and efficient classification of ransomware. It also highlights the importance of considering multiple analysis techniques in the development of effective ransomware classification methods, especially when dealing with large datasets and packed samples. [ABSTRACT FROM AUTHOR]

Twitter produces a massive amount of data due to its popularity that is one of the reasons underlying big data problems. One of those problems is the classification of tweets due to use of sophisticated and complex language, which makes the current tools insufficient. We present our framework HTwitt, built on top of the Hadoop ecosystem, which consists of a MapReduce algorithm and a set of machine learning techniques embedded within a big data analytics platform to efficiently address the following problems: (1) traditional data processing techniques are inadequate to handle big data; (2) data preprocessing needs substantial manual effort; (3) domain knowledge is required before the classification; (4) semantic explanation is ignored. In this work, these challenges are overcome by using different algorithms combined with a Naïve Bayes classifier to ensure reliability and highly precise recommendations in virtualization and cloud environments. These features make HTwitt different from others in terms of having an effective and practical design for text classification in big data analytics. The main contribution of the paper is to propose a framework for building landslide early warning systems by pinpointing useful tweets and visualizing them along with the processed information. We demonstrate the results of the experiments which quantify the levels of overfitting in the training stage of the model using different sizes of real-world datasets in machine learning phases. Our results demonstrate that the proposed system provides high-quality results with a score of nearly 95% and meets the requirement of a Hadoop-based classification system. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Computer Engineering & Applications is the property of Beijing Journal of Computer Engineering & Applications Journal Co Ltd. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Crime prediction is an effort to cut down the crime rate and criminal activities in the society. This paper concentrates on monitoring the crime trends in India using data from 2001 to 2019. The work analyzes the crime condition in India by following a top-to bottom approach and implementing visualization and machine learning algorithms. Heat map visualization of India is done to focus on specific crime types for all states. Furthermore, various demography of human population like age-groups, sex, caste, etc., are considered to have a larger perspective of the issue. The model also suggest proactive measures based on these findings. [ABSTRACT FROM AUTHOR]

Glaucoma is a progressive eye condition that can lead to permanent vision loss. Therefore, on-time detection of glaucoma is critical for making an effective treatment plan. In recent years, enormous attempts have been made to develop automated glaucoma classification systems using CNNs through images. In contrast, limited methods have been proposed for diagnosing different glaucoma stages. It is mainly owing to the lack of large publicly available labeled datasets. Also, fundus images exhibit a high inter-stage resemblance, redundant features and minute size variations of lesions, making the conventional CNNs difficult to classify multiple stages of glaucoma accurately. To address these challenges, this paper proposes a novel adapter and enhanced self-attention based CNN framework named AES-Net for effective classification of glaucoma stages. In particular, we propose a spatial adapter module on top of the backbone network for learning better feature representations and an enhanced self-attention module (ESAM) to capture global feature correlations among the relevant channels and spatial positions. The ESAM assists in capturing stage-specific and detailed-lesion features from the fundus images. Extensive experiments on two multi-stage glaucoma datasets indicate that our AES-Net surpasses CNN-based existing approaches. The Grad-CAM ++ visualization maps further confirm the effectiveness of our AES-Net. • A spatial adapter and enhanced self-attention based CNN, AES-Net, is proposed. • An enhanced self-attention module is proposed to learn class-specific features. • A comparative analysis with state-of-the-art attention mechanisms is performed. • Results on two datasets indicate the effectiveness of AES-Net over current methods. • The visualization results demonstrate the explainability and interpretability of the model. [ABSTRACT FROM AUTHOR]

This paper investigates the enhanced potential of using multi-frequency PolInSAR data for land cover classification. In order to enable a descriptive analysis that goes beyond the mere comparison of classification accuracies, a two-step classification process is applied. First, polarimetric and interferometric features are extracted and projected into a 3-dimensional feature space by using the supervised dimension reduction algorithm Uniform Manifold Approximation and Projection (UMAP). Subsequently, based on the expressive 3-dimensional representation a simple yet sufficient k-nearest neighbors (KNN) classifier is applied to assign a land cover class to each pixel. In this way, besides the simplified classification, the visualization of the underlying data structure is possible and contributes to a better explanation and analysis of classification results. The data analyzed in this way are airborne L- and S-band PolInSAR data acquired by the F-SAR system. The visual analysis of reduced feature spaces as well as the quantitative analysis of classification results reveal the benefits of combining both frequencies with regard to class separability. [ABSTRACT FROM AUTHOR]

Constructing adversarial examples in a black-box threat model injures the original images by introducing visual distortion. In this paper, we propose a novel black-box attack approach that can directly minimize the induced distortion by learning the noise distribution of the adversarial example, assuming only loss-oracle access to the black-box network. To quantify visual distortion, the perceptual distance between the adversarial example and the original image, is introduced in our loss. We first approximate the gradient of the corresponding non-differentiable loss function by sampling noise from the learned noise distribution. Then the distribution is updated using the estimated gradient to reduce visual distortion. The learning continues until an adversarial example is found. We validate the effectiveness of our attack on ImageNet. Our attack results in much lower distortion when compared to the state-of-the-art black-box attacks and achieves 100% success rate on InceptionV3, ResNet50 and VGG16bn. Furthermore, we theoretically prove the convergence of our model. The code is publicly available at https://github.com/Alina-1997/visual-distortion-in-attack. [ABSTRACT FROM AUTHOR]

The main objective of this study is a graphical display of the results of the high (as well as the low) dimensional multi-class support vector machine classification. Additionally, we will visually be able to detect the outliers and misclassified observations by using this graphical tool. The "outlier map" as a successful graphical outlier detection tool of robust statistics is extended in this paper. In fact, this is a bilateral extension concerning the misclassified and outlying observations recognition. The most important feature of this extension is creating two types of discriminative boundaries to segregate the data and detect the outlying observations. For this purpose, we employed the simple but efficient concept of the "confidence interval", which is computed for the mean of decision function of support vector machine and then, "thresholding" technique. After that, the efficiency of the outlier map in terms of the preciseness of the correct outlier identification has been tested by the classification accuracy. Moreover, we deployed the margin width "before" and "after" outlier detection as the other criterion to assess the preciseness of the correct outlier identification. We conducted an empirical study based on the proposed method on the simulated and several well-known real datasets. It shows the effectiveness of our proposed method by increasing the "margin width" and gaining a higher classification accuracy. [ABSTRACT FROM AUTHOR]

Image editing technology leads to tampering traces hidden in images hard to be identified, which results in great challenges for image manipulation detection. Therefore, it is necessary to enhance the characteristic response of tampering traces. In this paper, a two-stream network is exploited to extract tampering features from both semantic level and noise level through end-to-end training. At the input end of the network, a multi-scale high-frequency constrained convolution kernel module is proposed to extract multi-channel and multi-scale noise fingerprint information, which enhances the tampering traces. Moreover, we leverage multi-task learning to realize the classification of tampering techniques, the detection and segmentation of tampering regions. The tampered segmentation mask attention is introduced as a novel constraint to be fed back to the detection branch, which further enhances the tampering characteristics and improves the detection performance. Experiments on COVER, CASIA and NIST16 datasets prove that the proposed framework outperforms existing methods quantitatively and qualitatively. The proposed method effectively enhances the characteristics of tampered regions. Moreover, the proposed method has high robustness on JPEG recompression and image resize. • We proposed a multi-scale high-frequency constrained convolution kernel module to extract fingerprint noise information end-to-end, which exploits the domain knowledge of camera model identification. The module expands the receptive field and highlights the contrast of tampering traces at different scales and different channels, which emphasizes the characteristic representation of the tampering traces. • The segmentation mask attention is introduced as a novel constraint to be fed back to the detection branch. The network is forced to pay more attention to the tampered area and enhances the tampering characteristics. The visualization results show that segmentation features can focus on the tampered areas. • The tasks of classification, detection and segmentation are combined as multi-task learning, sharing the characteristics of different tasks to form constraints. The detection performance is further improved. • Extensive experiments on three standard datasets demonstrate that our method outperforms other methods significantly. Moreover, the proposed method has high robustness on JPEG recompression and image resize. [ABSTRACT FROM AUTHOR]