Search

With the popularity of social networks, short text clustering has become a more and more important task that is widely used. Short text clustering is a challenging problem because social network short texts are characterized by irregular words, a lot of noise, and sparse features. We propose a Short Text Clustering enhanced by Semantic Matching Model (abbr. to STCSMM). The STCSMM method applies the knowledge of the tagged text similarity task dataset to the short text clustering through the semantic matching model, thereby improving the effect of short text clustering. First, we train a semantic matching network on the data set of the text similarity task, where the network contains the feature extraction layer and the vector distance calculation layer. Then, we use the learned feature extraction layer to extract short text feature and use the vector distance calculation layer replaces the commonly used distance metrics in the traditional K-means algorithm, such as cosine distance, Euclidean distance and so on. Finally, the text features obtained by feature extraction layer are applied to K-means based on vector distance calculation layer. This improved K-means clustering (STCSMM) has better performance on the microblog text clustering dataset than some existing methods such as K-means clustering with LDA, LSI or average word embedding feature vectors.

Phishing website is becoming a major threat to the information security in Social Network. The attacks not only lessen the users' trust but also influence the benefit of the third party who develops the platform. In order to solve the time lag in phishing website passive detection, this paper proposes a solution to discover phishing website initiatively based on blacklist, in which the anomalies of its URL and WHOIS information are analyzed, and based on this, the heuristic rules that aim to generate suspicious URLs are made. In order to filter out noise sites in the suspicious set, a website filtering solution based on webpages image-layout is presented. We firstly propose a Ray Scan Method to generate the location feature of webpage images quickly, and then, we proposed a method of calculating the webpage layout similarity, which will be compared against the preset threshold to decide whether it will be filtered. The experimental results show that the solution successfully detects some phishing websites out before they are widely spread, and further, the webpage filtering method guarantees both high filtration ratio and high phishing website retention ratio.