1. Cluster analysis of urdu tweets
- Author
-
Zarmeen Nasim and Sajjad Haider
- Subjects
Topic model ,General Computer Science ,Computer science ,business.industry ,020206 networking & telecommunications ,02 engineering and technology ,Document clustering ,computer.software_genre ,language.human_language ,Task (project management) ,Resource (project management) ,0202 electrical engineering, electronic engineering, information engineering ,language ,Affinity propagation ,020201 artificial intelligence & image processing ,Urdu ,Artificial intelligence ,Cluster analysis ,business ,computer ,Sentence ,Natural language processing - Abstract
Document clustering allows a user to group semantically similar documents. It has been an interesting research area for the past many years and various methods and techniques have been developed. However, the research has primarily been limited to English and other high resource languages. For low-resource languages, such as Urdu, the area of document clustering is open to contributions. This work presents an experimental evaluation of clustering techniques on Urdu tweets. It is a challenging task to semantically cluster tweets due to their very short length. In this paper, various features, including sentence and phrase-level embeddings, TF-IDF features and document embeddings are extracted from tweets and clustering is performed using three different algorithms: K-Means, Bisecting K-Means, and Affinity Propagation algorithms. Furthermore, a comparison is performed with the traditional topic modeling approach. The results indicate that the TF-IDF features combined with the K-means clustering algorithm outperformed the adopted clustering techniques.
- Published
- 2022