Back to Search Start Over

Improving information retrieval through correspondence analysis instead of latent semantic analysis

Authors :
Qi, Qianqian
Hessen, Dave
Van der Heijden, P.G.M.
Qi, Qianqian
Hessen, Dave
Van der Heijden, P.G.M.
Source :
Journal of Intelligent Information Systems vol.62 (2024) nr.1 p.209–230 [ISSN 0925-9902]
Publication Year :
2024

Abstract

The initial dimensions extracted by latent semantic analysis (LSA) of a document-term matrix have been shown to mainly display marginal effects, which are irrelevant for information retrieval. To improve the performance of LSA, usually the elements of the raw document-term matrix are weighted and the weighting exponent of singular values can be adjusted. An alternative information retrieval technique that ignores the marginal effects is correspondence analysis (CA). In this paper, the information retrieval performance of LSA and CA is empirically compared. Moreover, it is explored whether the two weightings also improve the performance of CA. The results for four empirical datasets show that CA always performs better than LSA. Weighting the elements of the raw data matrix can improve CA; however, it is data dependent and the improvement is small. Adjusting the singular value weighting exponent often improves the performance of CA; however, the extent of the improvement depends on the dataset and the number of dimensions.

Details

Database :
OAIster
Journal :
Journal of Intelligent Information Systems vol.62 (2024) nr.1 p.209–230 [ISSN 0925-9902]
Notes :
DOI: 10.1007/s10844-023-00815-y, English
Publication Type :
Electronic Resource
Accession number :
edsoai.on1445830334
Document Type :
Electronic Resource