Back to Search
Start Over
Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts
- Source :
- Northern European Journal of Language Technology. Volume 1. 2021
- Publication Year :
- 2022
-
Abstract
- In this study we investigate to which degree experts and non-experts agree on questions of difficulty in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to rank multi-word expressions in a crowdsourcing experiment. We find that the resulting rankings by all the three tested groups correlate to a very high degree, which suggests that judgments produced in a comparative setting are not influenced by professional insights into Swedish as a second language.
- Subjects :
- Computer Science - Computation and Language
Subjects
Details
- Database :
- arXiv
- Journal :
- Northern European Journal of Language Technology. Volume 1. 2021
- Publication Type :
- Report
- Accession number :
- edsarx.2206.08724
- Document Type :
- Working Paper
- Full Text :
- https://doi.org/10.3384/nejlt.2000-1533.2021.3128