Overview of the CLEF-2023 CheckThat! Lab: Task 2 on Subjectivity in News Articles Notebook for the CheckThat! Lab at CLEF 2023

24th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF-WN 2023 -- 18 September 2023 through 21 September 2023 -- 193170
We describe the outcome of the 2023 edition of the CheckThat!Lab at CLEF. We focus on subjectivity (Task 2), which has been proposed for the first time. It aims at fostering the technology for the identification of subjective text fragments in news articles. For that, we produced corpora consisting of 9,530 manually-annotated sentences, covering six languages —Arabic, Dutch, English, German, Italian, and Turkish. Task 2 attracted 12 teams, which submitted a total of 40 final runs covering all languages. The most successful approaches addressed the task using state-of-the-art multilingual transformer models, which were fine-tuned on language-specific data. Teams also experimented with a rich set of other neural architectures, including foundation models, zero-shot classifiers, and standard transformers, mainly coupled with data augmentation and multilingual training strategies to address class imbalance. We publicly release all the datasets and evaluation scripts, with the purpose of promoting further research on this topic. © 2023 Copyright for this paper by its authors.
PE00000013, PNRR-M4C2-Investimento 1.3; Qatar Foundation, QF; Qatar National Research Fund, QNRF; Bundesministerium für Bildung und Forschung, BMBF: 01FP20031J; Türkiye Bilimsel ve Teknolojik Araştırma Kurumu, TÜBİTAK: 120E514; Università di Bologna, UNIBO: 2021-15854, DOT1303118, NPRP 14C-0916-210015, NPRP13S-0206-200281