Search

This report documents the program and the outcomes of Dagstuhl Seminar 23031 "Frontiers of Information Access Experimentation for Research and Education", which brought together 38 participants from 12 countries. The seminar addressed technology-enhanced information access (information retrieval, recommender systems, natural language processing) and specifically focused on developing more responsible experimental practices leading to more valid results, both for research as well as for scientific education. The seminar featured a series of long and short talks delivered by participants, who helped in setting a common ground and in letting emerge topics of interest to be explored as the main output of the seminar. This led to the definition of five groups which investigated challenges, opportunities, and next steps in the following areas: reality check, i.e. conducting real-world studies, human-machine-collaborative relevance judgment frameworks, overcoming methodological challenges in information retrieval and recommender systems through awareness and education, results-blind reviewing, and guidance for authors. Date: 15--20 January 2023. Website: https://www.dagstuhl.de/23031. [ABSTRACT FROM AUTHOR]

This is a report on the NTCIR-16 conference held online in June 2022. NTCIR is a series of parallel and collective evaluation efforts designed to enhance research on diverse information access technologies, including, but not limited to, cross-language and multimedia information access, question-answering, text mining, and summarization. 53 active research groups from 20 countries/regions participated in one or more of the 10 different tasks in NTCIR-16. This report introduces the highlights of the conference and describes the scope and task designs of 10 tasks organized at NTCIR-16. Date: 14--17 June, 2022. Website: https://research.nii.ac.jp/ntcir/ntcir-16/. [ABSTRACT FROM AUTHOR]

This is a report on the NTCIR-15 conference held online in December 2020. NTCIR is a sesquiannual research project designed to evaluate various information access technologies, including information retrieval, information recommendation, question answering, natural language processing, etc. 55 active research groups from 22 countries\regions have participated in one or more of the seven tasks in NTCIR-15. This report introduces the highlights of the conference, describes the scope and task designs of the seven tasks organized at NTCIR-15. Date: 8--11 December, 2020. Website: http://research.nii.ac.jp/ntcir/ntcir-15/. [ABSTRACT FROM AUTHOR]

This is a report on the NTCIR-13 conference held in December 2017, in Tokyo, Japan. NTCIR is a series of parallel and collective evaluation efforts designed to enhance research on diverse information access technologies, including, but not limited to, cross-language and multimedia information access, question-answering, text mining and summarization, with an emphasis on East Asian languages such as Chinese, Korean, and Japanese, as well as English. 105 different research groups from 20 countries/regions participated in one or more of the nine different tasks in NTCIR-13, to compete and collaborate on a common ground and thereby advance the state of the art. This report introduces the highlights of the conference, describes the scope and task designs of nine tasks organized at NTCIR-13, and provides a brief introduction to NTCIR-14, which started from January 2018 and will be closed in June 2019, which will be the 20th anniversary since the first NTCIR Conference in the summer of 1999. [ABSTRACT FROM AUTHOR]

Multilingual Information Access (MLIA) is at a turning point wherein substantial real-world applications are being introduced after fifteen years of research into cross-language information retrieval, question answering, statistical machine translation and named entity recognition. Previous workshops on this topic have focused on research and smallscale applications. The focus of this workshop was on technology transfer from research to applications and on what future research needs to be done which facilitates MLIA in an increasingly connected multilingual world. [ABSTRACT FROM AUTHOR]

This workshop attempted to present the state-of-the-art in multilingual information access (MLIA/ research and development, including cross-language information retrieval and question-answering and multilingual, multi-document summarization. Our goal was to delineate current research areas as well as suggest new areas for future research and development. The workshop also focused on practical issues of scalability and practical application of MLIA in digital libraries and web portals. In addition to an invited keynote, 17 research and position papers were selected for the proceedings which may be found at http://ucdata.berkelev.edu/sigir2006-mlia.htm. [ABSTRACT FROM AUTHOR]

The Second International Workshop on Evaluating Information Access (EVIA 2008) held at the National Institute of Informatics, Tokyo, Japan on December 16th, 2008. It was composed of sessions covering various aspects of information access evaluation and featured eleven refereed regular and short papers and two unrefereed "very short" papers. [ABSTRACT FROM AUTHOR]

The first workshop on Evaluating Information Access was held at the National Institute of Informatics, Tokyo, Japan on May 15th, 2007. It was composed of a five invited speakers and two sessions of refereed papers and posters. [ABSTRACT FROM AUTHOR]