Search

Your search keyword '"Kando, Noriko"' showing total 160 results
Start Over Author "Kando, Noriko" Publication Year Range Last 10 years

Refine your results

more »

more »

more »

more »
160 results on '"Kando, Noriko"'

2. Perspectives on Large Language Models for Relevance Judgment

Author

Faggioli, Guglielmo, Dietz, Laura, Clarke, Charles, Demartini, Gianluca, Hagen, Matthias, Hauff, Claudia, Kando, Noriko, Kanoulas, Evangelos, Potthast, Martin, Stein, Benno, and Wachsmuth, Henning

Subjects
Computer Science - Information Retrieval, Computer Science - Computers and Society, H.3.3
Abstract

When asked, large language models (LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in evaluations of retrieval systems. In this perspectives paper, we discuss possible ways for LLMs to support relevance judgments along with concerns and issues that arise. We devise a human--machine collaboration spectrum that allows to categorize different relevance judgment strategies, based on how much humans rely on machines. For the extreme point of "fully automated judgments", we further include a pilot experiment on whether LLM-based relevance judgments correlate with judgments from trained human assessors. We conclude the paper by providing opposing perspectives for and against the use of~LLMs for automatic relevance judgments, and a compromise perspective, informed by our analyses of the literature, our preliminary experimental evidence, and our experience as IR researchers.

Published
2023
Full Text
View/download PDF

3. Personalized Treasure Hunt Game for Proactive Museum Appreciation by Analyzing Guide App Operation Log

Author

Yu, Jinsong, Takidaira, Shio, Sawaura, Tsukasa, Shoji, Yoshiyuki, Yamamoto, Takehiro, Yamamoto, Yusuke, Ohshima, Hiroaki, Aihara, Kenro, Kando, Noriko, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Goh, Dion H., editor, Chen, Shu-Jiun, editor, and Tuarob, Suppawong, editor

Published
2023
Full Text
View/download PDF

4. Who Determines What Is Relevant? Humans or AI? Why Not Both?

Author

Faggioli, Guglielmo, Dietz, Laura, Clarke, Charles L. A., Demartini, Gianluca, Hagen, Matthias, Hauff, Claudia, Kando, Noriko, Kanoulas, Evangelos, Potthast, Martin, Stein, Benno, and Wachsmuth, Henning

Subjects
HUMAN-artificial intelligence interaction, ARTIFICIAL intelligence, HUMAN-computer interaction, ARTIFICIAL intelligence & society, LANGUAGE models, CHATGPT, CHATBOTS
Abstract

The article offers an opinion regarding how a human-artificial intelligence (AI) collaboration can asses relevance. Topics include the improvements to large language models (LLMs) such as OpenAI's chatbot ChatGPT, the reasons why utilizing only LLMs can be problematic, and how human judgement can improve fairness, efficiency, and effectiveness.

Published
2024
Full Text
View/download PDF

6. Visualization of the Gap Between the Stances of Citizens and City Councilors on Political Issues

Author

Senoo, Ko, Seki, Yohei, Kashino, Wakako, Kando, Noriko, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Tseng, Yuen-Hsien, editor, Katsurai, Marie, editor, and Nguyen, Hoa N., editor

Published
2022
Full Text
View/download PDF

7. Final Report of the NTCIR-14 QA Lab-PoliInfo Task

Author

Kimura, Yasutomo, Shibuki, Hideyuki, Ototake, Hokuto, Uchida, Yuzu, Takamaru, Keiichi, Sakamoto, Kotaro, Ishioroshi, Madoka, Mitamura, Teruko, Kando, Noriko, Mori, Tatsunori, Yuasa, Harumichi, Sekine, Satoshi, Inui, Kentaro, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Woeginger, Gerhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Kato, Makoto P., editor, Liu, Yiqun, editor, Kando, Noriko, editor, and Clarke, Charles L. A., editor

Published
2019
Full Text
View/download PDF

10. Evaluation-as-a-Service: Overview and Outlook

Author

Hanbury, Allan, Müller, Henning, Balog, Krisztian, Brodt, Torben, Cormack, Gordon V., Eggel, Ivan, Gollub, Tim, Hopfgartner, Frank, Kalpathy-Cramer, Jayashree, Kando, Noriko, Krithara, Anastasia, Lin, Jimmy, Mercer, Simon, and Potthast, Martin

Subjects
Computer Science - Computers and Society, Computer Science - Information Retrieval
Abstract

Evaluation in empirical computer science is essential to show progress and assess technologies developed. Several research domains such as information retrieval have long relied on systematic evaluation to measure progress: here, the Cranfield paradigm of creating shared test collections, defining search tasks, and collecting ground truth for these tasks has persisted up until now. In recent years, however, several new challenges have emerged that do not fit this paradigm very well: extremely large data sets, confidential data sets as found in the medical domain, and rapidly changing data sets as often encountered in industry. Also, crowdsourcing has changed the way that industry approaches problem-solving with companies now organizing challenges and handing out monetary awards to incentivize people to work on their challenges, particularly in the field of machine learning. This white paper is based on discussions at a workshop on Evaluation-as-a-Service (EaaS). EaaS is the paradigm of not providing data sets to participants and have them work on the data locally, but keeping the data central and allowing access via Application Programming Interfaces (API), Virtual Machines (VM) or other possibilities to ship executables. The objective of this white paper are to summarize and compare the current approaches and consolidate the experiences of these approaches to outline the next steps of EaaS, particularly towards sustainable research infrastructures. This white paper summarizes several existing approaches to EaaS and analyzes their usage scenarios and also the advantages and disadvantages. The many factors influencing EaaS are overviewed, and the environment in terms of motivations for the various stakeholders, from funding agencies to challenge organizers, researchers and participants, to industry interested in supplying real-world problems for which they require solutions.

Published
2015

12. Patent-Related Tasks at NTCIR

Author

Lupu, Mihai, Fujii, Atsushi, Oard, Douglas W., Iwayama, Makoto, Kando, Noriko, Zhai, ChengXiang, Series editor, de Rijke, Maarten, Series editor, Lupu, Mihai, editor, Mayer, Katja, editor, Kando, Noriko, editor, and Trippe, Anthony J., editor

Published
2017
Full Text
View/download PDF

14. Investigating Result Usefulness in Mobile Search

Author

Mao, Jiaxin, Liu, Yiqun, Kando, Noriko, Luo, Cheng, Zhang, Min, Ma, Shaoping, Hutchison, David, Series Editor, Kanade, Takeo, Series Editor, Kittler, Josef, Series Editor, Kleinberg, Jon M., Series Editor, Mattern, Friedemann, Series Editor, Mitchell, John C., Series Editor, Naor, Moni, Series Editor, Pandu Rangan, C., Series Editor, Steffen, Bernhard, Series Editor, Terzopoulos, Demetri, Series Editor, Tygar, Doug, Series Editor, Weikum, Gerhard, Series Editor, Pasi, Gabriella, editor, Piwowarski, Benjamin, editor, Azzopardi, Leif, editor, and Hanbury, Allan, editor

Published
2018
Full Text
View/download PDF

16. Perspectives on Large Language Models for Relevance Judgment

Author

Faggioli, Guglielmo, primary, Dietz, Laura, additional, Clarke, Charles L. A., additional, Demartini, Gianluca, additional, Hagen, Matthias, additional, Hauff, Claudia, additional, Kando, Noriko, additional, Kanoulas, Evangelos, additional, Potthast, Martin, additional, Stein, Benno, additional, and Wachsmuth, Henning, additional

Published
2023
Full Text
View/download PDF

17. Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Author

Bauer, Christine, primary, Carterette, Ben, additional, Ferro, Nicola, additional, Fuhr, Norbert, additional, Beel, Joeran, additional, Breuer, Timo, additional, Clarke, Charles L. A., additional, Crescenzi, Anita, additional, Demartini, Gianluca, additional, Di Nunzio, Giorgio Maria, additional, Dietz, Laura, additional, Faggioli, Guglielmo, additional, Ferwerda, Bruce, additional, Fröbe, Maik, additional, Hagen, Matthias, additional, Hanbury, Allan, additional, Hauff, Claudia, additional, Jannach, Dietmar, additional, Kando, Noriko, additional, Kanoulas, Evangelos, additional, Knijnenburg, Bart P., additional, Kruschwitz, Udo, additional, Li, Meijie, additional, Maistro, Maria, additional, Michiels, Lien, additional, Papenmeier, Andrea, additional, Potthast, Martin, additional, Rosso, Paolo, additional, Said, Alan, additional, Schaer, Philipp, additional, Seifert, Christin, additional, Spina, Damiano, additional, Stein, Benno, additional, Tintarev, Nava, additional, Urbano, Julián, additional, Wachsmuth, Henning, additional, Willemsen, Martijn C., additional, and Zobel, Justin, additional

Published
2023
Full Text
View/download PDF

18. Continuous Recipe Selection Model Based on Cooking History

Author

Yamamoto, Shuhei, Kando, Noriko, Satoh, Tetsuji, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Spiro, Emma, editor, and Ahn, Yong-Yeol, editor

Published
2016
Full Text
View/download PDF

19. Content Centrality Measure for Networks: Introducing Distance-Based Decay Weights

Author

Fushimi, Takayasu, Satoh, Tetsuji, Saito, Kazumi, Kazama, Kazuhiro, Kando, Noriko, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Spiro, Emma, editor, and Ahn, Yong-Yeol, editor

Published
2016
Full Text
View/download PDF

20. Final Report of the NTCIR-14 QA Lab-PoliInfo Task

Author

Kimura, Yasutomo, primary, Shibuki, Hideyuki, additional, Ototake, Hokuto, additional, Uchida, Yuzu, additional, Takamaru, Keiichi, additional, Sakamoto, Kotaro, additional, Ishioroshi, Madoka, additional, Mitamura, Teruko, additional, Kando, Noriko, additional, Mori, Tatsunori, additional, Yuasa, Harumichi, additional, Sekine, Satoshi, additional, and Inui, Kentaro, additional

Published
2019
Full Text
View/download PDF

23. Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Author

Bauer, Christine, Carterette, Ben, Ferro, Nicola, Fuhr, Norbert, Beel, Joeran, Breuer, Timo, Clarke, Charles L. A., Crescenzi, Anita, Demartini, Gianluca, Nunzio, Giorgio Maria Di, Dietz, Laura, Faggioli, Guglielmo, Ferwerda, Bruce, Fröbe, Maik, Hagen, Matthias, Hanbury, Allan, Hauff, Claudia, Jannach, Dietmar, Kando, Noriko, Kanoulas, Evangelos, Knijnenburg, Bart P., Kruschwitz, Udo, Li, Meijie, Maistro, Maria, Michiels, Lien, Papenmeier, Andrea, Potthast, Martin, Rosso, Paolo, Said, Alan, Schaer, Philipp, Seifert, Christin, Spina, Damiano, Stein, Benno, Tintarev, Nava, Urbano, Julián, Wachsmuth, Henning, Willemsen, Martijn C., Zobel, Justin, Bauer, Christine, Carterette, Ben, Ferro, Nicola, Fuhr, Norbert, Beel, Joeran, Breuer, Timo, Clarke, Charles L. A., Crescenzi, Anita, Demartini, Gianluca, Nunzio, Giorgio Maria Di, Dietz, Laura, Faggioli, Guglielmo, Ferwerda, Bruce, Fröbe, Maik, Hagen, Matthias, Hanbury, Allan, Hauff, Claudia, Jannach, Dietmar, Kando, Noriko, Kanoulas, Evangelos, Knijnenburg, Bart P., Kruschwitz, Udo, Li, Meijie, Maistro, Maria, Michiels, Lien, Papenmeier, Andrea, Potthast, Martin, Rosso, Paolo, Said, Alan, Schaer, Philipp, Seifert, Christin, Spina, Damiano, Stein, Benno, Tintarev, Nava, Urbano, Julián, Wachsmuth, Henning, Willemsen, Martijn C., and Zobel, Justin

Published
2023

28. MinpakuBERT: A Language Model for Understanding Cultural Properties in Museum

Author

Mibayashi, Ryota, primary, Ueta, Masaki, additional, Kawahara, Takafumi, additional, Matsumoto, Naoaki, additional, Yoshimura, Takuma, additional, Aihara, Kenro, additional, Kando, Noriko, additional, Shoji, Yoshiyuki, additional, Nakajima, Yuta, additional, Yamamoto, Takehiro, additional, Yamamoto, Yusuke, additional, and Ohshima, Hiroaki, additional

Published
2022
Full Text
View/download PDF

34. Evaluating Information Retrieval and Access Tasks

Author

Sakai, Tetsuya, Oard, Douglas W., and Kando, Noriko

Subjects
Information Storage and Retrieval, Evaluation, Information Retrieval, Multilingual Information Access, NTCIR, Test Collections, Information Search, Information Storage, Artificial Intelligence, Open Acces, Information retrieval, Data warehousing, bic Book Industry Communication::U Computing & information technology::UN Databases::UNH Information retrieval
Abstract

This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, today’s smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students—anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.

Published
2021
Full Text
View/download PDF

38. Towards Humane Feedback Mechanisms in Exploratory Search

Author

Sørig, Esben, Collignon, Nicolas, Fiebrink, Rebecca, and Kando, Noriko

Abstract

Machine learning (ML) plays a central role in modern information retrieval (IR) systems. We argue that, in IR systems for multi-session exploratory search, there are unexploited opportunities for IR document ranking models to leverage users’ knowledge about the search task to better support users’ search needs. Specifically, we propose a method to enable users to adapt an IR document ranking model according to their information needs, using an interface that supports search strategies and methods for engaging with documents known to be useful when people explore new or complex domains of knowledge. We also discuss the major challenges in creating human-centered machine learning models and interfaces for exploratory search.

Published
2019

43. Evaluation-as-a-Service for the Computational Sciences

Author

Hopfgartner, Frank, primary, Hanbury, Allan, additional, Müller, Henning, additional, Eggel, Ivan, additional, Balog, Krisztian, additional, Brodt, Torben, additional, Cormack, Gordon V., additional, Lin, Jimmy, additional, Kalpathy-Cramer, Jayashree, additional, Kando, Noriko, additional, Kato, Makoto P., additional, Krithara, Anastasia, additional, Gollub, Tim, additional, Potthast, Martin, additional, Viegas, Evelyne, additional, and Mercer, Simon, additional

Published
2018
Full Text
View/download PDF

44. Report on NTCIR-13

Author

LIU, Yiqun, primary, Kato, Makoto P., additional, Clarke, Charles L.A., additional, Kando, Noriko, additional, and Sakai, Tetsuya, additional

Published
2018
Full Text
View/download PDF

49. How Task Types and User Experiences Affect Information-Seeking Behavior on the Web: Using Eye-tracking and Client-side Search Logs

Author

Saito, Hitomi, Terai, Hitoshi, Egusa, Yuka, Takaku, Masao, Miwa, Makiko, Kando, Noriko, Saito, Hitomi, Terai, Hitoshi, Egusa, Yuka, Takaku, Masao, Miwa, Makiko, and Kando, Noriko

Abstract

type:text, We investigated what influence task type and user experience had on information-seeking behaviors on the Web by using screen-capture logs and eye-movement data. Five graduate students in library and information science and eleven undergraduate students with other majors performed two different Web searches, a report-writing and a trip-planning task, and their think-aloud protocols, behaviors, and eye movements were recorded. Analyses of the screen-capture logs and eye-movement data revealed that the task type and user experience affected the participants’ information-seeking behaviors.

Published
2017

50. Visualization of User Eye Movements for Search Result Pages

Author

Egusa, Yuka, Takaku, Masao, Terai, Hitoshi, Saito, Hitomi, Kando, Noriko, Miwa, Makiko, Egusa, Yuka, Takaku, Masao, Terai, Hitoshi, Saito, Hitomi, Kando, Noriko, and Miwa, Makiko

Abstract

type:text, We propose new visualization techniques for the user behaviors when using search engine results pages. Our visualization method provides an overview of a user’s actual visual behavior using the logs for eye-movement data and browser link-clicking. We also report on the eye-movement data collected from user experiments.

Published
2017

Catalog

Books, media, physical & digital resources
See catalog results