Search

Your search keyword '"Koolen, R.M.F."' showing total 45 results
Start Over Author "Koolen, R.M.F."
45 results on '"Koolen, R.M.F."'

1. On the role of object knowledge in reference production: Effects of color typicality on content determination

Author

Westerbeek, H.G.W., Koolen, R.M.F., Maes, A.A., Bello, Paul, Guarini, Marcello, McShane, Marjorie, Scassellati, Brian, and Language, Communication and Cognition

Subjects
reference production, content determination, color typicality, AI models of reference production, visual saliency
Abstract

In two language production experiments, we investigated whether stored knowledge of the typical color of objects affects spoken reference. In experiment 1, human speakers referred to objects with colors ranging from very typical (e.g., red tomato) to very atypical (e.g., blue pepper). The probability that speakers redundantly include color in their descriptions was almost linearly predicted by the degree of atypicality. In experiment 2, we extended this finding to references to objects for which color is inherently a less salient property in stored knowledge (i.e., objects with a highly characteristic shape, making color less important for recognition). Following these findings that typicality affects reference production, we conclude that speakers utilize stored knowledge about everyday objects they refer to. We discuss the implications of our findings for artificial agents that generate natural language, arguing that computational models fall short in captur- ing general knowledge about typical properties of objects.

Published
2014

2. Reduction in gesture during the production of repeated references

Author

Hoetjes, M.W., Koolen, R.M.F., Goudbeek, M.B., Krahmer, E.J., Swerts, M.G.J., Hoetjes, M.W., Koolen, R.M.F., Goudbeek, M.B., Krahmer, E.J., and Swerts, M.G.J.

Abstract

In dialogue, repeated references contain fewer words (which are also acoustically reduced) and fewer gestures than initial ones. In this paper, we describe three experiments studying to what extent gesture reduction is comparable to other forms of linguistic reduction. Since previous studies showed conflicting findings for gesture rate, we systematically compare two measures of gesture rate: gesture rate per word and per semantic attribute (Experiment I). In addition, we ask whether repetition impacts the form of gestures, by manual annotation of a number of features (Experiment I), by studying gradient differences using a judgment test (Experiment II), and by investigating how effective initial and repeated gestures are at communicating information (Experiment III). The results revealed no reduction in terms of gesture rate per word, but a U-shaped reduction pattern for gesture rate per attribute. Gesture annotation showed no reliable effects of repetition on gesture form, yet participants judged gestures from repeated references as less precise than those from initial ones. Despite this gradient reduction, gestures from initial and repeated references were equally successful in communicating information. Besides effects of repetition, we found systematic effects of visibility on gesture production, with more, longer, larger and more communicative gestures when participants could see each other. We discuss the implications of our findings for gesture research and for models of speech and gesture production.

Published
2015

5. Color typicality and content planning in definite reference

Author

Westerbeek, H.G.W., Koolen, R.M.F., Maes, A., Bard, Ellen, van Deemter, Kees, Gatt, Albert, van Gompel, Roger, Krahmer, Emiel, and Language, Communication and Cognition

Subjects
genetic structures, ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION, content planning, models of reference production, color typicality, visual saliency
Abstract

We investigated whether knowledge of the typical color of objects affects content planning in reference production. In a language production experiment, we elicited identifying de- scriptions of typically colored (e.g., orange goldfish) and atypically colored objects (orange crocodile). In line with our expectations, speakers are more likely to redundantly include color in a description of a target when it has an atypical color, than when it is typically colored. This finding leads to some recommendations for current computational models of con- tent planning, such as the Incremental Algorithm.

Published
2013

9. Reduction in repeated references in gesture and sign language

Author

Hoetjes, M.W., Schmit, A., Koolen, R.M.F., Goudbeek, M.B., Krahmer, E.J., Swerts, M.G.J., Efthomiou, E., Kouroupetroglou, G., and Language, Communication and Cognition

Subjects
ComputingMilieux_LEGALASPECTSOFCOMPUTING
Published
2011

10. Effects of scene variation on referential overspecification

Author

Koolen, R.M.F., Goudbeek, M.B., Krahmer, E.J., Carlson, L., Hoelscher, C., Shipley, T.F., and Language, Communication and Cognition

Subjects
ComputingMilieux_GENERAL, ComputingMilieux_LEGALASPECTSOFCOMPUTING
Published
2011

14. How Perceived Distractor Distance Influences Reference Production: Effects of Perceptual Grouping in 2D and 3D Scenes

Author

Koolen, R.M.F., Houben, E., Huntjens, J., Krahmer, E.J., Koolen, R.M.F., Houben, E., Huntjens, J., and Krahmer, E.J.

Abstract

This study explored two factors that might have an impact on how participants perceive distance between objects in a visual scene: perceptual grouping and presentation mode (2D versus 3D). More specifically, we examined how these factors affect language production, asking if they cause speakers to include a redundant color attribute in their descriptions of objects. We expected speakers to use more redundant color attributes when distractor objects are perceptually close. Our findings revealed effects of perceptual grouping, with speakers indeed using color more often when all objects in a scene were in the same perceptual group as compared to when this was not the case. An effect of presentation mode (whether scenes were presented in 2D or in 3D) was only partially borne out by the data. Implications of our results for computational models of reference production are discussed.

Published
2014

Catalog

Books, media, physical & digital resources
See catalog results