Search

How we perceive the world is not solely determined by our experiences at a given moment in time, but also by what we have experienced in our immediate past. Here, we investigated whether such sequential effects influence the affective appraisal of food images. Participants from 16 different countries (N = 1278) watched a randomly presented sequence of 60 different food images and reported their affective appraisal of each image in terms of valence and arousal. For both measures, we conducted an inter-trial analysis, based on whether the rating on the preceding trial(s) was low or high. The analyses showed that valence and arousal ratings for a given food image are both assimilated towards the ratings on the previous trial (i.e., a positive serial dependence). For a given trial, the arousal rating depends on the arousal ratings up to three trials back. For valence, we observed a positive dependence for the immediately preceding trial only, while a negative (repulsive) dependence was present up to four trials back. These inter-trial effects were larger for males than for females, but independent of the participants’ BMI, age, and cultural background. The results of this exploratory study may be relevant for the design of websites of food delivery services and restaurant menus.

Food experiences can be summarized along two main dimensions: valence and arousal, which can be measured explicitly with subjective ratings or implicitly with physiological and behavioural measures. Food experiences are not only driven by the food’s intrinsic properties, such as its taste, texture, and aroma, but also by extrinsic properties such as brand information and the consumers’ previous experiences with the foods. In this study, valence and arousal to intrinsic and extrinsic properties of soy sauce were measured in consumers that varied in their previous experience with soy sauce, using a combination of explicit (scores and emojis), implicit (heart rate frequency and skin conductance), and behavioural measures (facial expressions). Forty participants, high- and low-frequency users, were presented with samples of rice and three commercial soy sauces without and with brand information that either matched or non-matched the taste of the soy sauce. In general, skin conductance and facial expressions showed relatively low arousal during exposure to the brand name, increased arousal in anticipation of the taste, and again lowest arousal during tasting. Heart rate frequency was lowest during exposure to the brand name, increased during anticipation, and increased further during tasting (probably resulting from the motor activity during chewing). Furthermore, the results showed that explicit liking and arousal scores were primarily affected by the taste of the specific soy sauce and by the participants’ previous experience with soy sauces. These scores were not affected by branding information. In contrast, facial expressions, physiological skin conductance (level and response), and heart rate frequency were primarily affected by 1) the participants’ level of experience with soy sauce, 2) whether or not branding information was provided, and 3) whether or not the branding information matched with the taste. In conclusion, this study suggests that liking scores may be most sensitive to the food’s intrinsic taste properties, whereas implicit measures may be most sensitive to extrinsic properties such as brand information. Both explicit and implicit measures were affected by the consumers’ previous food experiences.

Food experiences are not only driven by the food’s intrinsic properties, such as its taste, texture, and aroma, but also by extrinsic properties such as visual brand information and the consumers’ previous experiences with the foods. Recent developments in automated facial expression analysis and heart rate detection based on skin color changes (remote photoplethysmography or RPPG) allow for the monitoring of food experiences based on video images of the face. RPPG offers the possibility of large-scale non-laboratory and web-based testing of food products. In this study, results from the video-based analysis were compared to the more conventional tests (scores of valence and arousal using Emojis and photoplethysmography heart rate (PPG)). Forty participants with varying degrees of familiarity with soy sauce were presented with samples of rice and three commercial soy sauces with and without brand information. The results showed that (1) liking and arousal were affected primarily by the specific tastes, but not by branding and familiarity. In contrast, facial expressions were affected by branding and familiarity, and to a lesser degree by specific tastes. (2) RPPG heart rate and PPG both showed effects of branding and familiarity. However, RPPG heart rate needs further development because it underestimated the heart rate compared to PPG and was less sensitive to changes over time and with activity (viewing of brand information and tasting). In conclusion, this study suggests that recording of facial expressions and heart rates may no longer be limited to laboratories but can be done remotely using video images, which offers opportunities for large-scale testing in consumer science.

We present CROCUFID: a CROss-CUltural Food Image Database that currently contains 840 images, including 479 food images with detailed metadata and 165 images of non-food items. The database includes images of sweet, savory, natural, and processed food from Western and Asian cuisines. To create sufficient variability in valence and arousal we included images of food with different degrees of appetitiveness (fresh, unfamiliar, molded or rotten, spoiled, and partly consumed). We used a standardized photographing protocol, resulting in high resolution images depicting all food items on a standard background (a white plate), seen from a fixed viewing (45°) angle. CROCUFID is freely available under the CC-By Attribution 4.0 International license and hosted on the OSF repository. The advantages of the CROCUFID database over other databases are its (1) free availability, (2) full coverage of the valence – arousal space, (3) use of standardized recording methods, (4) inclusion of multiple cuisines and unfamiliar foods, (5) availability of normative and demographic data, (6) high image quality and (7) capability to support future (e.g., virtual and augmented reality) applications. Individuals from the United Kingdom (N = 266), North-America (N = 275), and Japan (N = 264) provided normative ratings of valence, arousal, perceived healthiness, and desire-to-eat using visual analog scales (VAS). In addition, for each image we computed 17 characteristics that are known to influence affective observer responses (e.g., texture, regularity, complexity, and colorfulness). Significant differences between groups and significant correlations between image characteristics and normative ratings were in accordance with previous research, indicating the validity of CROCUFID. We expect that CROCUFID will facilitate comparability across studies and advance experimental research on the determinants of food-elicited emotions. We plan to extend CROCUFID in the future with images of food from a wide range of different cuisines and with non-food images (for applications in for instance neuro-physiological studies). We invite researchers from all parts of the world to contribute to this effort by creating similar image sets that can be linked to this collection, so that CROCUFID will grow into a truly multicultural food database.

Because of the globalization of world food markets there is a growing need for valid and language independent self-assessment tools to measure food-related emotions. We recently introduced the EmojiGrid as a language-independent, graphical affective self-report tool. The EmojiGrid is a Cartesian grid that is labeled with facial icons (emoji) expressing different degrees of valence and arousal. Users can report their subjective ratings of valence and arousal by marking the location on the area of the grid that corresponds to the emoji that best represent their affective state when perceiving a given food or beverage. In a previous study we found that the EmojiGrid is robust, self-explaining and intuitive: valence and arousal ratings were independent of framing and verbal instructions. This suggests that the EmojiGrid may be a valuable tool for cross-cultural studies. To test this hypothesis, we performed an online experiment in which respondents from Germany (GE), Japan (JP), the Netherlands (NL) and the United Kingdom (UK) rated valence and arousal for 60 different food images (covering a large part of the affective space) using the EmojiGrid. The results show that the nomothetic relation between valence and arousal has the well-known U-shape for all groups. The European groups (GE, NL and UK) closely agree in their overall rating behavior. Compared to the European groups, the Japanese group systematically gave lower mean arousal ratings to low valenced images and lower mean valence ratings to high valenced images. These results agree with known cultural response characteristics. We conclude that the EmojiGrid is potentially a valid and language-independent affective self-report tool for cross-cultural research on food-related emotions. It reliably reproduces the familiar nomothetic U-shaped relation between valence and arousal across cultures, with shape variations reflecting established cultural characteristics.