Search

This pilot study is part of a larger "Decolonization of Digital Learning Spaces" project, which aims to develop research tools for communities that are remote and/or excluded geographically, politically, economically, socially, culturally, and linguistically. The project's ultimate goal is to work alongside these communities to design their own digital learning tools, networks, and online educational environments by accessing and leveraging their knowledge and skills. Testing the single-criterion card sorting method is the first step toward this goal. Card sorting is an easy, enjoyable, and cost-effective method for data collection and analysis, particularly for researchers working in remote areas with limited access to electricity or the Internet. The pilot explored singlecriterion card sorting as a method to elicit knowledge from two diverse cultural and linguistic groups engaged in learning activities within their communities. These groups were from a Deaf and Hard of Hearing (DHH) community in Canada (engaged in a bowmaking workshop) and a rural Kabyle community in Algeria (engaged in a traditional cooking lesson). Despite low participant numbers, distinct patterns emerged, indicating the method's effectiveness. The results, though anticipated, were non-random, demonstrating the potential of card sorting in producing patterns indicative of how individuals and/or communities categorize their world(s). Kabyle sortings focused on ingredients, highlighting older individuals as teachers passing along knowledge, while the DHH sortings emphasized face-to-face contact and hand movements in communication. The findings, though modest, established relationships, provided insights into the research context and offered logistical understanding, paving the way for further work with DHH and Kabyle communities towards the design of digital learning spaces. [ABSTRACT FROM AUTHOR]

Copyright of Orientation Scolaire et Professionnelle (OSP) is the property of Institut National d'Etude du Travail et d'Orientation Professionnelle and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Copyright of Cuadernos del Centro de Estudios de Diseño y Comunicación is the property of Cuadernos del Centro de Estudios de Diseno y Comunicacion and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Purpose: The purpose of this study was to investigate the perspective of school personnel regarding the impact of social–ecological factors and to identify salient ways to support school personnel in sustaining Comprehensive School Physical Activity Programs. Methods: In this mixed-methods longitudinal study, stakeholders were surveyed at two points in time (n = 67) and interviewed in semistructured interviews (n = 41) using card sorting to understand the influence of social–ecological factors on Comprehensive School Physical Activity Programs sustainability. Results: Across time, the perceived influence of social–ecological levels varied considerably: individual, t(78.86) = −4.22, p <.001, d = 0.52, interpersonal, t(88.20) = −2.32, p =.023, d = 0.09, organizational, t(80.56) = −2.38, p =.02, d = 0.29, and the community factor, t(83.24) = −3.05, p =.003, d = 0.30. Stakeholders rated ecological levels from greatest to least influential as individual, organizational, interpersonal, community, and policy. Themes within levels provided a deeper understanding of these influences. Conclusion: To successfully sustain Comprehensive School Physical Activity Programs in schools, balanced support from all social–ecological levels may be needed. [ABSTRACT FROM AUTHOR]

Background. The necessity of studying perceptions of creativity in psychology cadets is conditioned by the fact that the “soft” skill of creativity is associated with the ability to go beyond the given conditions and to act effectively in uncertain situations, and also by the fact that the successful adaptation of a young specialist to work depends on whether his perceptions of his activity coincide with its real content. Objectives. The research is meant to identify the peculiarities of representations of creativity in psychology cadets at the adept stage. Study Participants. A total of 201 people (122 men and 79 women) participated in the study, including representatives of different professions: working professionals and trainees, students and cadets. The average age of the sample was 31 years. Methods. Psychosemantic methods were used in the study: group associative experiment and card sorting method. They allow to construct a subjective semantic space reflecting the peculiarities of perceptions of creativity. Results. As a result of the associative experiment, a list of 86 frequent words describing professional activity was obtained. Sorting of the obtained 86 words by cadet psychologists, psychology students, and psychologists of the scientific platoon revealed significant differences in the content and structure of representations of creativity. Comparison of the semantics of creativity in psychologists at the adept stage shows that university students have a more complex structure of representations in comparison with cadets, connected with the allocation of a separate cluster “hobby, interest, development” and at the same time similar in content to the representations of working psychologists on the proximity of “labor, work” with creativity. At the same time, the similarity of clusters in the description of creativity by students and cadets indicates that the ideas about it are laid down at the early stages of professional training. Conclusions. Reconstruction of subjective semantics of creativity by the method of semantic spaces in psychology cadets is a promising qualitative description method for specific characteristics of professional activity.

Clinical decision support systems (CDSS) can efficiently support doctors in coping with ever-increasing amounts of data by providing evidence-based recommendations for medical decisions. To integrate the systems into the medical workflow and provide patient-specific recommendations for action in the context of personalized medicine, it is essential to tailor the systems to the context of use. This study aims to present an overview of factors influencing medical decision-making that CDSS must consider. Our approach involves the systematic identification and categorization of contextual factors relevant to medical decision-making. Through extensive literature research and a structured card-sorting workshop, we systematized 774 context factors and mapped them into a model. This model includes six primary entities: the treating physician, the patient, the patient’s family, disease treatment, the physician’s institution, and professional colleagues, each with their relevant context categories. The developed model could serve as a foundation for communication between developers and physicians, supporting the creation of more context-sensitive CDSS in the future. Ultimately, this could enhance the utilization of CDSS and improve patient care. [ABSTRACT FROM AUTHOR]

The design and info‐architecture of the web content contribute significantly to achieving better usability and user experience as well as to adopting a website to its intended end‐users. Although several design techniques exist, choosing a suitable one for designing a particular type of website is difficult and needs further investigation. Thus, the objective of this research is to explore the impact of a design technique on web usability and to find out the best suitable design technique for a particular type of website. To achieve these objectives, two separate websites for providing electronic health services named Citizen Health Service portal were developed using the two mostly used design techniques, namely card sorting and interactive dialogue model (IDM). The usability of both websites was evaluated through a laboratory‐based usability testing approach with 20 participants. The study result showed that the IDM performs better in designing such an information‐intensive website. [ABSTRACT FROM AUTHOR]

Emergency Remote Teaching (ERT) can be defined as a shift of instructional delivery to a substitute delivery approach during a crisis. Such a shift poses several challenges for students at Higher Education Institutes. This paper presents a taxonomy of such challenges faced by first-year mathematics students in the Pacific region during the ERT dictated by the COVID-19 pandemic. First, a list of 44 challenges was assembled based on a university’s in-house monitoring report, literature review and the authors’ experiences of challenges faced by students. Next, the open card sorting technique involving 32 participants was used to classify these challenges. Open card sorting is a well-established method for discovering how people understand and categorize information. This paper employed a recently proposed algorithm to quantitatively analyze open card sorting data using the Best Merge Method, Category Validity Technique and Multidimensional Scaling. Analysis of the collected card sort data produced the initial taxonomy of challenges. Finally, the participants were asked to answer a questionnaire so that we could validate and further refine the taxonomy. The proposed taxonomy includes seven challenges: i) lack of online learning support; ii) problem with online course delivery; iii) time and workload management; iv) learning management system issues; v) lack of face-to-face interaction; vi) financial hardship; vii) internet challenge. Such a taxonomy might be particularly useful in designing and evaluating an ERT approach.

This study aimed to understand the epistemic views of history teachers on school history as specialised subject of knowledge. This study adopted the qualitative research approach and interpretivism paradigm. I purposively sampled seven professionally qualified history teachers. For data generation, I used card sorting. What emerged was an unquestionable epistemic certainty to which the teachers steadfastly returned. Broadly speaking, to them school history as the specialised subject of knowledge was about past human actions, promoting human rights, critical thinking, and understanding values. In many ways this spoke of a fixed mindset in which the ideas of what school history should be--namely, procedural historical thinking as part of an analytical approach to the subject as found in the CAPS-History document--had limited to no impact. This could be attributed to the fact that the rural teachers who participated in this study had limited opportunities to be exposed to training related to the CAPS-History curriculum. Hence, their knowledge about school history is rooted in their historical, social, political, educational, and economic reality in which historical knowledge, common or general knowledge, political knowledge, generic skills, and character education are key matters. [ABSTRACT FROM AUTHOR]

Abstract The design and info‐architecture of the web content contribute significantly to achieving better usability and user experience as well as to adopting a website to its intended end‐users. Although several design techniques exist, choosing a suitable one for designing a particular type of website is difficult and needs further investigation. Thus, the objective of this research is to explore the impact of a design technique on web usability and to find out the best suitable design technique for a particular type of website. To achieve these objectives, two separate websites for providing electronic health services named Citizen Health Service portal were developed using the two mostly used design techniques, namely card sorting and interactive dialogue model (IDM). The usability of both websites was evaluated through a laboratory‐based usability testing approach with 20 participants. The study result showed that the IDM performs better in designing such an information‐intensive website.

BACKGROUND: Universal design (UD) is a beneficial concept for better accessible design to improve easy approachability and industry-standard products. Specifically, Indian household products require UD features in domains such as bathroom and toilet, furniture, kitchen utilities, and home appliances. Among household product design in India, a lack of understanding of the product's universality might be a constraint for product designers. Also, there are no studies assessing the UD features of Indian household products. OBJECTIVE: (1) To examine the UD feature of Indian household products against the seven principles of UD; (2) To determine the most lacking UD feature among Indian household products; and (3) To find out the Indian household categories (i.e., bathroom and toilet, furniture, kitchen utilities, and home appliances) which are most lacking in UD performance. METHOD: The UD features were evaluated using a standardized questionnaire, which contains 29 questions on UD principles and general questions (gender, education level, age and house characteristics). Using statistical packages, the data were computed for mean and frequency distribution, as well as analyzed to achieve the objectives. The analysis of variance (ANOVA) was performed for comparative analyses. RESULTS: The results indicate that the "flexibility in use" and "perceptible information" principles were lacking among the Indian household products. Also, bathroom and toilet and furniture household products were most lacking in UD performance. CONCLUSION: The findings of this research will enlighten the insights into the usefulness, usability, safety, and marketability of Indian household products. In addition, they will be helpful in promoting UD features and obtaining financial benefits from the Indian market. [ABSTRACT FROM AUTHOR]

The purpose of this research was to redesigning the user interface architecture of the digital library website of the National Library and Archives of Iran (NLAI( using card-sorting method in order to improve the structure and the desired retrieval. The present study is an applied research. To this end a multifaceted approach and various techniques such as interviewing, think-aloud protocol and card-sorting were used to redesign the user interface architecture of the digital library website of the NLAI. EXCEL and VISIO software were used to analyze the data, and Sort Optimal tool was used to analyze the data obtained from card-sorting. The results were read in the form of similarity matrix and dendrogram algorithm. The statistical population in this study included users of the digital library website of the NLAI, who were selected in two groups of novice users (clients) and advanced users (librarians). In order to validate the qualitative findings, the researcher triangulation method was used. Findings of the research, the model and the results obtained from Card Sorting test, were provided to 7 experts, researchers and professors of library and information science who had necessary experience, for evaluation to give their expert opinion in the field of data analysis. The similarity matrix findings showed that users grouped elements such as "Ask Us", "Legal Considerations", "Resource Registration", "Resource Donation", and "Technical Support" and so on. The findings of the Standardization Network also confirmed that users have included 10 times "Ask Us", 17 times "Resource Registration" and 6 times "Technical Support" in the menu of electronic services. Dendrogram findings also showed that a number of contributors expect to be able to select "source type" if necessary next to the search box, rather than independently reviewing individual digital resources. Cart sorting process analysis showed that in addition to predefined categories, some new categories were suggested. These included "links to other digital libraries", "shared databases" and the "FAQ" category. The data and performance of users in this study showed that the current user interface of the digital library website is not user-friendly and users cannot quickly get what they are looking for. The card-sorting process generally acknowledged inconsistencies in how users perceived the labeling and organization of digital library website content. Interviews and think-aloud protocols with users also confirmed that the language used to name menues and information elements is currently not simple and user-friendly. User categories in the card-sorting process for designing the user interface architecture also showed that there are elements in the website that users do not need, and conversely, there are important elements that are not included in the website. In the simulated information architecture, based on the findings of the interview and the participation of users in the Card Sorting process, an attempt was made to design the proposed user interface somewhat similar to other user interfaces (OPAC and Rasa software). In the proposed model, while paying attention to the demands and expectations of users, the simplicity of the pages, the most important point has been observed.

Teaching algorithmic thinking enables students to use their knowledge in various contexts to reuse existing solutions to algorithmic problems. The aim of this study is to examine how students recognize which algorithmic concepts can be used in a new situation. We developed a card sorting task and investigated the ways in which secondary school students arranged algorithmic problems (Bebras tasks) into groups using algorithm as a criterion. Furthermore, we examined the students’ explanations for their groupings. The results of this qualitative study indicate that students may recognize underlying algorithmic concepts directly or by identifying similarities with a previously solved problem; however, the direct recognition was more successful. Our findings also include the factors that play a role in students’ recognition of algorithmic concepts, such as the degree of similarity to problems discussed during lessons. Our study highlights the significance of teaching students how to recognize the structure of algorithmic problems.

The purpose of this research was to redesigning the user interface architecture of the digital library website of the National Library and Archives of Iran (NLAI) using card-sorting method in order to improve the structure and the desired retrieval. The present study is an applied research. To this end a multifaceted approach and various techniques such as interviewing, think-aloud protocol and card-sorting were used to redesign the user interface architecture of the digital library website of the NLAI. EXCEL and VISIO software were used to analyze the data, and Sort Optimal tool was used to analyze the data obtained from card-sorting. The results were read in the form of similarity matrix and dendrogram algorithm. The statistical population in this study included users of the digital library website of the NLAI, who were selected in two groups of novice users (clients) and advanced users (librarians). In order to validate the qualitative findings, the researcher triangulation method was used. Findings of the research, the model and the results obtained from Card Sorting test, were provided to 7 experts, researchers and professors of library and information science who had necessary experience, for evaluation to give their expert opinion in the field of data analysis. The similarity matrix findings showed that users grouped elements such as “Ask Us”, “Legal Considerations”, “Resource Registration”, “Resource Donation”, and “Technical Support” and so on together. The findings of the Standardization Network also confirmed that users have included 10 times “Ask Us”, 17 times “Resource Registration” and 6 times “Technical Support” in the menu of electronic services. Dendrogram findings also showed that a number of contributors expect to be able to select “source type” if necessary next to the search box, rather than independently reviewing individual digital resources. Cart sorting process analysis showed that in addition to predefined categories, some new categories were suggested. These included “links to other digital libraries”, “shared databases” and the “FAQ” category. The data and performance of users in this study showed that the current user interface of the digital library website is not user-friendly and users cannot quickly get what they are looking for. The card-sorting process generally acknowledged inconsistencies in how users perceived the labeling and organization of digital library website content. Interviews and think-aloud protocols with users also confirmed that the language used to name menues and information elements is currently not simple and user-friendly. User categories in the card-sorting process for designing the user interface architecture also showed that there are elements in the website that users do not need, and conversely, there are important elements that are not included in the website. In the simulated information architecture, based on the findings of the interview and the participation of users in the Card Sorting process, an attempt was made to design the proposed user interface somewhat similar to other user interfaces (OPAC and Rasa software). In the proposed model, while paying attention to the demands and expectations of users, the simplicity of the pages, the most important point has been observed. [ABSTRACT FROM AUTHOR]

La evolución del sector editorial demanda un nuevo perfil profesional: el Gestor Creativo. El estudio analiza los tipos de competencias profesionales y propone unas competencias transversales para definir este nuevo perfil editorial. La investigación se basa en una metodología mixta de base cualitativa con una técnica cuantitativa: el card sorting. Este método de clasificación de tarjetas sirve para comprobar la adecuación e importancia de estas competencias con el rol del Gestor Creativo editorial. Por tanto, el objetivo principal es definir las competencias transversales en diferentes áreas de conocimiento como técnico, creativo y de la comunicación.

ABSTRACT Visual literacy, which is the ability to effectively identify, interpret, evaluate, use, and create images and visual media, is an important aspect of science literacy. As molecular processes are not directly observable, researchers and educators rely on visual representations (e.g., drawings) to communicate ideas in biology. How learners interpret and organize those numerous diagrams is related to their underlying knowledge about biology and their skills in visual literacy. Furthermore, it is not always obvious how and why learners interpret diagrams in the way they do (especially if their interpretations are unexpected), as it is not possible to “see” inside the minds of learners and directly observe the inner workings of their brains. Hence, tools that allow for the investigation of visual literacy are needed. Here, we present a novel card-sorting task based on visual literacy skills to investigate how learners interpret and think about DNA-based concepts. We quantified differences in performance between groups of varying expertise and in pre- and postcourse settings using percentages of expected card pairings and edit distance to a perfect sort. Overall, we found that biology experts organized the visual representations based on deep conceptual features, while biology learners (novices) more often organized based on surface features, such as color and style. We also found that students performed better on the task after a course in which molecular biology concepts were taught, suggesting the activity is a useful and valid tool for measuring knowledge. We have provided the cards to the community for use as a classroom activity, as an assessment instrument, and/or as a useful research tool to probe student ideas about molecular biology.

Purpose: This study aims to evaluate the usability and information architecture of the digital library (DL) website of the National Library and Archives of Iran (NLAI). Design/methodology/approach: This applied study used an exploratory mixed method, card sorting. Data were collected by interviewing, observation, usability test and card sorting. By interviewing users about problems of the DL, eight tasks were predefined and users' problems in the path were identified. Their satisfaction of the tasks and the usability rates were measured via a questionnaire. Card sorting was done to inform on the information organization of the website elements. The study population included all users of the DL of the NLAI in two groups: ten initiator users (public users) and ten expert users (librarians). SPSS was used for analysing the usability test quantitative data. MaxQda was applied for analysing interview-driven qualitative data. Qualitative content analysis, categorization (data organization and grouping) and determining main and secondary codes were applied as well. The sort optimal application was used for analysing card sorting data in the form of similarity matrix and dendrogram. For validating qualitative findings, triangulation was used. The internal reliability of the used questionnaire amounted to a = 0.87 Findings: Regarding the assigned tasks, new initiator users by consuming 367.67 s for registering and new expert users by consuming 403 s spent the most time. Task 2 ranked first in being incomplete among 40% of initiator users and Task 3 ranked first by 30% of incompleteness. Expert users had more unsuccessful attempts. Task 5 with the mean rate of 3.35 and Task 8 with the mean rate of 2.25 were the most difficult and the easiest tasks, respectively. Some usability components were rated lower than the moderate point. Only 30% of initiator users and 10% of expert users were satisfied with the website. A total of 12 categories and 452 codes were identified as main problems of the DL. The problems related to a vague perception of concepts and labels with 90 repetitions and digital source display with six repetitions ranked as the first and the last problems in working with the DL, respectively. The sort optimal package produced the card sorting results as a matrix similarity and a dendrogram. Card sorting reflected some changes in organizing information items. Interviews after card sorting emerged some new groups to be included, such as links to other digital libraries, shared databases in the organization and frequently asked questions. Originality/value: The library's website should be designed in a manner so that it can satisfy users with different traits. As the information technologies are increasingly developing, the importance of such a design increases for better service provision and effective competition. [ABSTRACT FROM AUTHOR]

Plant-based food (PBF) is on the rise as an alternative for animal-based food. Europe is leading in the market size compared with the global market. However, the high failure rate for new food products is challenging the success of new PBF in the market. This paper aims to unravel the key success factors (KSFs) from existing brands, contributing to the knowledge on how to achieve success in PBF market. Two subsequent studies employing online surveys were included, which targeted food expert participants. Study 1 focused on the collection of KSFs related to PBF brands utilizing the card sorting approach. Study 2 employed cluster analysis to further investigate the KSFs among different PBF brands. The findings identified six clusters of KSFs under the external and internal factors supporting the success of the PBF brands. Two ('Consumer' and 'Trend') and four ('Ideology', 'Marketing strategy', 'Innovation management', and 'Management structure') clusters were assigned into external and internal factors, respectively. Furthermore, cluster analysis identified four brand clusters: 'Mature', 'Targeted', 'Newcomer', and 'Established but diversifying' clusters. Each brand cluster utilized different KSFs into their strategies; however, both external and internal factors were applied, suggesting that there is no one-size-fits-all KSF to succeed in the market. [ABSTRACT FROM AUTHOR]

This research note introduces the use of question cards as a technique that can aid the interviewing process. Question cards provide a dynamic checklist of themes and questions, affording interviewers and interviewees increased flexibility in shaping dialogue. This approach empowers interviewees by allowing them to influence the interview's direction, determine question order, and contribute their own questions. The transparency facilitated by question cards clarifies the interview's purpose and reduces ambiguity. Additionally, question cards act as visual aids, aiding navigation and enabling both interviewer and interviewee to have a clear sight of the topics for discussion. Importantly, this technique levels the information playing field, granting all parties access to the interview's structure, questions and themes. Post-interview, question cards prove invaluable as prompts for coding and analysis, streamlining data extraction. As such, the research note suggests, the use of question cards has many potential benefits for the qualitative researcher. [ABSTRACT FROM AUTHOR]

Perception gaps measure the disparity between the current state and the expected or desired state for a particular phenomenon. This research study examined the perception gaps between how undergraduate students at the University of Mississippi prioritized adding prospective services and how librarians at the University of Mississippi thought students prioritize those services. Card sorts completed by students during a prior study were compared to cards sorts completed by librarians to calculate the perception gap for sixty different services and spaces. The perception gaps for technology-related services were analyzed based on findings from the authors' prior study. The perception gaps revealed several services that librarians either notably underestimated (extended hours, natural lighting) or overestimated (3D printing, removing bookshelves to add study space). The perception gaps for items which students had the most and least interest were also analyzed. [ABSTRACT FROM AUTHOR]

Familiar and unfamiliar faces are recognized in fundamentally different ways. One way in which recognition differs is in terms of the features that facilitate recognition: previous studies have shown that familiar face recognition depends more on internal facial features (i.e., eyes, nose and mouth), whereas unfamiliar face recognition depends more on external facial features (i.e., hair, ears and contour). However, very few studies have examined the recognition of faces that vary in both familiarity and race, and the reliance on different facial features, whilst also using faces that incorporate natural within-person variability. In the current study, we used an online version of the card sorting task to assess adults' (n = 258) recognition of faces that varied in familiarity and race when presented with either the whole face, internal features only, or external features only. Adults better recognized familiar faces than unfamiliar faces in both the whole face and the internal features only conditions, but not in the external features only condition. Reasons why adults did not show an own-race advantage in recognition are discussed. [ABSTRACT FROM AUTHOR]

Software engineers can use various techniques to elicit relevant information from stakeholders to specify the requirements that a software-intensive product must satisfy. However, few are aware of the differences and advantages they have from each other. This article presents an exploratory study of the vision that requirements engineers have on twelve requirements elicitation techniques. An empirical study has been carried out using two classification techniques: card sorting and repertory grid. The perceptions obtained with each technique were compared, showing that there are differences and coincidences in the visions captured by each technique. This study can help guide training objectives on software requirements and conduct future empirical studies that show the adequacy of each elicitation technique. [ABSTRACT FROM AUTHOR]

Teaching algorithmic thinking enables students to use their knowledge in various contexts to reuse existing solutions to algorithmic problems. The aim of this study is to examine how students recognize which algorithmic concepts can be used in a new situation. We developed a card sorting task and investigated the ways in which secondary school students arranged algorithmic problems (Bebras tasks) into groups using algorithm as a criterion. Furthermore, we examined the students' explanations for their groupings. The results of this qualitative study indicate that students may recognize underlying algorithmic concepts directly or by identifying similarities with a previously solved problem; however, the direct recognition was more successful. Our findings also include the factors that play a role in students' recognition of algorithmic concepts, such as the degree of similarity to problems discussed during lessons. Our study highlights the significance of teaching students how to recognize the structure of algorithmic problems. [ABSTRACT FROM AUTHOR]

Participatory Theme Elicitation (PTE) is a new approach to increasing user-involvement in qualitative data analysis. In this five-step method, participants independently identify themes in the data using open card sorting, and are supported in their development of a set of themes that reflect all participant views. We describe and evaluate PTE with a case study, where nine lay researchers identified five core themes in qualitative data from an online intervention with depressed adults. Total participation time was approximately 6 hours. Evaluation data revealed high levels of satisfaction with the PTE process and the themes generated. The strong commitment to public engagement in social science research and limited guidance on methods for effective participatory analysis of qualitative data highlight the value and growing need for robust standardised approaches such as PTE. [ABSTRACT FROM AUTHOR]

The article discusses the challenges and opportunities for the next generation of cartographers. it emphasizes the need for diverse competencies and overcoming institutional and professional barriers. It highlights the importance of inter-generational knowledge sharing, continuous learning, and professional networking, and calls for global workshop expansion and increased support for early-career cartographers within the International Cartographic Association (ICA).

Older adults are increasingly a target for cyber‐attacks; however, very little research has investigated how they feel about engaging in protective cyber‐security behaviors. We developed and applied a novel card‐sorting task to elicit how older adults feel about protective cyber‐security behaviors and to identify the factors that impact their confidence in executing these behaviors. Nineteen task‐assisted interviews were conducted with UK older adults. A thematic analysis revealed that older adults see protective online behaviors as important, but their reasons for disengagement fell into three categories: I do not want to (essentially, because the costs outweigh the benefits), I do not need to (e.g. because it is not my responsibility), and I am unable to (which includes heightened anxiety about doing something wrong). Underlying confidence around engagement with protective behaviors was a function of three factors: personal competence (related to good computer self‐efficacy and relevant past experience), support (having a good network for information and advice), and demand (the effort of keeping up to date with the latest advice). Ultimately, we found that older adults are keen to protect themselves but are lacking appropriate support and we discuss implications for developers, researchers, and policy makers. This paper explores older adults' perceptions of common cyber‐security behaviors. We introduce an effective card sorting methodology for security elicitation in older adults. We apply this to identify reasons as to why older adults may not engage in security behaviors as well as identifying a number of reasons why older adults actively avoid engaging in security behaviors. [ABSTRACT FROM AUTHOR]

The debate as to whether language influences cognition has been long standing but has yielded conflicting findings across domains such as colour and kinship categories. Fewer studies have investigated systems such as nominal classification (gender, classifiers) across different languages to examine the effects of linguistic categorisation on cognition. Effective categorisation needs to be informative to maximise communicative efficiency but also simple to minimise cognitive load. It therefore seems plausible to suggest that different systems of nominal classification have implications for the way speakers conceptualise relevant entities. A suite of seven experiments was designed to test this; here we focus on our card sorting experiment, which contains two sub-tasks — a free sort and a structured sort. Participants were 119 adults across six Oceanic languages from Vanuatu and New Caledonia, with classifier inventories ranging from two to 23. The results of the card sorting experiment reveal that classifiers appear to provide structure for cognition in tasks where they are explicit and salient. The free sort task did not incite categorisation through classifiers, arguably as it required subjective judgement, rather than explicit instruction. This was evident from our quantitative and qualitative analyses. Furthermore, the languages employing more extreme categorisation systems displayed smaller variation in comparison to more moderate systems. Thus, systems that are more informative or more rigid appear to be more efficient. The study implies that the influence of language on cognition may vary across languages, and that not all nominal classification systems employ this optimal trade-off between simplicity and informativeness. These novel data provide a new perspective on the origin and nature of nominal classification.

The World Wide Web has become a common platform for interactive software development. Most web applications feature custom user interfaces used by millions of people every day. Information architecture addresses the structural design of information to build quality web applications with improved usability of content, navigation, and findability. One of the most frequently utilized information architecture methods is card sorting—an affordable, user-centered approach for eliciting and evaluating categories and navigable items. Card sorting facilitates decision-making during the development process based on users' mental models of a given application domain. However, although the qualitative analysis of card sorts has become common practice in information architecture, the quantitative analysis of card sorting is less widely applied. The reason for this gap is that quantitative analysis often requires the use of customized techniques to extract meaningful information for decision-making. To facilitate this process and support the structuring of information, we propose a methodology for the quantitative analysis of card-sorting results in this paper. The suggested approach can be systematically applied to provide clues and support for decisions. These might significantly impact the design and, thus, the final quality of the web application. Therefore, the approach includes proper goodness values that enable comparisons among the results of the methods and techniques used and ensure the suitability of the analyses performed. Two publicly available datasets were used to demonstrate the key issues related to the interpretation of card sorting results and the overall suitability and validity of the proposed methodology. [ABSTRACT FROM AUTHOR]

The study of visual content using qualitative methods currently involves much scholarly work in the field of digital humanities. Documentary films are considered among those objects defined as visual content and are therefore not the focus of most attention within Film Studies. One of the best-known researchers in this area, Bill Nichols, proposed a theoretical classification of six documentary voices that is widely recognized in academic circles. However, the classification is based on induction and intuition which, until now, have not been verified in accordance with the evidence. This study proposes a mixed qualitative and quantitative methodology that allows the authors to surpass Nichols' model and generate a new classification based on empirical criteria. To that end, they study the opinions of users of and experts on Nichols' theory through the card sorting technique borrowed from cognitive science that is based on multivariate statistics. In this way, they generate a hierarchy of formal cinematographic elements grouped into four documentary voices and Nicholas' classification proposal is partly replaced as two of the voices in his model disappear but the four others are confirmed. In addition, this new model allows the authors to determine which formal elements are assigned to each one of the confirmed documentary modes and with what relative weights, thereby opening up the possibility of generating a predictive model. The article therefore demonstrates that cluster analysis and other techniques borrowed from multivariate statistics can be used to empirically and quantitatively verify theories in film studies as well as in other areas such as poetics. This suggests that it is possible to verify empirically and use quantitative models for the study of visual content and complement other methods based on induction and intuition. [ABSTRACT FROM AUTHOR]

Card sorting has been widely used in information architecture to analyze and improve web content and navigation. This is an intuitive and cost-effective technique also useful in user research and evaluation. However, while the implementation of sorting tasks comprises a constructive and easy-toaccomplish process, the quantitative analysis of resulting card-sorting data can be a challenge for non-skilled evaluators. Several tools exist to support sorting tasks and data analysis, but still some users utilize custom spreadsheets or statistical packages in order to enhance analysis and obtain more expressive and comparable results. One of the most utilized diagrams for analyzing card-sorting results is the dendrogram, also known as a tree diagram, which is commonly based on an agglomerative clustering representation depicting groupings of related cards. However, several issues have to be considered by evaluators in order to produce meaningful dendrograms for decisionmaking. In fact, the distance method and the linkage criterion greatly influence the final dendrogram obtained. In this paper, an analysis on distance methods and linkage criteria for obtaining suitable dendrograms is proposed. The main aim is to guide evaluators and usability engineers to produce appropriate dendrograms based on available cardsorting data. In this sense, the provided clues can be widely applied to any card-sorting domain and sample size, improving card-sorting analysis by comparing different solutions through goodness indicators. Analyses applied to a publicly available dataset indicate that the results are highly dependent of the data type, so the right selection of both distance method and linkage criterion is essential for obtaining a suitable dendrogram and correctly interpreting the results. [ABSTRACT FROM AUTHOR]

Context: Code review is a widely used technique of systematic examination of code changes which aims at increasing software quality. Code reviews provide several benefits for the project, including finding bugs, knowledge transfer, and assurance of adherence to project guidelines and coding style. However, code reviews have a major cost: they can delay the merge of the code change, and thus, impact the overall development process. This cost can be even higher if developers do not understand something, i.e., when developers face confusion during the code review. Objective: This paper studies the phenomenon of confusion in code reviews. Understanding confusion is an important starting point to help reducing the cost of code reviews and enhance the effectiveness of this practice, and hence, improve the development process. Method: We conducted two complementary studies. The first one aimed at identifying the reasons for confusion in code reviews, its impacts, and the coping strategies developers use to deal with it. Then, we surveyed developers to identify the most frequently experienced reasons for confusion, and conducted a systematic mapping study of solutions proposed for those reasons in the scientific literature. Results: From the first study, we build a framework with 30 reasons for confusion, 14 impacts, and 13 coping strategies. The results of the systematic mapping study shows 38 articles addressing the most frequent reasons for confusion. From those articles, we found 13 different solutions for confusion proposed in the literature, and five impacts were established related to the most frequent reasons for confusion. Conclusions: Based on the solutions identified in the mapping study, or the lack of them, we propose an actionable guideline for developers on how to cope with confusion during code reviews; we also make several suggestions how tool builders can support code reviews. Additionally, we propose a research agenda for researchers studying code reviews. [ABSTRACT FROM AUTHOR]

Introductory biochemistry courses are often challenging for students because they require the integration of chemistry, biology, physics, math, and physiology knowledge and frameworks to understand and apply a large body of knowledge. This can be complicated by students' persistent misconceptions of fundamental concepts and lack of fluency with the extensive visual and symbolic literacy used in biochemistry. Card sorting tasks and game‐based activities have been used to reveal insights into how students are assimilating, organizing, and structuring disciplinary knowledge, and how they are progressing along a continuum from disciplinary novice to expert. In this study, game‐based activities and card sorting tasks were used to promote and evaluate students' understanding of fundamental structure–function relationships in biochemistry. Our results suggest that while many markers of expertise increased for both the control and intervention groups over the course of the semester, students involved in the intervention activities tended to move further towards expert‐like sorting. This indicates that intentional visual literacy game‐based activities have the ability to build underdeveloped skills in undergraduate students. [ABSTRACT FROM AUTHOR]

Organizational ambidexterity (OA) is an essential capability for organizations in turbulent environments, as it facilitates the simultaneous pursuit of exploitation and exploration. Over the last years, knowledge on OA has continuously matured, covering outcomes, moderators, and types of OA. However, little is known about how to build an ambidextrous organization in terms of what capabilities are needed and how they can be developed. To address this gap, we developed an organizational ambidexterity maturity model (OAMM) that assists organizations in becoming ambidextrous based on actionable practices (APs) structured according to five capability areas. In developing the OAMM, we conducted a structured literature review to compile APs and used card sorting to assign APs to maturity stages. We evaluated the OAMM based on literature-backed design objectives and discussions with practitioners. We also conducted an initial empirical validation of the APs' assignment to maturity stages. The OAMM extends the descriptive and prescriptive knowledge on OA by taking a holistic view on OA, by shedding light on the interrelation of different OA types, and by enabling the assessment of an organization's as-is and to-be OA maturity based on implemented APs. [ABSTRACT FROM AUTHOR]

Grounded on organization of information, this study used card sorting method to investigate female consumers’ preferred classification scheme, and adopted in-depth interview method to identify the organizing rules they lived by. The results of card sorting analysis were able to identified 14 categories of health food package information, and they were price, flavor, award and remarks, product liability insurance, disposal information, research development information, function claims, consumer complaints, production information and logo, nutritional ingredient, advertisement and national certificate, food instructions, manufacturer information, and others. This study found that the consumer-perceived most important food package information were product name, brand name, ingredient information, food additives information, and information on certified functions. It suggests that these five types of information should be prominently displayed in a conspicuous place to enable consumers make rationale and efficient choices. The 14 categories of food package information and their labels resulted from the card sorting experiment may provide a guide as to how the information should be organized and grouped in a way that facilitates making sense of the information. This study may also facilitate consumers to efficiently and accurately locate the information they need when making purchasing decision of health food. (Article content in Chinese with English extended abstract)

Se propone la utilización de metodologías propias de la disciplina de la Arquitectura de la información para mejorar el acceso a los contenidos de los repositorios universitarios o institucionales. Se ha observado que en la mayoría (80%) de los repositorios universitarios se utiliza una implementación por defecto del software DSpace. El hecho de no adecuar la arquitectura del repositorio a las necesidades de la universidad y sus usuarios puede generar una mala experiencia de usuario llegando a generar búsquedas insatisfactorias en una de cada tres interacciones. Este obstáculo en la recuperación de documentos puede evolucionar en una falta de visibilidad de la producción científica de la institución. Por ello se hace una propuesta metodológica para mejorar la arquitectura de los repositorios basada en las técnicas de User Persona y de Card Sorting empleando herramientas gratuitas como Google Forms, y se aplica la metodología a un estudio de caso: el Dipòsit Digital de la UB.

Meeting international emission targets will require major changes in the energy system. This paper addresses the public perception of different pathways to energy transition, and their mental representation in particular. A study is reported that employed card sorting to explore how laypeople categorize possible pathway components with respect to their perceived similarity (Norwegian sample, n = 61; German sample, n = 71). Data sets that were obtained by this method were subjected to multidimensional scaling and cluster analysis. Results for both samples consistently indicate that people differentiate components located at the individual level (e.g., vegetarian food, avoid long flights, walking and cycling), components located at the societal level (e.g., taxes, regulations, urban planning), and components concerned with technological solutions (e.g., hydropower, wind farms, solar panels). These results give reason to assume that laypeople from Norway and Germany share a multifaceted understanding of energy transition, yet some differences between samples were present with regard to the substructure of the individual level category. Future research can build on the present results to explore the subjective meanings of these structures, possibly identifying barriers to public engagement with energy transition.

The ability of Immersive Virtual Reality (IVR) systems to mimic the real world has made it possible to use this technology to create environments for remote collaborative work. This study aimed to understand the feasibility of immersive virtual reality when conducting a collaborative Information Architecture (IA) design task-card sorting, with geographically dispersed participants. Using a between-subjects experimental design, thirty groups of two individuals each completed a card sorting activity using conventional in-person, video screen-sharing method or immersive virtual reality methods. The dependent measures included total time, percentage match with master card set, usability, presence and perceived workload. Overall usability was found to be significantly higher for the immersive virtual reality condition when compared to conventional in-person card sorting. In addition, the new immersive virtual reality technology performed as well as the other two conditions for other dependent variables. Qualitative data from the participants also indicated a positive reaction to the use of immersive virtual reality for this task. Overall, the participants felt they were productive and enjoyed the IVR condition, indicating the potential of IVR-based approaches as an alternative to conventional approaches for IA design. [ABSTRACT FROM AUTHOR]

Pairwise similarity judgments and card sorting methodologies are different ways of generating data for similarity matrices used in various analyses such as multidimensional scaling and cluster analysis. Pairwise similarity judgments are considered the gold standard methodology, but can be cumbersome for large numbers of stimuli given the geometric increase in number of judgments necessary to fill the matrix. Card sorting methods provide a more expedient means of gathering this information, although they typically generate only binary data. Nonetheless, aggregated matrices generated from card sorts approximate pairwise similarity matrices. The current study used pairwise similarity and card sorting results from two existing studies that used the same stimuli to determine the optimal number of participants needed in a card sorting task to approximate the similarity matrix of pairwise data collection. In these studies, approximately 10–15 participants provided optimal estimation of the similarity matrix, with minimal increases for higher numbers of participants. [ABSTRACT FROM AUTHOR]

The article proposes the use of methodologies of the discipline of Information Architecture to improve access to the contents of institutional repositories. It has been observed that in the majority (80%) of the university repositories a default implementation of the DSpace software is used. The fact of not adapting the architecture of the repository to the needs of the university and its users can generate a bad user experience, generating unsatisfactory searches in one of every three interactions. This obstacle in the recovery of documents can evolve in a lack of visibility of the scientific production of the institution. Therefore, a methodological proposal is made to improve the architecture (organization system, mainly) of the repositories based on the techniques of user persona and card sorting using free tools such as Google Forms, and this methodology is applied to a case study: Depósito Digital of the UB. [ABSTRACT FROM AUTHOR]

The goal of this paper is to highlight the benefits of applying card sorting techniques and performance testing for improve digital products. A case study was developed at the Federal University of Amazonas (UFAM) with the creation of the monitoring module in the campus system, aka ecampus. This study was directed with support of the project E methodology (MEURER and SZABLUK, 2012), that was divided in four steps: (1) strategy, (2) scope, structure and skeleton, (3) aesthetics and (4) execution. As result we had a better understanding about the needs of users utilizing classification and labeling. This information allowed us to create a better user experience: a interface that communicates with effectiveness, efficiency and satisfaction. [ABSTRACT FROM AUTHOR]

In 2016, Utah State University (USU) Libraries redesigned the library website's main menu and underlying information architecture (IA) in response to a number of known usability problems and limitations. Card sorting studies were conducted with a group of USU undergraduate students and a mixed group of faculty and graduate students to help develop a better understanding of users' mental models of library-related research and service tasks. Participants worked in teams to sort, rank and label cards pertaining to the content and feature of the library's website. Afterwards, participants discussed and performed usability tasks on each other's categories. Results were used to inform the design of a new IA and menu structure, while best practices from usability studies and trends in academic library website design were used to help with menu and link labeling. The final design was validated through follow-up discussions with staff, usability tests, and category/reverse category tests. [ABSTRACT FROM AUTHOR]

We present a method for visualizing and analyzing card sorting data aiming to develop an in-depth and effective information architecture and navigation structure. One of the well-known clustering techniques for analyzing large data sets is with the k-means algorithm. However, that algorithm has yet to be widely applied to analyzing card sorting data sets to measure the similarity between cards and result displays using multidimensional scaling. The multidimensional scaling, which employs particle dynamics to the error function minimization, is a good candidate to be a computational engine for interactive card sorting data. In this paper, we apply the combination of a similarity matrix, a kmeans algorithm, and multidimensional scaling to cluster and calculate an information architecture from card sorting data sets. We chose card sorting to improve an information architecture. The proposed algorithm handled the overlaps between cards in the card sorting data quite well and displayed the results in a basic layout showing all clusters and card coordinates. For outliers, the algorithm allows grouping of single cards to their closest core clusters. The algorithm handled outliers well choosing cards with the strongest similarities from the similarity matrix. We tested the clustering algorithm on real-world data sets and compared to other techniques. The results generated clear knowledge on relevant usability issues in visualizing information architecture. The identified usability issues point to a need for a more in-depth search of design solutions that are tailored for the targeted group of people who are struggling with complicated visualizing techniques. This study is for people who need support to easily visualize information architecture from data sets. [ABSTRACT FROM AUTHOR]