Search

This study develops and validates an English communicative competence model for Korean high school students, in response to the need to redefine the relevant concepts and components of competence that are demanded by the rapidly evolving future society. Drawing on Celce-Murcia's (2008) theoretical model on communicative competence, this research conceptualized a model that could assess high school students' English communicative competence by examining relevant domestic and international studies as well as theoretical reflections. Expert opinions from a two-stage Delphi survey were compiled and incorporated to revise, supplement, and validate the English communicative competence among high school students reflecting Korea's English education environment. Following this process, the conceptual model for English communicative competence was reorganized into five sub-competences (sociolinguistic, discourse, linguistic, interactional, and strategic competence) and 15 corresponding subfactors. The content validity ratio values for the conceptual definition and factor structure of this model were all above 0.64, thus affirming the validity of the conceptual definition and factor structure.

The predominant conceptualization of scientific literacy occurs on the micro scale of an individual person. However, scientific literacy can also be exhibited at the meso scale by groups of people in communities of place, practice, or interest. What comprises this community level scientific literacy (CSL) is both understudied and undertheorized. In this paper, we utilized a systematic literature review to describe how CSL is characterized in the extant literature and a Delphi survey of experts to elicit more current thought. Guided by cultural-historical activity theory, inductive and deductive analyses produced seven elements of CSL and their constituent characteristics: (1) resources, (2) attributes of those resources, (3) actors, (4) interactions between actors, (5) contexts, (6) topics, and (7) purposes. The typology created through this process is meant to be generative, serving as a starting point for continuing refinement within science education and other fields related to science learning and knowing.

International Online Collaboration Competencies (IOCCs) are considered essential for global virtual teams, yet no consensus exists on what experts consider as IOCCs and which competencies are involved. To develop a framework to support higher education in designing learning tasks and evaluation instruments for the acquisition of IOCCs, a three-round consensus study was conducted among a purposive sample of academic and field experts in international online collaboration. The final IOCCs framework includes a definition of IOC and 34 IOCCs within six competency domains: (1) information and communication technology, (2) international and intercultural, (3) communication and language, (4) collaboration, (5) management and organization, and (6) domain-specific. The framework may be a benchmark for program development for Internationalization of the Curriculum (IoC), evaluation, and continuous professional development. Further research is needed to evaluate how this IOCCs framework can be integrated into higher education settings to teach and evaluate IOCCs.

We report findings from an eDelphi study that aimed to explore 16 expert panelists' perspectives regarding the key attributes of learning experience design (LXD) as it relates to the following: design, disciplines, methods, and theory. Findings suggest consensus was reached regarding LXD's focus on learner-centrism and incorporating human-centered design practices to design learning environments. LXD practitioners adapt methods and theories from fields such as human--computer interaction and user experience. Implications suggest a need to develop specific methods and theories within our own field.

In the 1970s, research on artificial intelligence in education emerged with the aim of acknowledging and accommodating the psychological aspects of the learning process. Since then, its applications have evolved and it is now used for student learning and assessment, teachers' pedagogical practice, management of educational institutions, and lifelong learning. Nevertheless, the ethical challenges of educational programmes using these systems have not been thoroughly studied. Anchored on the theoretical frame of dialogic ethics, this paper presents a section of a participatory futures research project. The goal of the research is to develop a toolkit that educators can use to ensure a smooth and ethical transition to artificial intelligence-based education while preserving the interests of educational development. This paper emphasises the need for an informed and participatory process that involves all stakeholders and begins with an expert consultation through the Delphi method, the results of which allowed the construction of eight hypothetical futures scenarios. These scenarios provide evidence that examining the ethics of using artificial intelligence systems presents an opportunity to reflect on the ethics of education as a whole. They highlight the challenge of balancing the benefits and drawbacks of such systems, especially concerning educational goals and the interplay between diverse educational actors and personal development in educational settings. The study outcomes are intended to encourage discussions on the integration of ethical artificial intelligence in education and facilitate the continuing professional development of teachers by equipping them with scenarios that can be used as a resource for training purposes.

This study aims to determine the effectiveness of the Delphi Technique as an educational planning tool. The authors investigated the perceptions of sixty-two pre-service school administrators who would most likely use the Delphi Technique for educational planning purposes. They were invited to participate in an actual Delphi Technique implementation process before they were asked to provide their responses to the research survey questions. Data collected in the study were carefully examined by coding category and identification of major themes to answer the research questions. The findings of the study have indicated the major strengths and weaknesses of the Delphi Technique. Most research participants agreed that Delphi Technique effectively sought consensus among diverse experts. The limitation of the technique was identified to be tedious and time-consuming. The research participants also recommended to improve Delphi Technique by allowing longer lapse of time between rounds of survey. However, they clarified that Delphi Technique did not fit all educational planning situations. The technique works best in planning situations of seeking for prioritization of possible options.

Using competencies for volunteer organizations and applying those competencies to both situational and servant leadership, the Delphi study method was used to identify leadership competencies necessary for titled leaders within NACADA's Advising Communities Division. Surveys were administered to former and outgoing chairs within the division. Results from 10 experts identified important competencies, including knowledge of the advising community, communication, time management skills, and the ability to conduct meetings. At the end of the chair term, important competencies identified were a deeper knowledge of the advising community; communication; the ability to determine, organize, and prioritize the needs of the advising community; and people management skills. Implications for practice and areas for additional research are discussed.

This article provides a conceptual framework for considering both the theoretical and methodological factors that underpin the successful validation of a competency framework. Drawing on educational assessment literature, this article argues that a valid competency framework relates to an interpretive judgement of the credibility of the claims made. To establish a credible approach to competency framework validation, there is a requirement to align the purposes of the competency framework, the claims developers make concerning the uses of the framework, and evidence collection methods to substantiate or challenge these claims. This article concludes with a template of questions for competency framework developers to consider in determining the range of potential claims to be made concerning their framework, and in understanding competency framework users and contexts.

Internet-of-Things (IoT) research has primarily focused on identifying IoT devices' organizational risks with little attention to consumer perceptions about IoT device risks. The purpose of this study is to understand consumer risk perceptions for personal IoT devices and translate these perceptions into guidance for future research directions. We conduct a sequential, mixed-methods study using multi-panel Delphi and thematic analysis techniques to understand consumer risk perceptions. The results identify four themes focused on data exposure and user experiences within IoT devices. Our thematic analysis also identified several emerging risks associated with the evolution of IoT device functionality and its potential positioning as a resource for malicious actors to conduct security attacks.

Background and Aim: College physical education (CPE) is a Key Stage in the transition from school physical education to national sports. Collaborative governance is an effective new type of social participation, but there is not much research on CPE collaborative governance. The purpose of this study is to describe the interrelationship of multiple subjects in the College Physical Education (CPE) collaborative governance and explore the specific influencing factors that affect the effect of CPE collaborative governance. Materials and Methods: This study uses the Delphi method. A total of 18 experts conducted two rounds of expert consultation questionnaires with the Delphi method and completed the CPE Collaborative Governance Scale. The scale includes four dimensions: Government-led multi-sectoral coordination, CPE internal governance, and external synergy, System design of CPE collaborative governance, and Mechanism construction of CPE collaborative governance. Three criteria for the inclusion of experts have been established, including educational background, professional title, and management experience, ensuring the authority of experts. Results: The theoretical model of CPE collaborative governance constructed shows the interrelationships among multiple subjects of CPE. The four dimensions of collaborative governance in college physical education are government-led multi-sector collaboration, internal governance and external collaboration of CPE, the institutional design of CPE collaborative governance, and the mechanism construction of CPE collaborative governance. The results show that after the expert consultation and verification of the Delphi method, the 4 Indicator Dimensions and 28 Specific Items in the revised CPE collaborative governance Indicator System have significance and reference value for CPE collaborative governance. Conclusion: The relationship between multiple subjects of CPE collaborative governance revealed in this study, as well as the quantified and validated indicators of collaborative governance effectiveness, have certain reference values for CPE to carry out collaborative governance work. CPE managers can use the results of this study to carry out CPE collaborative governance work based on the current situation.

Background and Aim: Over the past three years of the COVID-19 pandemic, both the external sports environment for youth physical exercise and the national education policy landscape have undergone significant changes. In light of these developments and to align with physical education instruction in the next era, ensuring high-quality physical education, and promoting the physical fitness of young individuals, this study aims to construct a physical education instructional model "CISSO" (collaborate, input, school, student, output) to better regulate and optimize the process of physical education learning management and improving the quality of learning management. Methods: This study was future research conducted with phase 1 exploring the problem by reviewing literature and 5 experts through Semi-structured interviews, the PESTEL model, and the SIPOC model to analyze influencing factors, to drat physical education instructional concept model; phase 2 by questionnaires and modified Delphi to construct physical education instructional model "CISSO"; phase 3 connoisseurship to determine and evaluate the rationality of the CISSO model. Results: The CISSO Model contains factors of Collaborate, Input, School, Student, and Output such as: (1) Collaborate: a collaborative educational approach guided by the government, led by schools, and supported by social organizations and families. (2) Input: The key to governing school physical education management is to take more measures to increase comprehensive "Input" in school physical education learning. (3) School: The CISSO model places a significant emphasis on aligning with the Curriculum Standards (2022 Edition), and revolves around key components such as "learning, practicing, competing, and evaluation," resulting in a new and cohesive state of physical education. (4) Student: accentuates the subjectivity of students, with a pronounced focus on fostering their psychological development through sports education, thereby progressively instilling positive exercise routines. (5) Output: It holds the promise of driving improvements in students' physical abilities and fostering a greater sense of contentment among parents with the school's physical education initiatives. Conclusion: By implementing the CISSO model, educators and policymakers can gain a deeper understanding of the intricacies involved in managing physical education during the next era of education. The findings from this study will aid in making informed and wise decisions, enabling the formulation of effective strategies to optimize the learning experience of students in this dynamic educational landscape.

The emergence of generative artificial intelligence (GenAI) text generator tools and the potential challenges for higher education (HE) have characterised informal academic discussion on multiple fora. Specifically examining the case of English medium instruction (EMI) assessment academic integrity, this study sought to explore this conundrum by conceptualising threats and possible recommendations to counter these by creating a problem-solution matrix for key stakeholders considering the scarce academic literature available. An exploratory Delphi technique was employed as a way of generating ideas, gauging expert perspectives, and establishing consensus based on the premise of wisdom-of-(expert)-crowds. In the data collection stage, this new use of the mixed-methods methodology in the field included iterative Delphi questionnaire rounds and concurrent focus group sessions with a panel of 26 international experts. Quantitative and qualitative data were analysed using descriptive statistics and thematic analysis, respectively. The resulting GenAI and EMI Assessment Problem-Solution Matrix is an empirically informed instrument for key stakeholders in EMI HE that exemplifies a range of GenAI-induced issues and recommendations as to how to proceed going forward in EMI HE pedagogical settings. This contributes to the field in line with broader theoretical assessment principles, particularly with those seeking to mitigate inequitable practices. Further contextual matters pertaining to social justice were highlighted, such as the effects of the massification and commodification of HE on the role of assessment in both EMI didactic contexts and others. The findings here take a step towards addressing the gaps identified but also represent a means of sparking much-needed further discussion in both extant literature and praxis.

Foresight studies conducted by the College of Social Work at Assiut University, Egypt, have enabled us to identify key variables that may enhance its strength by 2030. This study presents a conceptual framework based on the methodology and findings of implementing the Matrix of Cross Impacts Multiplication Applied to a Classification (MICMAC) method, aimed at determining significance through degrees of influence and dependence among one another. To attain the objective of this article, Delphi was employed to analyze 42 key variables, which were subsequently organized based on their respective significance. Among the 42 key variables, analysis has been conducted on 17, providing insights into enhancing the competitiveness and future prospects of these colleges. The findings have highlighted the noteworthy influence of variables like technology infrastructure, applied projects, and international cooperation on the robust assessment of the competitive landscape of the College of Social Work. The variables ranked second in terms of their significance impact on enhancing the institutional capacity of this college, encompassing strategic orientation, mobility, teacher, educational programs, student, scientific research, and innovation. Finally, this study serves as the initial step toward developing future scenarios aimed at enhancing the institution's competitive position.

Purpose: To establish a consensus on the complexity of 16 fundamental movement skills (FMS). Initially, complexity was defined as how difficult it would be to teach FMS to children and for the children to learn them. Method: The study was conducted using a modified Delphi method and a mobile application called Move Improve® to showcase video demonstrations of 16 FMS. Six experts discussed and rated the complexity of each FMS using a 5-point Likert scale until a 75% consensus was obtained during three rounds. Result: Dribble was rated as the most complex (average five) and run as the least (average one). The highest percentage of consensus at 100% was obtained for dribble, overhead throw, run, and skip during Round 3. Conclusion: Eye--hand or eye--foot coordination, laterality, and the environment were deemed as the most influential factors when rating the complexity of FMS.

The proportion of pupils with English as an additional language (EAL) has steadily risen in recent years in England, reaching just under one in five of all pupils aged 5-16 in 2021, with a total of over 365 languages spoken between them. Despite educational psychologists' (EPs) practice being concerned with reduction of barriers that prevent children from fully accessing education, a review of the educational psychology literature provides little information to suggest that EPs are responding to the increasing linguistic diversity of their client group. Further, there is a lack of shared understanding among EPs of the specific competencies needed to address the specific language needs of this population. Through a three-round Delphi, 90 statements were identified as key features required for EP practice with EAL students and families; these statements were then structured into a guiding framework for EP practice. The implications of this framework, and its limitations, are discussed.

Information and communications technology (ICT) is now widely used in education. However, the effect of ICT on the development of students' scientific higher-order thinking skills (S-HOTS) is a controversial issue in science education research. This has attracted significant attention from researchers worldwide in the field of educational technology. Purpose: In this study, a novel framework for students' S-HOTS is proposed based on Marzano's new taxonomy to determine the impact of ICT on S-HOTS. And exploring the difference in the impact of ICT on S-HOTS in two different countries. Sample: The data for this study were obtained from the Science Assessment and ICT Familiarity Questionnaire of the PISA 2015 survey for Finnish and Chinese students. This survey measures the differences in economic and educational levels and literacy in each country and tests the knowledge and skills necessary for life in reading, mathematics, and science for students (15 years old), through a detailed pre-testing country field study to make the results comparable across countries. Design and methods: We used the Delphi methodology to determine the framework of S-HOTS and a regression analysis to analyse the effects of ICT on students' S-HOTS. Results: The results demonstrate how the availability, use frequency and use time of ICT affect S-HOTS. Furthermore, we compared the results between China (9841 students) and Finland (2538 students), and these findings demonstrated that ICT use at school has a negative effect on S-HOTS, especially ICT use time in school. We also found that using an interactive whiteboard positively and significantly affects S-HOTS. Conclusion: The results suggest that the effect of ICT use on S-HOTS in school depends on the ICT method combined with the learning process. Consequently, the use of ICT in schools should be viewed dialectically to promote students' S-HOTS.

Inclusive education has brought about a paradigm shift to the traditional roles of an educator and now require educators to accept multifaceted responsibilities to support diverse individualised needs. Even now, Malaysian mainstream and special needs educators continually report that they need better understandings and knowledge to be proficient in supporting inclusive transitions. This study holds that outlining the distinct roles and responsibilities of the educators throughout the inclusive transition process is critical towards increasing their level of knowledge, competencies, and readiness towards inclusion. This study focuses on utilising the Fuzzy Delphi method to reach a consensus on the roles and responsibilities of mainstream and special needs educators that the experts believe are essential towards supporting the first stage of inclusive transition -- the Pre-Transition Stage. The results identify a clearer picture of both educators' responsibilities within the planning and preparation role, classroom environment role, instructions role, and professional duties role that are key for educators in the first stage of transition. It offers a versatile judgement, clearer picture, and better structured insight that can help facilitate enhanced knowledge, competencies, better readiness, and clearer role alignments.

The Van Hiele model of geometric reasoning establishes five levels of development, from level 1 (visual) to level 5 (rigor). Despite the fact that this model has been deeply studied, there are few research works concerning the fifth level. However, there are some works that point out the interest of working with activities at this level to promote the acquisition of previous levels. Our goal is to describe this level through the construction and validation of a list of indicators for each of the processes involved in geometrical reasoning (definition, proof, classification, and identification). Due to the lack of previous research, we have decided to use the Delphi methodology. This approach allowed us to collect information from a panel of experts to reach a consensus through a series of phases about the indicators that describe each of the processes. The final product of the iterative application of this method is a list of validated indicators of the fifth Van Hiele level of reasoning. In particular, proof and definition processes have turned out to be the most relevant processes at this level.

Mathematics education researchers suggest that it is important for teachers to select mathematics tasks that align with their goals for students; however, this can be challenging as there are many facets of alignment to consider. In this article, I present a rubric that details the alignment between tasks and learning goals. This rubric was developed by adapting the Achieve protocol and making modifications based on responses of a Delphi model panel that applied the rubric. I then discuss the use of this rubric with preservice teachers in a course about teaching mathematics with technology and the positive impact it had on their understanding and ability to align tasks and learning goals. I conclude with possible future uses of this rubric for researchers, teachers, and teacher educators.

External validity is an important parameter that needs to be considered for decision making in health research, but no widely accepted measurement tool for the assessment of external validity of randomized controlled trials (RCTs) exists. One of the most limiting factors for creating such a tool is probably the substantial heterogeneity and lack of consensus in this field. The objective of this study was to reach consensus on a definition of external validity and on criteria to assess the external validity of RCTs included in systematic reviews. A three-round online Delphi study was conducted. The development of the Delphi survey was based on findings from a previous systematic review. Potential panelists were identified through a comprehensive web search. Consensus was reached when at least 67% of the panelists agreed to a proposal. Eighty-four panelists from different countries and various disciplines participated in at least one round of this study. Consensus was reached on the definition of external validity ("External validity is the extent to which results of trials provide an acceptable basis for generalization to other circumstances such as variations in populations, settings, interventions, outcomes, or other relevant contextual factors"), and on 14 criteria to assess the external validity of RCTs in systematic reviews. The results of this Delphi study provide a consensus-based reference standard for future tool development. Future research should focus on adapting, pilot testing, and validating these criteria to develop measurement tools for the assessment of external validity.

Higher education institutions pursue three distinct yet interrelated missions of education, knowledge production, and community engagement. Until the last decades of the twentieth century, the third mission, also known as community engagement, has received little attention. Although the third mission generally aims to contribute to the socio-cultural and economic transformations of society, its distinct characteristics are still under-theorized. None of the existing methodological and conceptual frameworks provides a holistic analysis of significant engagement indicators that transcend specific application contexts. Collecting data on university engagement with society and making meaningful interpretations is thus a challenge to researchers and practitioners. To contribute to filling this gap, this modified Delphi study proposes a comprehensive methodological framework of university-society engagements in Africa. The core thesis is that engagement is ubiquitous-university missions and support systems embody it. The framework thus constitutes eight engagement domains aligned with university core functions (teaching, knowledge production, and societal service) and support systems (governance, digitalization, internationalization, partnerships, and sustainability), with 52 items, rating scales, and descriptors. The framework contributes to conceptual and methodological clarity, informs data collection, and interpretations of the different modalities of university engagements. The alignment of engagement domains to university activities and the simplified articulations of the indicators ensure straightforward interpretations and applications of the framework by practitioners and researchers. It is also significant as it comes at a time when universities are expected to contribute more directly and significantly to the realizations of the UN 2030 SDGs and the African Union 2063 centennial development ambitions.

There is a rising recognition of the crucial role self-care plays in managing heart failure (HF). Yet patients often have difficulties implementing ongoing self-care recommendations into their daily lives. There is also recognition of the importance of theory for successful intervention design, and understanding of key factors for implementation so interventions fit a given context. Local key stakeholders can provide valuable insights to help understand relevant context-specific factors for intervention implementation. This study sought to engage stakeholders to explore and determine relevant contextual factors needed to design and facilitate successful implementation of an HF self-care intervention in the German health care system. A ranking-type Delphi approach was used to establish consensus from stakeholders (i.e., clinicians, patients, policymakers/potential funders) regarding eight factors (content, interventionist, target group, location, mode of delivery, intensity, duration, and format) to adequately define the components and implementation strategy of the intervention. Seventeen participants were invited to participate in the first Delphi round. A response rate of 94% (16/17) was achieved and maintained for all three Delphi rounds. Stakeholder consensus determined that nurses specializing in HF are the most appropriate interventionists, target groups should include patients and carers, and the intervention should occur in an outpatient HF clinic, be a mixture of group and individual training sessions, and last for 30 minutes. Sessions should take place more frequently in the beginning and less often over time. Local stakeholders can help determine contextual factors that must be taken into account for successful delivery of an intervention. This enables the intervention to be developed and applied based on these factors, to make it suitable for the target context and to enhance participation to achieve the desired outcomes.

This paper conducts Group Delphi-study and foresight approach within a five-year horizon in the field of digital education, with a specific focus on Continuing Education (CE) in a post-pandemic society. The study examines the impact of increasing digitalisation on the significant population of low-qualified individuals (approximately five million in Germany). The project identifies both opportunities and risks associated with digitalisation in CE for the low-qualified. The study focuses on 1) the impact of digitalisation on the participation of low-qualified people in CE, 2) the impact of accelerated digitalisation on the planning of programmes and services for this target group, 3) the transformation of programmes and services for low-qualified people due to digitalisation, and 4) methodological innovations for predicting the impact of digitalisation in the CE sector.

As part of a 5-year study to develop and validate an instrument for measuring success in long-standing community-based participatory research (CBPR) partnerships, we utilized the Delphi method with a panel of 16 community and academic CBPR experts to assess face and content validity of the instrument's broad concepts of success and measurement items. In addition to incorporating quantitative and qualitative feedback from two online surveys, we included a 2-day face-to-face meeting with the Expert Panel to invite open discussion and diversity of opinion in line with the CBPR principles framing and guiding the study. The face-to-face meeting allowed experts to review the survey data (with maintained anonymity), convey their perspectives, and offer interpretations that were untapped in the online surveys. Using a CBPR approach facilitated a synergistic process that moved above and beyond the consensus achieved in the initial Delphi rounds, to enhance the Delphi technique and the development of items in the instrument.

This study aimed to obtain consensus on physical activity (PA) and sedentary behaviour (SB) policy items for use in Canadian childcare settings. Purposeful sampling of Canadian experts in PA/SB (n = 19) and Early Childhood Education (ECE; n = 20) was used to form two distinct (i.e., PA/SB and ECE) panels for a 3-round Delphi study. In round 1, the PA/SB experts suggested their top 10 items for a Canadian childcare PA/SB policy. Policy items were then pooled to generate a list of 24 unique items. In round 2, experts in both panels rated the importance of the 24 policy items using a 7-point Likert scale (i.e., 1 = "Not at all important" to 7 = "Extremely important"). The ECE panel was also asked to report on the feasibility of the policy items using a 4-point Likert scale (i.e., 1 = "Not at all feasible" to 4 = "Very feasible"). Policy items that received an interquartile deviation (IQD) score of [less than or equal to] 1 (indicating consensus) and a median score of [greater than or equal to] 6 (indicating importance) in both panels were considered shared priorities. In round 3, members of both panels re-rated the importance of the policy items that did not achieve consensus among their respective panel in round 2 and were asked to order items based on importance. Descriptive statistics were used to assess feasibility of policy items, and differences in panel ratings were quantified using Mann Whitney U tests. Consensus was achieved for 23 policy items in the PA/SB panel and 17 items in the ECE panel. Overall, 15 shared priorities were identified (e.g., provide 120 min of outdoor time per day, sedentary behaviour should not be used as a punishment), and six policy items exhibited a statistical difference in ratings across panels. Members of the ECE panel indicated that the policy item, "children should be permitted to go outside whenever they want, for as long as they want" (M = 1.78; SD = 0.65) was lowest in terms of feasibility, and the policy item, "children should receive opportunities to engage in both unstructured and structured physical activity opportunities daily" (M = 3.89; SD = 0.32) was the most feasible for daily implementation. Findings from this study can inform the development of an expert-generated and feasibility-informed institutional PA/SB policy for use in Canadian childcare settings.

The flexibility of the Delphi Technique has enabled its application across a wide range of fields to facilitate problem solving, decision-making and consensus-building. However, flexibility brings with it a corresponding lack of detailed methodological guidelines, and the rigour of Delphi studies has been questioned. This paper presents a recent study investigating global competence in Japan to demonstrate how Q-methodology can be integrated into a Delphi study to improve rigour. Using Q-methodology helps to mitigate potential problems associated with (a) consensus parameters and focus, (b) panel retention rates, and (c) feedback design.

Inevitable and constant change is challenging school systems worldwide, and COVID-19 has further intensified the debate on the future. This article examines the possible futures of Finnish comprehensive schools through three scenarios generated by analysing data from a Delphi panel of 30 Finnish experts in the field of education. This study contributes to two major intertwining debates: first, who or what determines the content and goals of the curriculum. The study's theoretical framework builds on the curriculum as a social practice model, which views curriculum work as interwoven layers and sites of practice. Another topical debate concerns the tension between powerful knowledge and competences in the curricula. This is explored through Young and Muller's model of three types of knowledge: knowledge of power, tacit knowledge and powerful knowledge. The results show that Finnish comprehensive schools have various substantially divergent trends. In the three scenarios, the role of the teacher as a curriculum maker varies from non-existent to a strong interpreter. International policy flows can be transferred to schools to varying degrees. The three types of knowledge included in Young and Muller's model can be recognised in the three scenarios. Competences can be identified as learning outcomes in all scenarios, but the intensity varies. Scenarios are not predictions of the future or policy recommendations but an efficient tool for provoking strategic debate, generating new visionary thinking and considering the need for system-wide change in education.

Stress among teachers is a debilitating issue that has been plaguing the educational landscape in Malaysia for a long time. Past studies have investigated this issue, and most studies focused on identifying the causes of stress among teachers. However, recent studies have looked at stress as a process that involves a threat (stressors), an appraisal and defence mechanism against the threat (coping mechanism) and the breakdown of the defence (effect). Therefore, it is essential to look at teachers' stress from these three angles. This study aims to introduce a new stress index for Malaysian teachers that seeks to identify teachers' stressors, coping mechanisms and effects of stress. The Fuzzy Delphi method was employed in constructing the stress index as this method used both experts' opinions and analytics that produced an index with high validity and reliability. A proposed stress index with 101 items was evaluated by a panel of experts from linguistics medicine, psychology, linguistics and counselling. Their inputs were then analysed using the Fuzzy Delphi method. The items were then refined with experts' consultation. Furthermore, the finalised stress index proposed a new indicator of stressor, financial problem, an indicator absent in the previously developed stress index. This study has shown the effectiveness of using the Fuzzy Delphi method in developing a new stress index to help teachers, school administrators, and the Ministry of Education understand teacher stress in Malaysia.

An understanding of the theoretical basis of the design learning process, and the resulting partnership between students and teachers in contemporary design studios, is required to optimise learning. Students' learning in the architecture design studio has been widely studied, however the specific activities of students and teachers, and the interpersonal interactions between them, have not been investigated in great depth. This research identifies a complex, nuanced situation, one with three consecutive phases of different learning activities and relationships. An undergraduate architecture program at a large Australian university is analysed using a modified Delphi method to investigate the perceptions of staff and students and achieve convergence upon a shared understanding of how the design learning process unfolds through three distinct phases to support learning.

Distracted users can fail to correctly distinguish the differences between legitimate and malicious emails or search engine results. Mobile phone users can have a more challenging time identifying malicious content due to the smaller screen size and the limited security features in mobile phone applications. Thus, the main goal of this research study was to design, develop, and validate a set of field experiments to assess user's judgment when exposed to two types of simulated social engineering attacks: phishing and Potentially Malicious Search Engine Results (PMSER), based on the interaction of the environment (distracting vs. non-distracting) and type of device used (mobile vs. computer). In this paper, we provide the results from the Delphi methodology research we conducted using an expert panel consisting of 28 cybersecurity Subject Matter Experts (SMEs) who participated, out of 60 cybersecurity experts invited. Half of the SMEs were with over 10 years of experience in cybersecurity, the rest around five years. SMEs were asked to validate two sets of experimental tasks (phishing & PMSER) as specified in RQ1. The SMEs were then asked to identify physical and Audio/Visual (A/V) environmental factors for distracting and non-distracting environments. About 50% of the SMEs found that an airport was the most distracting environment for mobile phone and computer users. About 35.7% of the SMEs also found that a home environment was the least distracting environment for users, with an office setting coming into a close second place. About 67.9% of the SMEs chose "all" for the most distracting A/V distraction level, which included continuous background noise, visual distractions, and distracting/loud music. About 46.4% of the SMEs chose "all" for the least distracting A/V level, including a quiet environment, relaxing background music, and no visual distractions. The SMEs were then asked to evaluate a randomization table. This was important for RQ2 to set up the eight experimental protocols to maintain the validity of the proposed experiment. About 89.3% indicated a strong consensus that we should keep the randomization as it is. The SMEs were also asked whether we should keep, revise, or replace the number of questions for each mini-IQ test to three questions each. About 75% of the SMEs responded that we should keep the number of mini-IQ questions to three. Finally, the SMEs were asked to evaluate the proposed procedures for the pilot testing and experimental research phases conducted in the future. About 96.4% of the SMEs selected to keep the first pilot testing procedure. For second and third pilot testing procedures, the SMEs responded with an 89.3% strong consensus to keep the procedures. For the first experimental procedure, a strong consensus of 92.9% of the SMEs recommended keeping the procedure. Finally, for the third experimental procedure, there was an 85.7% majority to keep the procedure. The expert panel was used to validate the proposed experimental procedures and recommended adjustments. The conclusions, study limitations, and recommendations for future research are discussed.

Student outcomes depend on the implementation of intervention practice elements, which are the specific behaviors that front-line implementers deliver as part of their direct interactions with students. Tier 1 PBIS is a well established practice in schools but existing guidance on practice elements is often conflated with guidance on organizational systems that support implementation. The goal of this study was to distill the specific practice elements of Tier 1 PBIS from the established core features using an expert consensus process. A panel of nine Tier 1 PBIS research and practice experts participated in three iterative rounds of information gathering and feedback within an electronic Delphi study that structured the consensus-building process. The expert panel reached consensus by distilling Tier 1 PBIS into 16 distinct practice elements organized into five thematic domains. The thematic domains from the present study align with existing literature on core Tier 1 PBIS features but the practices in each domain clearly define the specific, expected actions of frontline implementers. Implications are discussed in terms of how the identified practice elements may be used to inform intervention fidelity monitoring and targeted implementation supports for front-line implementers.

The identification and understanding of essential roles and functions in a profession, through the application of job analysis methods, can serve as a guide to develop and hone professional competency. The last such analysis of accessibility services administrators in postsecondary education was published in 1997. A variety of changes in the field over the past 25 years warrant an updated examination of these duties. This study presents the results of a Delphi study conducted with 18 experts in postsecondary accessibility services. They were asked to review and rate the prior job duties as well as an array of duties reflected in the current professional literature. The study resulted in a set of accessibility administrator responsibilities that can be used to guide job activities and professional development going forward.

The objective of this research was to develop an educational sustainability assessment model using the Delphi technique. The research participants were an expert panel and stakeholders of educational projects. The research instruments consisted of an open-ended questionnaire and assessment forms. The frequencies, medians, quartile deviations, means and standard deviations of the data were analysed. The research results found that the assessment framework for educational sustainability in the first round consisted of the following indicators: pre-conduct, process conduct, post-conduct and the criteria consisted of the possible opportunities in sustainability (for pre-conduct and process conduct) and true sustainability (for post-conduct). The second round of assessment indicators and criteria were high, and in the third round they were very high. A pilot study of the feasibility of sustainability (pre-conduct) found that this project had the opportunity to achieve sustainability at the highest level and all model assessment standards were at the highest level.

The influence of digital technology and sociocultural adaptation is currently quickly changing society. Understanding the disparities between generations was necessary for moving on to the next generation together. The purposes of this research were to 1) study patterns of improving the quality of life of the elderly in different family styles, and 2) develop a curriculum of self-awareness in bringing the parenting skills of the aging population to early childhood using contemplative education. Data were collected by using questionnaires from 285 elderly northeast people in one province of Thailand, semi-structured interviews conducted with 22 elderly people. The curriculum of self-awareness used Delphi technique to assess its the appropriateness. Six key attributes were reported in learning participation, acceptance of original experiences, self-guided learning, critical thinking, action, and reflection. Elderly needed self-development for applying knowledge and skills to correct actual parenting situations.

The concept of "sustainable development" was proposed to re-examine the human development model. Initiated by the United Nations, education for sustainable development (ESD) has become an important tool for educators to achieve sustainable development. Although "Early Childhood Education" (ECE) is often taken as a starting point of ESD, the concept of sustainable development is difficult to integrate into ECE because of its unfamiliarity among teachers. Therefore, picture books can be used to bolster ESD in ECE. This research aims to construct an appropriate book selection guide system that can assist them in selecting picture books independently, objectively, and efficiently through a focus group and modified Delphi method. The guide system is based on three major aspects, covering 8 main guidelines and 21 sub-guidelines. A sustainable development-oriented picture book is defined as "a book that includes the core, values, and concept of sustainable development which can make readers aware of the balance between the environment, society and economy and that attempts to systematically explore problems, generate actions, and solve problems in relation to these three dimensions from a critical and global viewpoint." in this study.

As journal editors play an important role in defining and shaping academic discourse, knowing their opinions could likely prove beneficial for both current and future academic journal stakeholders. Within this vein, this study used the Delphi method to help build a profile on the trends and priorities within educational technology, from the unique perspective of the journals' editors-in-chief. This expert panel--initially built from 117 national and international research journals--concluded with 25 editors-in-chief who finished all three rounds of the survey. Results indicated five emerging themes for trends and priorities: computer-focused, teaching and learning, online and digital education, societal, and research and theory. By exploring these current trends and priorities within educational technology, this study may provide meaningful insights to better understand the field as a whole and may also help scholars in their goal of publishing relevant, high-quality academic scholarship.

Increasing age that helps everyone will lead to the elderly group being vulnerable to various activities because of the decline in physiological functions. On the other hand, the elderly have to be able to survive. In addition to the psychological aspects, aspects of muscle, cardiovascular, balance, and mobility are essential factors to support the body's work. Measurements in this study using Delphi Technique towards a psychological-based physical exercise education model to improve physical fitness. The majority of validity tests are more significant than critical 0.30, so the Delphi technique is valid. In the reliability test, the calculated values of Cronbach's Alpha were 0.889 and 0.741, indicating that various questions about the use of the Delphi technique were reliable or consistent. It can be concluded that applied Delphi Technique as a psychological-based physical exercise education model to improve physical fitness for the elderly stated valid and reliable.

The success of a school depends on student outcome which can be measured based on three main aspects, namely academic, co-curriculum and personality. The ineffectiveness of programs organized by schools to cultivate good values among students has led to the need for certain efficient and systematic mechanisms to be established to assess the current level of student outcomes. Therefore, this study aimed to get expert views and consensus on the indicator of student outcome based on "Ibn Miskawayh"'s theory in the mission of shaping students according to the true Islamic practices. This research employed the Fuzzy Delphi technique utilizing a 7 Likert scale to accumulate answers of 15 experts in different areas of education at public universities and government sectors in Malaysia. A total of 54 item survey was given to experts for evaluation. The Fuzzy Delphi technique was used for statistical analysis. Data were analyzed using a triangular fuzzy numbers and the ranking of each variable was determined using the 'defuzzification' process. The findings showed that response and expert consensus on the factors that lead to academic dishonesty was at a good level. The general findings of the expert consensus exceeded 75%, the overall value of the threshold (d) <0.2 and [alpha]-cut exceeded 0.05. The priority factors were sorted and refined by adding and dropping items as recommended by the experts.

The purpose of this study was to conduct a needs analysis concerning the future of curriculum development in education. A mixed-methods study was conducted with a sequential exploratory research design, where the qualitative data were collected first followed by the quantitative data. As a needs analysis was undertaken in this research, the Delphi technique, one of the techniques for determining needs, was employed in this study. In the first stage of the three-stage Delphi technique, an open-ended question was directed to curriculum development experts. The qualitative data were analyzed using a content analysis method under four themes, Design, Development, Implementation, and Evaluation. In the second stage, a questionnaire was prepared based on the resultant findings and experts were asked whether they agreed with the questionnaire items. After analyzing the questionnaire data using central tendency measures, the second stage was initiated to determine whether there were differences in their views regarding the same questionnaire items. As a result of these procedures, first, the views of experts were obtained on the future of curriculum development and then the quantitative data were collected. Finally, the collected data were analyzed together. Under the design stage of curriculum development, the study findings suggested creating curriculum drafts based on the needs analyses, skills, and abilities and ensuring their suitability to digital platforms. Under the development stage, the results suggested preparing curriculum with interdisciplinary approaches that value student-centered practices, skills, values, and activities. The implementation stage included inclination towards practices such as creating digital content and guiding towards social accountability projects that eliminate the disadvantages of distance education. Lastly, the evaluation stage included effective use of digital platforms, taking safety precautions, and providing counselling services.

In UK Higher Education (HE), there is a growing awareness that wellbeing is central to student experience. Increasingly, HE agendas are promoting a targeted holistic institutional approach to wellbeing that supports students thrive in and beyond the student journey. This study positions students as experts of the student experience. Through student voice, the study explores teacher education students' experiences as a product of the synergistic effects of wellbeing and eco-systemic factors related to remote learning. In turn, findings feed into programme and practice developments that support positive student wellbeing. A conventional Delphi Method was used for its effectiveness addressing four different conditions: (1) accessing geographically dispersed populations; (2) overcoming unequal power dynamics; (3) supporting structured communication between experts on a topic leading to consensus building and decision making; and (4) engaging students as co-producers of practice to support positive wellbeing. Our findings provide new insight into the multiplicity of factors that interact with student wellbeing to benefit, challenge, or threaten student experience and the coping resources teacher education students rely on to maintain their education trajectories. These insights provide valuable understanding informing future teacher education programming and practice.

In this study, the Maker Competency Instrument (MCI) was developed to diagnose the level of Maker Competence of elementary and secondary students in South Korea. First, in this study, a draft of the test tool was adapted based on the Maker Competency Model developed as part of Yoon et al.'s research (2018). Then, two expert-level Delphi surveys examined the content validity of the MCI. To verify the construct's validity, the exploratory factor analysis and the confirmatory factor analysis were conducted in two separate stages with the involvement of both teachers and professional Makers. As a result, it was confirmed by the MCI that 6 higher-order factors (Making mind, Making practice, collaboration, visual thinking, human-orientation, integrated thinking), 19 lower-order factors (observation, sense of challenge, interest in various areas, pleasure of the making process, understanding programming, understanding electricity, information searching, direct execution, understanding production tools, planning, hand knowledge, conflict management, communication, sharing, visual thinking and insight, humanity, user-oriented, analytical thinking, intuitive thinking), and 57 items were reasonable. From the outcome of this paper, it can be deduced that the MCI can be used from elementary to secondary school due to its proven reliability and validity.

This study explores the environmental factors that affect the transfer of training among technical education instructors in Nepal. In the exploration, a scale with 40 items was constructed by utilizing Delphi technique. Then, a survey was carried out on 251 instructors who completed instructional skills-related training. The result of Exploratory Factor Analysis (EFA) retained 26 items and showed six factors affecting the perceived transfer of training accounting for 58.8% of the total variance explained which are: (i) organizational transfer intervention, (ii) external monitoring and evaluation (M&E), (iii) local school governance, (iv) management support, (v) social support and, (vi) curriculum standard. Further using Confirmatory Factor Analysis (CFA), the study confirmed the model-fit of three constructs that affect training transfer: organizational transfer intervention, external M&E, and social support. The study concluded that the training transfer is affected by internal and external environmental factors, which are represented by two major driving forces of support and control.

The focus of this study was to develop standards that can be used for establishing and assessing high-quality postsecondary trade and industrial programs. A four-round Delphi technique was used to generate consensus regarding program standards. The panel of experts, comprised of postsecondary administrators of trade and industrial programs, was used to determine which program standards should guide the development and assessment of high-quality trade and industrial education programs. The result was a list of 17 standards and descriptions. The standards included Academic Integration, Advisory Committee, Curriculum, Employer Feedback, Faculty Qualifications, Meaningful Employment, Placement Rates, Program Design, Program Review, Safety, Soft Skills, Student Achievement of Industry Credentials, Student Assessment, Student Advancement, Student Remediation, and Tools and Equipment. Postsecondary administrators can use the results to develop and assess existing programs, as well as to guide the design of new programs that meet industry labor needs.

The purpose of this study was to conceptualize a pedagogical content knowledge framework for informal science educators (ISE-PCK). An initial, hypothetical framework was created grounded in the literature in informal science education (ISE) as analogous to PCK models in formal science education. An exploratory sequential mixed-methods research design was used to revise, refine, and validate the initial framework. Data were collected through interviews and Delphi method surveys with practicing ISE educators and education researchers. The refined and validated ISE-PCK framework comprised five, correlated constituent components: knowledge of ISE goals, knowledge of ISE programs, knowledge of context(s) of audience(s), knowledge of engagement strategies, and knowledge of evaluation. Of these five components, knowledge of engagement strategies was considered the most important and knowledge of evaluation was considered the least important, as ranked by the Delphi study participants. Articulation of a framework for ISE-PCK is useful to professionalize the important work that ISE educators do as well as to provide guidance for professional development programs. This framework for ISE-PCK will serve as a conceptual foundation for future research focusing on informal science educators' knowledge in relation to their performance and their professional growth from novice to expert.

Due to the diversity of steps to be followed in program evaluation and knowledge, skills, qualification and competency requirements, the evaluation should be a field of expertise similar to other disciplines. Thus, it is important to consider program evaluation as a field of expertise and to determine the required competencies. This study aimed to determine the competencies of program evaluation experts based on the views of curriculum and instruction experts. A Delphi study was carried out with 23 participants in the first round and each was selected via the purposive sampling method. In the first round of the Delphi study, the open-ended questions were sent to the participants and qualitative data were analyzed with content analysis. At the end of the first round, a 5-point Likert-type questionnaire with 82 items was developed. In the second round, participants were asked to answer questions and also the views of the participants on main and sub-themes and their comments on these concepts were analyzed. In the third round, participants were asked to reevaluate their responses. The study was finalized with an 82 itemed-questionnaire under four main themes: "theoretical professional competencies of program evaluation experts", "practical professional competencies of program evaluation experts", "professional values that program evaluation experts should have", "professional skills that program evaluation experts should have".

Career literacy is a concept that is often misunderstood, yet it is something that can be developed to enhance youth's potential for career readiness and career growth. This study sought to determine the knowledge and skills required for career literacy and to identify the optimal time to acquire these skills. A four-round Delphi study was designed and implemented to determine such skills and the ideal corresponding time of acquisition for each. The research indicated a final list of 50 skills and knowledge, all of which fall under the categories of functional, interactive, and critical skills a student needs to be able to read, understand, and make decisions on career-related information. These skills and knowledge can be used not only to inform stakeholders what to infuse into existing curricula, but also to identify the optimal time of introduction into a student's educational career.

(International) research collaboration (IRC) is considered one of the most important aspects of academic careers and, although it is often linked to co-authorship, investigations of academic perceptions and practices are rare. Reflections on factors affecting IRC, as well as effective technology for use in IRC are also now particularly vital, due to the outbreak of COVID-19. The aim of this three-round Delphi study, conducted prior to the pandemic, was to explore why and how academics conduct IRC in the field of Education. The results indicate that the benefits of IRC are more relevant than the barriers, and that networking with and learning from others are two of the most important reasons for conducting IRC. Four stages of IRC were identified, alongside a range of influencing factors, which could inform future project management training. Suggestions for institutional IRC policy are provided, as well as considerations for early career researchers.

This paper presents mixed-method research on teaching vocabulary online using a combination of quantitative (bibliometric approach) and qualitative (expert evaluation based on Delphi technique) methods to answer three research questions: Which tools in teaching language with technology have been described in research publications? Which tools are frequently addressed in EFL Methodology course in Ukrainian universities for teaching vocabulary online? Which tools and methods require more information for teaching vocabulary online? To answer the first research question, the authors have used a bibliometric approach to analyse the topic-related articles in the eight most relevant journals from the Scopus Database between 2011 and 2020. The authors have encountered few literature review articles tracking the developments in this research area and no articles using bibliometric methods or science maps. After finalising and structuring the bibliometric analysis data, the authors have used the Delphi method with the British Council experts who were involved in the New Generation School Teacher Project. The experts who are EFL Methodology teachers at 7 Ukrainian Universities have shared their experience in using the tools identified by the bibliometric analysis and listed the usability precedency and hurdles with their recommendations. The experts assisted in answering the research questions about the tools addressed in the EFL methodology course and those that require some consideration. As a result, the findings are collated and shared with EFL teachers, and they can gain valuable insights into the current state of the research and practice in this area. In the discussion part, the authors familiarise EFL teachers with the newest resources that provide information about the understudied areas.