Search

This study aims to develop a valid and reliable scale for determining the self-efficacy of teachers toward context-based science education. This study employed a survey design. The sample has formed 433 science teachers working in Kayseri province in the 2020-2021 spring semester. Firstly, an item pool of 85 items was developed by reviewing the literature. Secondly, a five-point Likert-type draft scale consisting of 67 items was developed. Required arrangements have been performed according to expert opinions to provide content validity. Explanatory and confirmatory factor analyses have been run to provide construct validity. As a result of explanatory factor analysis, a structure with four factors as "Learning/Teaching Process", "Self-efficacy Resources", "Academic Self-efficacy" and "Planning Instruction" consisting of 47 items has been reached. Factors have been confirmed by confirmatory factor analysis. Cronbach Alpha internal consistency coefficient has been calculated as 0.98. To provide criterion validity, the Pearson correlation coefficient has been found as 0.86 between the draft and criteria scales. Based on the findings, researchers have determined that the scale was valid and reliable, and they recommended that this scale should be used to determine self-efficacy beliefs towards context-based learning of science teachers.

School leadership research literature has a large number of widely used constructs. Could fewer constructs bring more clarity? This study evaluates construct content validity, defined as the extent to which a measure's items reflect a theoretical content domain, in school leadership literature. To do so, we reviewed 29 articles that used Teaching and Learning International Survey (TALIS) as data sources to study school leadership, and developed a construct co-occurrence network in which nodes represented constructs in the 29 reviewed articles and ties connected a pair of constructs that used the same TALIS survey items. Among the 82 constructs, 43 constructs had overlapping measures with one another in the TALIS literature on school leadership. Results of network analysis suggest three problematic issues with constructs of TALIS literature on school leadership: (1) same measures for different constructs, (2) different measures for the same constructs, and (3) missing alignment between theoretical and operational definitions. To strive for construct clarity, we provide four recommendations for future research: (1) efforts to prevent construct proliferation, (2) alignment of theoretical and operational definitions, (3) rigorous evaluation of construct validity, and (4) following a fundamental principle of parsimony.

School readiness assessments in South Africa still predominantly focus on the assessment of cognitive skills. The Emotional Social Screening Tool for School Readiness (E3SR) was developed to bridge the perceived gap in assessing emotional-social skills as a domain of school readiness. An emerging body of research reports exists on the psychometric properties and factor structure of the E3SR. An initial validation study recommended a 6-factor solution instead of the theoretical 9-factor model that was proposed in the development of the E3SR. The E3SR (Revised) was also reduced in length. We report here on a pilot study of which the aim was to establish the reliability and construct validity of the E3SR (Revised). A cross-sectional survey design was used to gather data from 9 pre-schools in Cape Town, South Africa. Pre-school teachers (n = 24) constituted the respondent group who completed the E3SR (Revised) screening questionnaires on Grade R learners (n = 394). Analysis was conducted on 321 completed screening questionnaires. With the data analysis we aimed to: a) summarise sample characteristics of teachers and children; b) establish reliability estimates; and c) establish construct validity and confirming the factor structure. Ethics clearance was given by the Humanities and Social Science Research Ethics Committee (HSSREC) of the University of the Western Cape. The study adhered to stipulated ethics requirements. Data failed to show multivariate normality; however, this violation of normality was expected and was theoretically supported. The sample size (n = 321) was sufficient for factor analysis of a 36-item scale. All subscales showed excellent reliability: Cronbach's alphas ranged between 0.939 and 0.971. CFA results demonstrated a good model fit. The E3SR (Revised) was found to be reliable and valid for use. The use of a rigorous methodological process including the decision-making matrix represent good research practice that can be used in instrument development across cultures.

The volunteer function inventory (VFI) is an assessment tool to measure individual volunteer motivation. VFI measures individual motivation to volunteer by examining the functional motives of each volunteer. This research aimed to adapt the VFI to the Indonesian language. VFI consists of 30 items divided into five dimensions. This study utilized a non-experimental quantitative research method. Samples were acquired by accidental random sampling with N = 176. In this study, reliability testing was carried out with items and dimensions of Cronbach's [alpha]. Validity tests were examined using construct validity and item analysis. The results of the Indonesian version of VFI showed high reliability and validity. Besides, the item analysis also shows that the quality of each item is excellent. The Indonesian version of VFI will be suitable for various education fields in Indonesia to measure the students' voluntary willingness in community development activities, for example, in measuring the impact of volunteerism in the Merdeka Belajar Kampus Merdeka (MBKM) social activities and other activities within the communities.

The purpose of this synthesis study was to assess the reliability and validity of the Draw-A-Scientist Test (DAST) and its variations across multiple studies, aiming to understand limitations and propose modifications for future application within and beyond the science domain. Given the existence of multiple DAST versions, this study quantified the frequency of validity threats across various DAST variations. Literature review results indicated that despite its widespread use, the DAST and its variations consistently encounter challenges related to construct validity and external validity. Additionally, this synthesis identified literature limitations in testing concurrent validity, predictive validity, and inter-rater reliability when applicable.

Science education is a key area of research, largely due to its inherent complexity and challenges. Various teaching methods have been developed to address these difficulties, which include the consensus classroom climate. However, no standardized tool has been created to evaluate the consensus within a classroom. This study aimed to develop and validate the Consensus Classroom Climate Inventory (CCCI), an instrument designed to measure the consensus climate of a classroom. The research was conducted in two phases: (1) initial item pool development based on an extensive literature review and (2) expert panel review for content validation. The resulting 29-item scale was pilot-tested with 120 freshmen students from a state university. Exploratory factor analysis using SMART-PLS yielded four distinct factors: Student Agency, Collaborative Learning Environment, Inclusive and Flexible Learning, and Student Autonomy. The final scale consisted of 23 items. Confirmatory factor analysis demonstrated strong factor loadings (>0.8) for all items, indicating good construct validity. Model fit indices suggested a generally good fit, though some indices indicated room for improvement. Reliability analysis revealed high internal consistency across all factors. The CCCI shows promise as a reliable and valid tool for assessing consensus classroom climate, though further refinement is recommended to enhance model fit. This instrument can assist educators in evaluating the consensus climate of Science classrooms and help educators enhance teaching to improve students' Science learning.

The procedures of carrying out factorial invariance to validate a construct were well developed to ensure the reliability of the construct that can be used across groups for comparison and analysis, yet mainly restricted to the frequentist approach. This motivates an update to incorporate the growing Bayesian approach for carrying out the Bayesian factorial invariance, as well as the frequentist approach, using the recent add-on R packages to show the procedures systematically for testing measurement equivalence via multigroup confirmatory factor analysis. The practical procedure and guidelines for carrying out factorial invariance under MCFA using a classic empirical example are demonstrated. Comparison between the frequentist and the Bayesian procedures and demonstration using priors are another two nuclei of the paper.

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential. This investigation involved a rigorous process including expert involvement to ensure content validity, as well as the application of statistical tests for assessing internal consistency and reliability. Factor analysis also revealed two significant domains, "Quality of Content" and "Quality of Expression", which further enhanced the construct validity of the evaluation scale. The results from this investigation robustly affirm the reliability and validity of the developed rubric, thus marking a significant advancement in the sphere of AI chatbot performance evaluation within educational contexts. Nonetheless, the study simultaneously emphasizes the requirement for additional validation research, specifically those entailing a variety of tasks and diverse AI chatbots, to further corroborate these findings. The ramifications of this research are profound, offering both researchers and practitioners engaged in chatbot development and evaluation a comprehensive and validated framework for the assessment of chatbot performance.

Engineering education aims to equip children with the skills to solve and apply complex problems. Problem-solving processes in engineering require high-level thinking and mind habits. Habit is a term used to describe various aspects of intelligence. Engineering habits of mind are the values, attitudes, and thinking skills associated with engineering. This research aimed to develop a scale to assess the engineering habits of mind of children ages 5-8. The study involved 417 children in two provinces in the southwest and northwest of Türkiye. We performed Explanatory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) for the scale's construct validity. The scale consisted of 35 items and six factors and explained 59.2% of the total variance. We called the factors "system thinking," "creativity," "optimism," "collaboration," "communication," and "attention to ethical considerations." According to the CFA result, the construct we obtain is reasonable (X[superscript 2]/sd= 1.97, RMSEA= 0.068, CFI= 0.93, TLI= 0.91, SRMR= 0.062). The item total correlations range from 0.43 to 0.66. We determined the Cronbach Alpha coefficient of the scale to be 0.94 and the test re-test reliability to be 0.87. According to the results, it can be said that the scale obtained can be used validly and reliably to determine the engineering habits of mind children according to teacher reports. The study contributes to the ever-increasing engineering habits of mind literature.

The biological concept has a broad scope and requires the visualisation of bioprocesses to provide complex understanding. Learning media can help visualise bioprocesses to enhance students' cognitive abilities. The study aimed to develop, test the practicality, and test the effectiveness of video animation in improving grade XI high school students' understanding of the coordination system. This study involved 66 high school students in grade XI of the science department at State Senior High School 2 Malang, Indonesia. This research used the Lee & Owens Multimedia-Based Instructional Design method, which consisted of analysis, design, development, implementation, and evaluation stages. In the evaluation stage, we conducted face validity by media experts and content validity by material experts, successively getting results of 97% and 100%. Then, the concurrent validity test was obtained from student assessments of the media interface with a result of 97%, the user-friendly with a result of 100%, and the appropriateness of the material with a result of 95%. In the final stage, construct validity was carried out through an effectiveness test using a quasi-experimental design with a pretest-posttest control group design. Data analysis was performed using the Independent T-test, with the results showing a significance of 0.006 < 0.05, which showed a significant difference in the average post-test between the control and experimental classes. The average score in the experimental class increased from 76.32 to 89.03, but the control class increased from 76.38 to 84.56. The results showed that the video animation media effectively improved students' abilities. Therefore, this learning media can be a recommendation in the learning coordination system.

This research aims to develop an instrument for the evaluation of impulsivity traits in children and to examine the psychometric features of the developed scale. The process of developing the scale involved three main phases: namely, item generation, evaluation of content validity, and analysis of psychometric properties. The study sample comprised 319 children (68 females, 201 males) aged 5-18, all diagnosed with attention deficit hyperactivity disorder (ADHD), including 50 who underwent pilot testing. Both exploratory and confirmatory factor analyses were employed to assess the factor structure of the scale, resulting in an 18-item scale encompassing motor impulsivity, non-planning impulsivity, and attention-related impulsivity factors. The Confirmatory Factor Analysis "(CFA)" indicated a satisfactory model-data fit. The overall scale demonstrated high reliability, with Cronbach's Alpha coefficients reaching 0.863. The analyses indicated that the scale is both valid and reliable.

Although equality of opportunity in education is a current and important issue, most of the studies on this subject are based on theoretical studies rather than empirical studies. The main reason for this can be said to be the lack of a valid and reliable measurement tool in this field. For this reason, this study aims to develop a valid and reliable measurement tool for determining pre-service teachers' perceptions of equality of opportunity in education. For this purpose, data were collected from four different samples using a simple random sampling technique. First, a literature review was conducted, and qualitative interviews were conducted with the first sample on equal opportunities in qualitative education. After the item pool was created, the first application was made in order to determine the factor structure of the measurement tool. Data were collected from a separate sample to test the resulting structure and perform confirmatory factor analysis. Then, in the context of reliability studies of the measurement tool, calculation of the internal consistency coefficient, extracted mean variance, composite reliability and test-retest processes were used. As a result, a valid and reliable scale for determining the perception of equality of opportunity in education consisting of three factors and 23 items has been brought to the education literature.

A questionnaire for measuring Context University Skills and Workplace-Recognized Skills (LCUS-WRS) requires a validated and reliable instrument. The purpose of this study was to develop and validate a questionnaire to measure learning of context university skills and workplace-recognized skills, in order to carry out an advanced psychometric properties analysis of Work-Integrated Education (WIE) students and the skills of LCUS-WRS, including internal and external reliability. Methods: We conducted multi-stage random sampling, with a sample consisting of 728 students WIE from 20 rural colleges in Thailand. Exploratory Factor Analysis (EFA) was performed on a subset of the sample (n = 279), and Confirmatory Factor Analysis (CFA) was conducted on another subset (n = 449), both in different subgroups. Additionally, the researcher analyzed the internal consistency and temporal reliability of the scale in the instrument. Results: Using exploratory factor analysis with 39 items 6 factors and accounted for 55.881% of variance was identified of the variance for the CFA model. The model achieved a goodness-of-fit of chi-square (X[superscript 2]) = 582.907, df = 308, p = 0.000, X[superscript 2]/df = 1.90, GFI = 0.979, AGFI = 0.985, RMSEA = 0.030, SRMR = 0.030. Conclusion: LCUS-WRS scale has solid construct of validity and excellent internal consistency which to analyze psychometric properties It has optimum temporal reliability. Therefore, the indicated that the dimensions of measuring of LCUS-WRS guaranteed its use in higher education institutions. Keywords: learning of context university skills, workplace-recognized

The aim of the study is to develop a Likert-type scale to determine the play preferences of children attending pre-school education. The research was designed and carried out according to the survey research model. Data collected from 3 different study groups were used in the scale development process. The study groups consist of parents of children attending pre-school education in Istanbul Province in the 2022-2023 academic year. The 33-item and 8-dimensional structure obtained after EFA was also confirmed with CFA. Dimensions were determined as solitary play, parallel play, together play, collaborative play, building-building play, dramatic play, games with rules and digital play. It is seen that the reliability coefficients of the scale after EFA and CFA vary between 0.757 and 0.900. In order to distinguish between the lower and upper groups and to make comparisons between the groups, an independent group t test was performed, and it was revealed that there was a difference between the 27% lower and 27% upper groups (p <0.05). It was determined that the testretest values of the game type preferences scale were significant. According to these values, it was determined that the scale gave consistent results. When all studies were evaluated, it was concluded that the play preferences scale is a measurement tool that can validly and reliably measure the play preferences of children receiving preschool education.

Recent publications emphasize the need to take greater account of differences in teaching quality between subjects. The empirical analysis of this topic requires a comparison of teaching quality in different subjects to distinguish generic aspects of teaching quality from subject-specific ones. In this paper, we compare teaching quality in mathematics and German lessons using observational data from primary schools in Switzerland (N[subscript Math] = 319; N[subscript German] = 237). Data were collected using an observation instrument reflecting the teaching dimensions of the MAIN-TEACH model, which was developed based on a synthesis of established observation frameworks. The dimensions of classroom management, motivational-emotional support, selection and implementation of content, cognitive activation, support for consolidation, assessment and feedback, and adaptation were tested for subject-related measurement invariance. With a two-fold measurement invariance approach, differences between the subjects were investigated at both a global and an indicator level. When applying alpha accumulation correction, no significant subject-related differences in factor loadings or intercepts were found. The factorial structure of our data was basically identical for the two subjects. The comparison of latent factor means revealed no mean differences between the subjects. We discuss the implications for both the MAIN-TEACH model and research into subject-related differences of teaching in general.

Introduction: Self-regulation is the ability to adequately plan and manage one's own behavior in a flexible manner. It is a predictor of well-being, health, academic performance, among others. The psychometric characterization of the Self-Regulation Questionnaire-Abbreviated (CAR-abr.) composed of 17 items is presented. A versatile instrument, used exhaustively in various countries and professional contexts such as education or clinical. Method: The questionnaire was validated for content to verify its linguistic and cultural suitability and subsequently administered to a convenience sample. The survey involved 710 Colombian university students from 12 degrees, aged 18 to 33 years ( M = 20.3, SD = 4.3), 31.5% men. Results: The results indicate a good fit of the items to the Rasch model, an adequate functioning of the Likert scale and evidence of construct validity, although the questionnaire would benefit from the inclusion of more difficult items. Reliability was .84 for individuals and .98 for items. The self-regulation score correlated positively with flourishing (0.416** p <0.01) and mental health (0.372** p <0.01), and negatively with bad habits (-0.343** p <0.01). Discussion and conclusions: The test can be used in various measurement and assessment contexts. It allows the level of self-regulation to be established with sufficient reliability and evidence of validity, according to the results with the sample used. The possible uses and limitations of the CAR-abr. for psychological measurement and assessment are discussed.

The efficiency of cognitive component skills is typically assessed with speeded performance tests. Interpreting only effective ability or effective speed as efficiency may be challenging because of the within-person dependency between both variables (speed-ability tradeoff, SAT). The present study measures efficiency as effective ability conditional on speed by controlling speed experimentally. Item-level time limits control the stimulus presentation time and the time window for responding (timed condition). The overall goal was to examine the construct validity of effective ability scores obtained from untimed and timed condition by comparing the effects of theory-based item properties on item difficulty. If such effects exist, the scores reflect how well the test-takers were able to cope with the theory-based requirements. A German subsample from PISA 2012 completed two reading component skills tasks (i.e., word recognition and semantic integration) with and without item-level time limits. Overall, the included linguistic item properties showed stronger effects on item difficulty in the timed than the untimed condition. In the semantic integration task, item properties explained the time required in the untimed condition. The results suggest that effective ability scores in the timed condition better reflect how well test-takers were able to cope with the theoretically relevant task demands.

In this study, a valid and reliable scale (TSSSSS) was aimed to develop to measure secondary school students' perceptions of teacher support. The research was carried out on a total of 773 students studying in 6 different secondary schools in Ankara's Yenimahalle district in the Spring Term of the 2021-2022 Academic Year. The students who participated in the research voluntarily were divided into four study groups. The first study group consisted of 7th and 8 th grade students for the pre-application of the scale. The second study group and the third study group consisted of 5th, 6th, 7th, and 8 th grade students to determine the structure of the scale and verify the structure of the scale. The fourth study group consisted of students studying in the 7th and 8th grades of the school where the pre-application was made for the reliability study of the scale. The application form of the scale, which was created based on the literature review, was submitted to expert opinion for content and face validity and rearranged in line with the recommendations of the experts. As a result of the pre-application, some statements in the scale were changed based on the students' opinions. A structure with 36 items and four factors was gained with EFA, which explained 66.56% of the total variance. The factors of the scale were categorized under the names of emotional support (10 items), instructional support (5 items), guidance and orientation support (12 items), and problem-solving support (9 items). The structure of the scale was confirmed by CFA. Reliability coefficients obtained by Cronbach Alpha, composite reliability, and the test-retest method were examined for the reliability of the measurements related to the dimensions of the TSSSSS, and it was found that the reliability was quite high. The analyses carried out to determine the distinctiveness of the items on the scale revealed that all of the items were distinctive. In addition, as a result of examining the Pearson product-moment correlation coefficients calculated for the sub-dimensions of the TSSSSS after the item analysis, it was determined that the compatibility and the correlation between the dimensions of the scale were high. Based on these findings, it can be said that TSSSSS is a valid and reliable scale that can be used to measure secondary school students' perceptions of teacher support.

In social stratification research, the most frequently used social class schema are based on employment relations (EGP and ESEC). These schemes have been propelled to paradigms for research on social mobility and educational inequalities and applied in cross-national research for both genders. Using the European Working Conditions Survey, we examine their criterion and construct validity across 31 countries and for both genders. We investigate whether classes are welldelineated by the theoretically assumed dimensions of employment relations and we assess how several measures of occupational advantage differ across classes. We find broad similarity in the criterion validity of EGP and ESEC across genders and countries as well as satisfactory levels of construct validity. However, the salariat classes are too heterogeneous and their boundaries with the intermediate classes are blurred. To improve the measurement of social class, we propose to differentiate managerial and professional occupations within the lower and higher salariat respectively. We show that implementing these distinctions in ESEC and EGP improves their criterion validity and allows to better identify privileged positions.

This study aims to investigate the role of digital learning platforms (DLP) as a mediator in the relationship between the social media capability (SMC) and academic performance (AP). It explores the individual impacts of SMC and DLP on academic performance. The study employs Partial Least Squares Structural Equation Modeling (PLS-SEM) to analyze the reflective and structural models, aiming to find the correlations among various variables. The adoption of the structural model is supported by evidence of convergent, discriminant, and convergent validity among the constructs. The structural model's findings suggest a positive association between students' use of social media and both Digital Learning Platforms (DLP) and academic performance. Moreover, it identifies DLP as a mediating factor in these relationships, indicating that students are more likely to leverage and harness the benefits of social media when they have control over digital learning platform resources. Consequently, SMC and DLP collectively contribute to improved academic performance. This study highlights the applicability of Partial Least Squares Structural Equation Modeling in understanding the dynamics of social media and digital learning platforms in the context of enhancing academic performance. The results also emphasize the significance of integrating digital learning platforms into educational institutions. Finally, the study discusses implications and provides practical recommendations based on its findings.

The article focuses on adaptation and validation of the Academic Motivation Scale questionnaire (AMS-28) in higher education in four Eastern European countries: Czechia, Slovakia, Serbia, and Poland. The research was conducted with a total of 1711 respondents. We examined the construct validity of AMS-28 including measurement invariance and reliability according to national, gender and age groups. Our analysis confirmed its original seven-factor structure as well as its reliability. The tool is measurement invariant across all compared groups (gender, age, countries) except Poland, whose results are specific. The results identify new places on the world map where AMS-28 is functional. The tool appears functional in time, space and various language mutations. Despite satisfactory results, there is still room for future examination of the AMS-28 among different countries. In practice, the tool has a wide range of application possibilities.

Pragmatics refers to the ability to effectively use and interpret language in different contexts. Pragmatic abilities develop and refine through childhood, and they are essential for socialization, academic achievement and wellbeing. The scarcity of assessment tools in this field makes it challenging to provide a comprehensive assessment of pragmatic abilities. The Pragma test, originally developed for Finnish and also adapted into Italian, consists of a battery of tasks assessing children's pragmatic abilities. In this study, a first evaluation of the psychometric qualities of a Norwegian adaptation of this test is presented. In addition, we investigated pragmatic development between ages 5 and 7, and explored possible gender-based differences. Altogether 119 Norwegian-speaking children participated in the study. The children were tested with the Pragma test and parents completed the Children's Communication Checklist-2. The children were allocated into three groups: 5-year-olds, 6-year-olds and 7-year-olds. The psychometric qualities of this Norwegian adaptation supported its use as a tool for assessing pragmatics in children aged 5-7. Strong and significant growth in pragmatic competence was observed from age 5-6, subsequently flattening out between age 6 and 7, and gender differences in favour of girls were identified. These findings indicate that pragmatic ability, as measured by the Pragma test, shows similar age effects in a Norwegian setting as in Finnish and Italian contexts, paving the way for further cross-cultural and cross-linguistic studies.

The present study developed and validated a self-regulated learning (SRL) teaching scale with a total sample of 966 preschool teachers. A pool of items was generated from literature reviews, teacher interviews, and expert reviews using Zimmerman's cyclical model of SRL. An exploratory factor analysis (N = 333) in study 1, and a confirmatory factor analysis (N = 334), discriminant, and convergent validity (N = 667) in study 2 were performed to support a six-factor construct, including task analysis, self-motivation beliefs, self-control, self-observation, self-judgement, and self-reaction, with a satisfactory fit. In study 3, the T-SRL was found significantly correlated with teacher self-efficacy, validating the scale's concurrent validity with another sample of 299 teachers. Overall, the findings collectively support the further development of the T-SRL to assess teaching practice while emphasizing the need for more empirical research on promoting children's SRL.

The aim of this study was to adapt the Positive and Negative Affect Scale for Children (PANAS-C) developed by Laurent et al. into Turkish and to examine its validity and reliability on high school adolescents. The data of the study were analyzed with four different study groups. The first study group consisted of 414 high school adolescents, 262 girls (63.3%) and 152 boys (36.7%), between the ages of 14 and 19, with a mean age of 15.80 (SD = 1.15). Confirmatory factor analysis (CFA) was conducted with the first study group to determine the construct validity of the scale and a 14-item short form of the scale was obtained. A total of 295 adolescents, 159 girls (53.9%) and 136 boys (46.1%), between the ages of 14 and 19, with a mean age of 16.06 (SD = 1.16), participated in the second study group. CFA was conducted with this group for the construct validity of the short form; a two-dimensional structure was obtained as in the original form of the scale. In addition, multiple-group CFA was conducted with the data obtained from the second study group, and cross-validation of the scale regarding gender was ensured. The internal consistency coefficient, combined reliability values, and average variance extracted values of the scale were examined with both the first and second study groups, and the values obtained were found to be acceptable. The third study group consisted of 69 high school students, 36 girls, and 33 boys, with an average age of 15.67 (SD = 0.82). The criterion-related validity of the scale was examined with the third group. As a result of the criterion-related validity study, it was found that there was a moderately positive relationship between positive emotion and life satisfaction and a negative relationship between positive emotion and depression. On the other hand, there was a moderate negative relationship between negative emotion and life satisfaction and a significant positive relationship between negative emotion and depression. The test-retest reliability of the scale was examined with the fourth study group. For this purpose, 63 students were administered the PANAS-C at 3-week intervals. Significant relationships were found for test-retest reliability, r = 0.70, p < 0.01 for the positive emotion dimension, and r = 0.63, p < 0.01 for the negative emotion dimension. The results of the study were discussed and interpreted and suggestions for researchers were presented.

Organization, time management, and planning (OTMP) skills are behavioral manifestations of executive functioning linked to academic outcomes. Interventions to improve OTMP skills have shown favorable outcomes. The Children's Organizational Skills Scale parent and teacher forms (COSS-P, COSS-T) are widely used for assessing OTMP skills, but there is limited research on this scale. This study examined the factor structure and construct validity of the COSS in a non-clinical and clinical sample of students in grades 2-8 (Study 1; n = 1138 COSS-T; 1155 COSS-P), and teacher-referred students with OTMP deficits in grades 3-5 (Study 2; n = 184). In Study 1, a bifactor model with a general factor and three subfactors demonstrated good fit for the COSS-P (RMSEA = 0.057) and COSS-T (RMSEA = 0.052). This model was replicated in Study 2. The general factor on both versions demonstrated an acceptable to high level of internal reliability. An acceptable degree of reliability was also identified for subfactor 1 (Task Planning). The COSS was shown to be effective in differentiating children with ADHD from a comparison group drawn primarily from the non-clinical sample (AUC = 0.84 COSS-P; 0.85 COSS-T). Sex differences of medium magnitude were identified on the total score of both COSS versions. Correlations between the COSS-P and COSS-T were variable across samples. The findings provide strong evidence for using the total score on the COSS-P and COSS-T as an index of overall OTMP skills deficits. Given variable cross-informant correlations on the COSS, multi-informant assessment of OTMP skills is strongly indicated.

In Turkey, teacher appointment is made centrally by the Ministry of National Education and is made without considering where the teachers want to work. Many teachers are assigned to places very different from the cultural environments in which they grew up resulting in them encountering very different school types and administrator habits. The negative situations encountered affect the motivation of newly appointed teachers and weaken their organisational commitment. The draft scale was created with a pool of questions obtained as a result of examining the legal texts and similar studies on the subject. This draft scale includes 28 items and was developed for the adaptation of new appointed teachers to the profession. The rotated principal component analysis was used to test the construct validity of the scale. As a result of the analysis, the Kaiser-MeyerOlkin (KMO) value was determined as 0.949, while the Bartlett test was found to be significant. The analysis showed that 2 of the 28 items were loaded on more than 1 factor and as their load values were low, the 2 items were removed from the scale. The remaining 26 items formed a 3-factor structure with an eigenvalue higher than 1.00. Factor 1 of the scale is called "Compliance with the profession"; Factor 2 "Environmental compliance" and Factor 3 "Compliance with school." While Factor 1 with an eigenvalue of 5.86 explained 22.55% of the total variance, Factor 2, with an eigenvalue of 4.97 explained 19.13% of the total variance. Factor 3, with an eigenvalue of 4.71 explained 18.11% of the total variance. The alpha reliability coefficient of the composite scale was found to be 0.955. Internal consistency coefficients of the factors of the scale were 0.91 for all 3 factors.

Language testing and assessment have grown in popularity and gained significance in the last few decades, and there is a rising need for assessment literate stakeholders in the field of language education. As teachers play a major role in assessing students, there is a need to make sure they have the right level of assessment knowledge and skills to accomplish their duties as assessors. The present study sought to develop and validate an assessment literacy test. To this end, a thirty-five scenario-based Language Assessment Literacy Test (LALT) was developed based on the seven standards covered by the Standards for Teacher Competence in Educational Assessment of Students (1990). Construct validity of the test was investigated by collecting data from 168 Iranian EFL teachers. To investigate the validity of the measure, tests of reliability, item difficulty, and item discrimination were carried out. The test was then subjected to EFA (Exploratory Factor Analysis whose results showed a seven-factor solution for the test items. The implications of the study for EFL teachers, language testers, teacher trainers, and curriculum developers are discussed.

This work is intended to develop a measuring tool for determining teacher perception of informal relationships. The pool of items created by researchers through a literature review has been presented with expert assessment of the validity of the content, face, and meaning, and a draft scale has been created by making necessary revisions to the feedback. The draft form was applied to 214 teachers working in the central districts of Diyarbakir, exploratory factor analysis was made on the obtained data set, and a six-dimensional scale structure consisting of 20 items was determined. In order to verify this structure, data were collected from 306 teachers working in the central districts of Diyarbakir, and the six-factor scale structure was confirmed based on the goodness of fit values estimated by confirmatory factor analysis. In addition, AVE (Average Variance Extracted), the root of AVE, composite reliability, and correlation among factors were checked, and it was seen that the scale provided the convergent and discriminant validity conditions as a result of the values reached. For reliability analysis, Cronbach's Alpha coefficients and composite reliability values were checked together, and it was seen that the scale had sufficient reliability values. The measurement invariance of the scale was tested according to the categories of gender (female-male), marital status (married-single), level of employment (primary school, secondary school, and high school), and seniority (1-10 years, 11-20 years, 21 and above), and the formality of the scale, metric, scalar, and strict invariance conditions were found to satisfy. Consequently, it was concluded that the scale in question is a valid and reliable scale that can be used to measure teacher perception of informal relationships.

Introduction: Research suggests that one of the most pervasive consequences of traumatic events is the resulting dysregulation of emotions. Educators, including teachers, administrators, and student services staff, are instrumental in supporting students as they navigate overwhelming emotions by modeling and teaching skills to regulate emotional states (i.e., emotion co-regulation). Given the saliency of emotion co-regulation within educational contexts, this study presents the development and preliminary psychometric exploration of a measure of educator self-efficacy for co-regulation. Methods: We examined differences by educator characteristics (gender, professional experience, role in the school) as well as previous training in trauma-informed approaches and culturally responsive strategies. Results and discussion: Preliminary findings support the measure to be reliable and valid, with construct validity supported by positive associations to other theoretically applicable constructs such as culturally responsive strategies, as well as educator characteristics such as professional experience and role. However, a lack of association with trauma-informed training, suggests the need for additional research into supporting emotion co-regulation self-efficacy for educators.

Diagnostic tests have been developed previously to measure algebraic thinking skills; however, the tests do not specifically address algebraic problem-solving. Thus, an Algebraic Thinking Test (ATT) Instrument was developed to measure algebraic thinking skills in problem-solving involving linear equations. ATT comprises nine open-ended questions with three algebraic thinking constructs: Generalized Arithmetic, Functions and Modelling. Generalized arithmetic involves students in efficient calculation and generalization; functional involves identifying number patterns, while modelling involves solving openended problems, identifying similarities, and performing calculations involving variables. This study is meant to determine the quality of ATT instruments through the validity and reliability analysis using the Rasch Measurement Model. The sample consisted of 120 seventh graders aged 12 to 13, selected from two secondary schools in the Tuaran district, Malaysia. The instrument was found to have a strong dimensionality and high construct validity. The reliability of Cronbach Alpha (KR-20) demonstrated a value of 0.90 (very high), and item and respondent reliability of 0.98 (excellent) and .86 (good), respectively, with an item separation index of 6.29 and 2.45 for the person separation index. ATT has good validity and high reliability in measuring algebraic thinking skills among seventh graders in secondary schools.

The "metaverse," which bridges augmented and virtual reality as mixed reality and includes technological phenomena such as artificial intelligence, continues to be an agenda topic. It is foreseen that the concept in question will accelerate the changes in education and teaching activities, as in many other fields. In this research, a measurement tool was developed to determine pre-service teachers' and teachers' beliefs about education in the metaverse (meta-education), especially considering the concept of the "metaverse" that entered our lives with the information age. During the development process of the measurement tool, an item pool consisting of 59 items was created by scanning the relevant literature. The opinions of five experts were received for the draft scale. Two items were added to the draft scale, and ten items were removed based on expert feedback. The scale was arranged as 41 items before the application. During the pilot application process, 203 were collected. Exploratory factor analysis (EFA) was used for the scale's construct validity. The EFA result shows that the scale consists of 22 items and a single factor, and 44% of the total variance is explained. The item-rest correlations on the scale ranged from 0.64 to 077. The Cronbach alpha coefficient of the scale was found to be 0.90. Based on these findings, the scale can be used to determine adults' beliefs about meta-education.

This study aims to develop an instrument that measures democratic attitudes levels in primary school students in third and fourth grades. This study involved 591 students (302 for exploratory factor analysis, 289 for confirmatory factor analysis) enrolled in the 3rd and 4th grades. A literature review was conducted to prepare the scale items, and a pool of 32 items was created. A face and content validity assessment was performed by taking the opinions of four educators who are experts in classroom education and social studies education. A construct validity test was conducted on 302 students. The exploratory factor analysis resulted in a scale with three dimensions and 15 items. Confirmatory factor analysis was conducted with a group of 289 students using the scale. Based on the confirmatory factor analysis, the 15-item and 3- dimensional structure of the scale was compatible with the collected data. According to the results, the reliability coefficient of the scale was .85. Thus, the scale can be considered a valid and reliable tool for measuring democratic attitudes among primary school students in third and fourth grades.

The aim of this research is to develop a reliable and valid scale to determine the mathematical thinking skills of gifted students. In addition, with the developed scale, thinking skills of gifted students was examined in terms of various variables. In this context, the research was carried out on two different study groups. The first stage of this research was the development of the scale, and the data obtained from 410 gifted students. The second stage of this research was the testing process of the developed scale, and it was carried out on the data obtained from 393 gifted students. While developing the scale, confirmatory factor analysis, exploratory factor analysis, Guttman Split-half values reliability, Cronbach Alpha internal consistency coefficient calculations were performed. As a result of analyses, the total variance percentage of the scale consisting of 16 items and four factors was obtained as 60.781%. It was concluded that the model obtained from confirmatory factor analysis applied was at an acceptable level. For the whole scale, Cronbach's alpha value of the scale was determined as 0.841. As a result of this study, a reliable and valid scale was developed to determine mathematical thinking skills of students. In addition, through the scale developed, it was concluded that thinking skills of the students showed differences according to gender, group, grade level and education status.

The purpose of this study is to develop and validate based on construct validity and sampling validity on a self-confidence scale that can measure student self-confidence at the high school level by adapting self-confidence indicators and adjusting indicators according to the character of students in Indonesia with an age range of 16-18 years. A total of 405 students from several senior high schools in Indonesia participated in this study. Respondents came from 15 schools in several regions in Indonesia. The validity test uses Pearson Product Moment which is useful for determining the validity or suitability of the instruments used by researchers in measuring and obtaining research data from respondents. While the reliability test used Alpha Cronbach the Self Confidence Scale were said to be reliable (0.794). The basis for taking the Pearson validity test is if the significance value is <0.05 then the items in the instrument are declared valid. And based on the r value of the product moment table with 405 respondents, the significance level value of 5% is more than <0.098, the result is that the instrument scale item is also said to be valid. Based on the results of the Pearson validity test, 11 self-confidence scale statement items were declared invalid or invalid because the significance level value <5% was smaller <0.098. 11 invalid statement items were declared invalid so that there were 45 items of self-confidence scale statements that were declared valid and reliable. And it can be concluded that the 45 items are declared valid and become a valid and reliable self-confidence scale and can be used to measure student self-confidence. And become instruments in a self-confidence scale that can be used to measure the level of self-confidence of high school students, especially in Indonesia.

Researchers design diagnostic assessments to measure students' knowledge structures and processing skills to provide information about their cognitive attribute. The purpose of this study is to determine the instrument's validity and score reliability, as well as to investigate the use of classical test theory to identify item characteristics. The data used in the form of responses to elementary school mathematics subject. There are 166 students from 5 public elementary schools who participate in the study. The data analysis technique used is the analysis of item characteristics based on classical test theory using the R software package. The results showed that the developed mathematical ability diagnostic instrument had high content validity based on the Aiken formula and valid construct validity based on the CFA approach. According to the Spearman-Brown formulation, the correlation coefficient is about 0.889, indicating high internal consistency reliability. In the index of difficulty level, overall, it is categorized as moderate items. The discriminatory index shows that there are two items, namely items 9 and 17, with low discriminating power, so the two items are not used. Of the 60 total distractors, 5 (8.3%) did not function well because less than 5% of the participants chose them. In contrast, as many as 55 distractors (91.7%) have functioned well.

The true spirit of education involves psychosocial grooming and character building of learners. Teacher's efficacy plays a vital role in achieving educational objectives. The effectiveness of teachers is usually evaluated through the academic grades of their students. Teacher's efficacy, however, is originally the ability of a teacher to improve the cognitive functioning and humanistic values of students. The current study developed and validated a new scale entitled the Qualiquant Teacher's Efficacy Scale (QTES) by involving 147 teachers and 59 students. The sample was selected thru a mixed method that involved convenient and purposive sampling techniques. QTES reflected strong validity and excellent reliability thru exploratory factor analysis, Cronbach's alpha, item-scale, and item-total correlations. QTES is a unique measure for teacher's efficacy because it defines teacher's efficacy through cognitive functioning and humanistic values, offers two parallel and separate versions for teachers and students, and quantifies the qualitative data.

Language students apply different strategies to learn a second language (L2), especially when they want to attain proficiency in reading. The aim of the present study was to revisit the validity of the "Metacognitive Awareness of Reading Strategies Inventory" (MARSI-R) among Saudi students using a new statistical method of confirmatory composite analysis (CCA). Past studies modeled MARSI-R as a "common factor" and applied confirmatory factor analysis (CFA) to test its validity. However, studies struggled to provide support for the validity of the MASRI-R with each suggesting different model. Instead, we treat the inventory as a "composite," meaning that the items in MARSI-R form and define the inventory and not the other way around. We use partial least squared structural equation modeling (PLS-SEM) to allow the composite model to be estimated. The results indicated that the constructs of MARSI-R are better operationalized as composites not common factors as supported through CCA exclusively. After confirming the nature of the inventory, we evaluated the extent to which MARSI-R is related to reading proficiency through the mediational mechanism of motivational intensity (i.e., learning effort). Descriptive statistics illustrated that problem-solving strategies are the most used strategy and that females used the strategies more frequently than their male counterparts. Most importantly, the structural model showed that metacognitive reading strategies only exert an indirect effect on reading proficiency, suggesting that the effect of strategies is mediated by motivational intensity (i.e., learning effort). Thus, motivational intensity seems to be mediator in the relationship between metacognitive reading strategies and reading proficiency. Finally, methodological and educational implications are provided.

This study developed and validated the Science Practice Scale (SPS) and investigated the implementation of scientific teaching practices by Grade 8 science teachers in Jordan. The responses of 235 8th grade science teachers who participated in the Trends in International Mathematics and Science Study [TIMSS] of 2019 were analysed using the Rasch measurement. We found significant evidence supporting the construct validity of the SPS scale. The results showed that the estimated difficulty level of implementing the practices varies from -1.26 logit (observing natural phenomena) to 2.27 logit (conducting fieldwork), indicating that the level of conducting field experiments was very low. The results of the t-test (t = 0.267, df = 222, p<0.55) indicated that no statistically significant differences existed between male and female science teachers in implementing scientific practices. The Ministry of Education of Jordan is encouraged to organise specific professional development programmes to promote science teachers' implementation of these practices, especially with regards to organising fieldwork and giving their pupils opportunities to design and conduct experiments and present data. The current study provides recommendations for improving the TIMSS teacher questionnaire and introduces suggestions for further research.

This study aimed to refine and validate a Mechatronic System Usability Evaluation (MSUE) questionnaire. A total of 626 users were selected using random sampling, from the area of West Thessaloniki, Greece. The validity of the questionnaire were tested with the content and construction validity method. The reliability of the MSUE questionnaire instrument were tested using test-retest and internal consistency method. Factor analysis resulted a 25 questions questionnaire divided into five axes of, namely efficiency, effectiveness, Satisfaction, ease of use, and ease of learn. The Cronbach Alpha coefficient for the entire scale was 0.819. The questionnaire was tested and the results was shown a suitable instrument to measure usability on mechatronic systems.

This study aimed to develop a two-tier light concept test to identify student concept understanding of light. The development of the test was carried out through the content validity, construct validity, and reliability test stages using the Item Response Theory (IRT). The sample consisted of 81 students during the second semester at five universities in Indonesia. The results showed that the instrument met the content validity and construct validity criteria as well as reliability. Efforts are needed to improve concepts in light material.

This study focused on the development and validation of the Sense of Online Community Scale (SOCS), which includes 28 Likert-type scale items across six subscales: (1) program community; (2) program academic activities; (3) program social activities; (4) institutional academic activities; (5) institutional social activities; and (6) affiliation. The validation process included an implementation with 293 learners enrolled in online programs at a higher education institution in the eastern United States. The model was evaluated with and without outliers, and results show that the model aligned well with the SOCS. The means of all items except one exceeded 3.5 on a 5.0 scale, ranging from 1 (strongly disagree) to 5 (strongly agree). Time in an online program was not a statistically significant predictor of the validation model, though most of our participants were in the first or second year of their degree programs. Findings demonstrate that the SOCS is a reliable and valid instrument that other researchers may use to investigate community in online environments on both the program and the institutional level.

Cognitive diagnostic assessment is known for its capacity to provide detailed feedback to test-takers, which can inform instruction and guide learning. Besides this core strength of the assessment approach, the measurement procedure also works as a construct validation method in itself. Previous studies do not call attention to this aspect of cognitive diagnostic assessment and how the CDA validation can be different from existing construct validation methods. Thus, the purpose of this article is to synthesize cognitive diagnostic assessment research from a standpoint of seeing it as a construct validation procedure with a focus on its strengths as such. In doing so, the article closely examines studies that applied two earlier cognitive diagnostic models to learner data because they established the research foundations of CDA in language testing. Before looking into the details of the procedure of cognitive diagnostic assessment, the paper critically reviews non-CDA studies on construct validation in language testing. It then scrutinizes the methods and objects of construct validation in CDA research to find any significant differences. The paper concludes with several avenues of future research in CDA, which are related to the matter of verifying test constructs.

The main purpose of the research is to develop a valid and reliable scale for the perception of the desire to obtain legal authority in education administration. The sampling of the research consists of 390 education administrators and teachers with different statuses. Using the easily accessible sampling technique, the types of official primary, secondary and different high schools in the central province of Van were determined. The scale draft was applied to the education administrators and teachers determined by using the purposeful cluster sampling method. The data were analyzed with descriptive statistical analysis methods. Validity analyzes and reliability analyzes of the obtained data were made. As a result of the analysis, the scale consisted of 4 factors and 32 items, and item factor loads consisted of values between "0.61" and "0.87". It was determined that the resulting factors explained the perception of obtaining legal power by 77.46%. The fit index values of the scale reveals that the scale provides construct validity. While the scale's internal consistency coefficient was found to be "0.95", the test-retest reliability coefficient was determined as "0.92". The findings show that the developed scale can be used as a measurement tool with its validity and reliability.

An instrument was validated through factorial structure to measure the advantages, levels of reflection, and communicative competencies of the podcast, as well as to establish the levels of reliability and consistency of the measuring instrument. Likewise, confirmatory analysis was carried out to validate the proposed structural model and establish the relationships of the factors using the PLS-SEM methodology, Partial Least Squares Structural Equation Modeling. It was validated with a sample of 142 teachers. It was demonstrated that there is a causality relationship of the variables, given by the coefficient of determination R2, the level of influence of the independent variables: levels of reflection and advantages; on the dependent variable, communicative competencies; the level of influence of the exogenous variable: advantages with the endogenous variable: levels of reflection in teachers. A high degree of construct validity was shown through the fit indices of the confirmatory factorial analysis.

The way in which validity has been conceptualized has changed throughout the years. The focus in validation studies shifted from evaluating distinct components of validity to developing a comprehensive argument for the use and interpretations of test scores. The argument-based approach to validity incorporates the distinct types of the componential approach, underscores Messick's attention to construct validity, highlights the need for evidence of the evidence-gathering approach, and combines it all into one logical argumentative structure. Such a comprehensive argument is now an indispensable part of validity studies (Dursun & Li, 2021).

Agriculture extension staffs are encouraged to attempt more efficient methods to enhance their competency through digital webinars or technical guidance, in Bahasa Bimbingan Teknis (Bimtek) programs. The research aims to explore factors influencing the intention and behavior of agricultural extension staff towards the Technical guidance online Ministry of Agriculture in Special Region Yogyakarta, Indonesia. This research included the Behavior Intention (BI) and Use Behavior (UB) models with significant construct. The research used the quantitative method and analyzed PLS-SEM. One hundred eighty extension staffs participated, chiefly 34-42 years old. All of the indicators passed the outer model assessment. The analysis results conclude that significant effects are Attitude to BI, Control Behavior to BI, Perceived Usefulness to BI, and Behavior Intention to UB. The perception of extension staffs about Technical guidance online can enhance their performance to continue using it in obtaining agricultural technology information, extension materials, information on agricultural policies, and the latest agricultural development programs. The insignificant constructs are Subjective Norm, Motivation, and Perceived Ease to Use. The validated research model explains 61% of the variance (R2 = 0.61) in Attitude, Perceived Usefulness, and Control Behaviour towards Behavior Intention (BI). Moreover, BI explains 8.9% of the variance (R2 = 0.089) in UB of Technical guidance online. This research found that BI and UB have Q2 values of 0.538 and 0.077. The practical implication could be applied as preliminary development planning studies to enhance the efficiency of Technical guidance online as Bank Data.

The majority of students from elementary to tertiary levels have misunderstandings and challenges acquiring various statistical concepts and skills. However, the existing statistics assessment frameworks challenge practice in a classroom setting. The purpose of this research is to develop and validate a statistical thinking assessment tool involving form one (Grade 7) students' statistical thinking. The SOLO model was applied to develop five testlet tasks. Each testlet task involved four components. This study employed the survey methodology to assess the statistical thinking of 356 form one students. Content validity was determined using the Content Validity Index (CVI). The construct validity was determined using Rasch analysis. The results demonstrated that the instrument for assessing the statistical thinking of the form one students was valid and trustworthy. This finding of the study also revealed new evidence that the instrument allowed the teachers to identify the students' progress effectively based on the hierarchical manner of item levels in the testlet format. The instrument was useful in identifying students' statistical thinking levels. The students' ability to respond appropriately to a task at a particular level reveals their degree of cognitive development. Testlet task was also easy to diagnose the strengths and weaknesses in learning statistics topics.

The university environment provides a good context for entrepreneurship education. With the vigorous development of entrepreneurship education, educators and scholars have shown increasing interest in the significant role entrepreneurship education plays in higher education. As a result, the effectiveness of entrepreneurship education has quickly become a popular topic. However, it is often not easy to evaluate entrepreneurship education programs, which are designed for medium- and long-term outcomes. It is essential to develop alternative assessment tools that do not traditionally assess only knowledge. The study aims to adapt the multidimensional measurement tool for assessing university students' entrepreneurial skills, knowledge, attitudes, and mindsets. While the scale was translated into Turkish, face and content validity were proved. The data was gathered from 572 university students. Confirmatory factor analyses were employed to assess the construct validity of the measure. The Turkish Entrepreneurship Education Self-Efficiency Scale was obtained with three main dimensions and 38 items. Its Cronbach's alpha, Spearman-Brown correlation, and composite reliability coefficients are 0.95, 0.86, and 0.98, respectively. Furthermore, the study found that the entrepreneurship education scores of the participants were significantly related to their gender, field of education, volunteering, work experience, experience of starting or running their own business, and entrepreneurship education. The effect size of these variables differs, and the experience with self-employment has the greatest influence on entrepreneurship education.