Search

The study's objectives are to i) develop a test kit to determine the ability of multiple intelligences (MI) to play basketball in high school and ii) measure a student's MI test ability in playing basketball. The method used is the development of instruments with analysis, design, development, implementation, and evaluation (ADDIE). The study subjects comprised five schools in five districts in Yogyakarta, Indonesia. With a total sample of 1029 students. The results showed i) that test kits developed to assess students' MI abilities meet valid and reliable requirements. It can be seen from the validity of the contents of V-Aiken (0.96) and the validity of the construct, namely the loading factor > 0.3. With the analysis of the item classically, it detects that the level of difficulty and differentiability of the problem is good and according to the criteria; ii) the results of MI capability measurements show 55% of capabilities with the "high" category, 35% with the "medium" category, and 10% with the "low" category.

The rise and growing prevalence of juvenile delinquency is a matter of concern for many parties. This study aims to establish a research instrument in the form of a questionnaire that can be deployed to assess the learning environment perceived by high school students. This research endeavor constitutes a developmental study, wherein the outcomes are a single survey instrument encompassing six variables, nineteen indicators, and forty questions. The data-collecting process involved the utilization of a Google Form across five schools in five districts, containing a total of 1615 participants. The analysis of expert data was conducted utilizing V. Aiken and field trials employing confirmatory factor analysis (CFA) Second Order. The findings of this study indicate that the diagnostic survey instrument used to assess the learning environment's impact on the mental health of high school students demonstrated validity, as evidenced by loading factor values exceeding the established minimal threshold. The reliability of the instrument remains insufficient. This survey can be utilized to detect adolescent persistent tendencies carried out by students or other school members that interfere with mental health: the emergence and significant raising of juvenile delinquency.

The aim of this study is to develop a theoretically sound, valid, and reliable scale to examine seventh and eighth grade students' attitudes towards so-called skill-based mathematics questions (SBMQ). The sample of the study was 820 seventh and eighth grade students at three different middle schools in Etimesgut District of Ankara Province. A draft item pool was crafted after a detailed literature review and the scale was finalized for the implementation after receiving expert opinions. This version of scale was administered shortly before the national examination which included skill-based questions in the 2022-2023 academic year. Exploratory and confirmatory factor analysis methods were used to examine the construct validity of the scale. The analysis resulted in 16 items in three factors (affective, cognitive, and motivational) which explained 46% of the total variance. Cronbach's alpha and composite reliability scores were above 0.70 for each factor and whole scale. The results indicated that the Attitudes Towards SBMQ Scale developed for seventh and eighth grade students is valid and reliable.

This study was designed to determine the psychometric properties of the School Readiness Assessment Tool (SRAT), a new measurement tool for assessing school readiness. The measure aims to assess preschool children's school readiness by estimating their academic, motor, social, emotional, and self regulation skills. Both academic and motor skills are assessed through direct child observation while teacher ratings evaluate social-emotional and self-regulation skills. 228 children attending preschool participated in the study's first phase and 185 children in the second phase. The results show that the items of the new measurement tool had sufficient internal consistency. Both study phases also showed strong evidence of face (content) and construct validity (i.e., convergent and concurrent validity). Overall, the results show that SRAT is a promising new measure for school readiness among preschoolers in Türkiye. In addition to the evidence from randomized control trials, studies should be conducted to determine its psychometric properties with diverse samples, such as rural children and children not enrolled in preschool education.

This research goal to develop a multiple-choice closed-ended test to assessing and evaluate students' digital literacy skills. The sample in this study were students at MTsN 1 Blitar City who were selected using a purposive sampling technique. The test was also validated by experts, namely 2 Doctors of Physics and Science from Yogyakarta State University. The test instrument was developed based on five aspects of digital literacy skills: information, communication, content creation, security and problem-solving. Data have been analyzed descriptively and inferentially using the Rasch version and the assist of Quest software. The results showed that eight multiple-choice closed-ended test instruments were declared valid based on expert validation with an Aiken V value of 1.00. The reliability result is 0.97 with a very high category, and the INFIT MNSQ standard deviation value is 0.86-1.16, so seven items are by the Rasch model. Thus, the seven items in the multiple-choice closed-ended test instrument can be used to assessing and evaluate students' digital literacy skills in learning science.

Intellectual capital has aroused growing interest in higher education; however, one area for improvement in its study is how to measure it adequately. Therefore, it is necessary to have instruments based on current models of intellectual capital. This study aims to design and validate an intellectual capital measurement scale in accredited higher education institutions (HEIs) from the perspective of professors. The study was instrumental because a measurement scale was developed. The sample consisted of 341 professors from six accredited HEIs on the Colombian Caribbean Coast. The statistical analysis consisted of three stages: item analysis, collection of validity evidence based on the internal structure and the relationship with other variables, and reliability analysis using the internal consistency method. The scale's internal structure corroborated intellectual capital composition based on human, structural, and relational components. Regarding convergent evidence, all variables possess this source of validity evidence. Reliability levels were also good. Previously, an instrument has yet to be developed those measures intellectual capital in HEIs from the perspective of professors. This study provides a scale that focuses on the characteristics of this stakeholder and is based on an innovative model of intellectual capital composed of human, structural, and relational capital. The theoretical contribution of the study lies in developing a test based on two current models of intellectual capital: the Intellectus model and the Balanced Scorecard model. It also contributes to practice by providing a tool for measuring intellectual capital that allows its adequate management, improvement, and decision-making within higher education.

Background: Mid-semester evaluations are gaining traction as a means to gather evaluation data for formative purposes. However, it is not clear if course coordinators who conduct these evaluations are adequately equipped with evaluative knowledge and skills to guide them through their evaluative processes. Objectives: This study is a meta-evaluation of course coordinators' mid-semester evaluative practices in a Higher Education institution language centre and the extent to which their evaluative practices are attuned to RUFDATA for its preparatory design framework in the evaluative process and Utilization-Focused Evaluation (UFE) for its sets of principles with regards to uses and users and how these impact on the design and use of the evaluation. Research design & subjects: Data was gathered using meta evaluative mixed methods from three groups of participants consisting of course coordinators, academics who taught on their courses and their learners. Results: The results imply that whilst most course coordinators who participated in the study conducted mid-semester evaluations and that their evaluative practices contained some elements from the frameworks, it is problematic to align their evaluative practices and processes against these tools due to the challenges that they encountered in their evaluative processes. Conclusions: As important agents of evaluations in mid semester evaluations, it should be noted that course coordinators are not trained evaluators and conducting evaluations does not constitute a major component of their professional duties and roles. This study has implications for higher education policies and practices, commissioners, and users of evaluations.

The period of a child's growth and development that is most notable is from 0 to 8 years old. These are the years when all that is learned is laid down. Putting strong foundations in place today will yield big dividends later. Greater learning in the classroom and better educational results have a positive social and economic impact on society. Children who get early childhood education (ECE) have a strong foundation, which increases the effectiveness and productivity of every subsequent educational stage. The goal of the current study was to determine the pre-primary teachers' level of awareness regarding early childhood education, given their critical position in the field. To determine the level of knowledge of early childhood education (ECE) among teachers employed in pre-primary institutions in Bengaluru city, the study used a survey approach and a custom application. A sample of 106 teachers were drawn through cluster sampling. The study found out that the demographic variables like locality, marital status and teaching experience have no influence on the awareness of ECE among pre-primary teachers. The study found that 10% of teachers have average awareness, 31% have good awareness, 37% have very good awareness and 22% have excellent awareness of ECE. Thus, close to 90% of them are found to have better awareness of ECE. This means that preprimary teachers are well aware of the nature, learning needs etc. of children and also methodology of teaching and evaluation. In spite of better awareness of ECE found in teachers, the study comes out with few of educational implications in order to regulate and sustain the awareness of ECE among them and also in proper handling of children.

Incorporating ethnoscience into lessons through the ethnoscience-students' worksheet (ESW) is one method to improve student interest in science learning while introducing them to the local culture. However, no research was reported the effects of ESW on students' responses and the factors that influence ESW implementation in science learning. In order to better understand how students learn through ESW, this study investigated the relationship between ethnoscience context, science learning, and the implementation of students' worksheets. Seventy-two students participated in the survey after they studied ethnoscience learning through ESW. Students' responses are more influenced by science learning. In addition, the ethnoscience-integrated students' worksheets (SW) variable indirectly affects students' responses. Additionally, ESW affects students' responses more significantly than science learning and ethnoscience. This research provides insightful implications for educators on planning, designing, and practicing ESW to enhance students' problem-solving motivation and academic achievement. Furthermore, to contribute significantly to future researchers, further research employed the structural equation model through covariance analysis, also known as confirmatory factor analysis (CFA).

The volunteer function inventory (VFI) is an assessment tool to measure individual volunteer motivation. VFI measures individual motivation to volunteer by examining the functional motives of each volunteer. This research aimed to adapt the VFI to the Indonesian language. VFI consists of 30 items divided into five dimensions. This study utilized a non-experimental quantitative research method. Samples were acquired by accidental random sampling with N = 176. In this study, reliability testing was carried out with items and dimensions of Cronbach's [alpha]. Validity tests were examined using construct validity and item analysis. The results of the Indonesian version of VFI showed high reliability and validity. Besides, the item analysis also shows that the quality of each item is excellent. The Indonesian version of VFI will be suitable for various education fields in Indonesia to measure the students' voluntary willingness in community development activities, for example, in measuring the impact of volunteerism in the Merdeka Belajar Kampus Merdeka (MBKM) social activities and other activities within the communities.

Teacher readiness is the willingness of a teacher to implement a planned program successfully. Readiness is crucial in ensuring a program can be implemented at the individual or organizational level. The readiness of science teachers to implement Classroom-Based Assessment (CBA) determines the direction and success of primary school assessments in Malaysia. This pilot study aims to create and evaluate the Inventory of Science Teachers' Readiness in Implementing Classroom-based Assessment (ISTRI-CBA). There have been many studies on CBA. However, there are limitations in measuring the readiness of science teachers to implement CBA. The evaluation will be ineffective without a suitable tool to measure teacher readiness in CBA. Therefore, to determine the level of readiness of science teachers, the researcher needs an instrument that is valid, reliable, and appropriate to the context of the Ministry of Education, culture, and the current situation in Malaysia. It is necessary to have a conceptually and psychometrically substantial inventory. This challenge was addressed by developing the ISTRI-CBA, comprising five measurement dimensions: knowledge about CBA, skills of CBA, resource support, attitudes, and professional values. The development of ISTRI-CBA requires validity and reliability for its use. This study aims to (1) test the quality characteristics of the ISTRI-CBA items and (2) determine the reliability of the ISTRI-CBA obtained using the Rasch Model measurement. The research involves the administration of a survey questionnaire to 44 science teachers in a district in Malaysia. The findings show that the ISTRI-CBA, comprising 157 items, has good psychometric characteristics and meets the measurement criteria of the Rasch measurement model. The item quality and reliability also prove the suitability of the whole dimension. The study's findings provide evidence of the empirical implications that consistently support ISTRI-CBA as a valid and reliable instrument to measure teachers' readiness to implement CBA in science subjects. The findings also reveal that the ISTRI-CBA can measure science teachers' readiness to implement CBA.

Over the last several years, nationally disseminated course-based under graduate research experiences (CUREs) have emerged as an alternative to developing a novel CURE from scratch, but objective assessment of these multi-institution (network) CUREs across institutions is challenging due to differences in student populations, instructors, and fidelity of implementation. The time, money, and skills required to develop and validate a CURE-specific assessment instrument can be prohibitive. Here, we describe a co-design process for assessing a network CURE [the Prevalence of Antibiotic Resistance in the Environment (PARE)] that did not require support through external funding, was a relatively low time commitment for participating instructors, and resulted in a validated instrument that is usable across diverse PARE network institution types and implementation styles. Data collection efforts have involved over two dozen unique institutions, 42 course offerings, and over 1,300 pre-/post-matched assessment record data points. We demonstrated significant student learning gains but with small effect size in both content and science process skills after participation in the two laboratory sessions associated with the core PARE module. These results show promise for the efficacy of short-duration CUREs, an educational research area ripe for further investigation, and may support efforts to lower barriers for instructor adoption by leveraging a CURE network for developing and validating assessment tools.

This study aims to understand the experiences of Turkish teachers in blended learning, the challenges they encountered, and their recommendations in this regard. The authors adapted the Blended Teaching Readiness Instrument (BTRI) (Archibald et al., 2021) to Turkish. Secondly, the reasons, challenges, and suggestions of teachers regarding blended learning were investigated. A total of 325 Turkish teachers were selected as the participant group in this survey. A criterion purposeful sampling method was used in the data collection process. The statistical analysis led to the conclusion that the BTRI, which was translated into Turkish, is a valid and reliable tool for measuring teachers' levels of readiness for blended learning in Turkiye and it can also be used to gauge the readiness of teachers. ort he qualitative aspect, inductive content analysis was used for analyzing open-ended questions of the instrument. The study both served as a reflection of Turkish teachers' positive and negative experiences regarding blended learning practices and a scale adaptation study for measuring the blended teaching readiness of Turkish teachers. It is considered that the results can help both pre-service and in-service teachers to be sensitive toward their blended teaching competencies. This study also has the potential for informing teacher education departments to equip prospective teachers with required disciplinary knowledge along with digital competencies.

Despite growing interest in evaluating the social and emotional learning of students and the development of standardized assessment tools for this purpose, there remains a dearth of validated instruments for evaluating teachers' social and emotional skills. We set out to address this knowledge gap by investigating the psychometric characteristics of the Social-Emotional Competence Teacher Rating Scale (SECTRS) questionnaire, an instrument originally developed and validated in North America. Participants were 572 teachers from Italy (n=324), Latvia (n=139), and Portugal (n=109) ranging from 40 to 59 years of age. We performed confirmatory factor analysis procedures to validate a four-factor model measuring Teacher-student relationships, Emotion regulation, Social awareness, and Interpersonal relationships. The data supported this factorial structure, with a total of 14 items included in the final model. The outcomes of a multi-group comparison indicated that the model exhibited partial invariance, up to and including metric invariance, across the three cultural settings. We discuss these findings in relation to selecting appropriate instruments for assessing the social and emotional skills of teachers in different cultural contexts.

The SSIS SEL Brief + Mental Health Scales (SSIS SELb+MHS) are multi-informant assessments developed in the United States to assess the social and emotional learning (SEL) competencies and emotional behavior concerns (EBCs) of school-age youth. Although there are translations of the SEL items of the SSIS SELb+MHS available in other languages, a German translation has never been completed and validated, despite the growing need for SEL and mental health assessment in German-speaking countries. To address this need, this study's primary purpose was the examination of a German translation of the assessment with a specific focus on measurement invariance and concurrent validity invariance testing with 821 3rd through 6th-grade students in Austria and Germany. Results indicated that the SELb+MHS items clustered into 2 SEL factors and 2 EBC factors. With regard to measurement invariance, the SELb+MHS functioned similarly across both Austria and Germany and full scalar invariance was achieved. Additionally, the overall pattern of concurrent validity relationships was as expected and similar across countries. Implications and future directions are discussed.

The purpose of this synthesis study was to assess the reliability and validity of the Draw-A-Scientist Test (DAST) and its variations across multiple studies, aiming to understand limitations and propose modifications for future application within and beyond the science domain. Given the existence of multiple DAST versions, this study quantified the frequency of validity threats across various DAST variations. Literature review results indicated that despite its widespread use, the DAST and its variations consistently encounter challenges related to construct validity and external validity. Additionally, this synthesis identified literature limitations in testing concurrent validity, predictive validity, and inter-rater reliability when applicable.

The aim of this research is to adapt the 24-item "Learner Autonomy Scale" developed by Sereti and Giossos (2018) in higher education samples into Turkish by examining the psychometric properties of high school and secondary school samples, and to determine whether these groups are equivalent in terms of measurement invariance. The scale was applied in high school (n = 475) and secondary school (n = 395) samples consisting of 870 students. Different from the original four-factor scale form, EFA applied to both groups revealed a two-factor (factor load range: 0.308-0.775) and 21-item. Correlation values (r = 0.209-0.392, p?0.001) indicate that the factors are not strongly related. The factors produced adequate internal consistency coefficients ([alpha] = 0.706-0.866; [omega] = 0.708-0.871) and were validated by meeting the fit indices accepted in the literature for CFA. Measurement invariance tests revealed strong invariance for the structural and metric tests and partial invariance for the scalar test in high school and secondary school samples. More research is needed to determine why the intersections of items 19, 20, and 21 are not invariant. The main contribution to "learner autonomy" in this study is the adaptation and justification of a valid and reliable measurement tool for determining autonomy in the adolescent age group. The use of the adapted scale in different educational environments and in the examination of "autonomy" by adapting it specific to the field (science, mathematics, etc.) will provide important implications for further theoretical studies.

Alternative conceptions become obstacles in physics. However, it is difficult to find instruments that can identify students' alternative conceptions, especially in gases kinetic theory (DIGaKiT). The purpose of this research was to development of diagnostic instrument of DIGaKiT in identifying students' alternative conceptions by Rasch analysis model. The research method used the defining, designing, developing, and disseminating (4D). The samples are 31 students (12 male students and 19 female students, their ages were typically 16 years old) at one of the senior high schools at Belitung. Rasch analysis was used to identify the validity, reliability, and distribution of students' alternative conceptions. The result is that the level of validity and reliability of the instrument is in a good category. Meanwhile, alternative conceptions of the kinetic theory of gases can be identified in all questions, and the questions with the highest alternative conceptions are questions with code Q11 (77%) and the lowest are questions with codes Q1, Q5, and Q6 (4%). Therefore, teachers must design learning processes that can reduce students' alternative conceptions of the kinetic theory of gases material.

This study aimed to validate a scale for subjectively measuring teaching competencies for innovation in higher education. The scale was developed by creating a set of items that underwent content validity through the Delphi technique and face validity. A survey was then conducted with 523 higher education professors. The resulting scale, called the STW-ICE Scale, consists of four dimensions: continuing education, creativity, digital fluency, and scientificity. We found that the scale has psychometric properties that allow for subjective measurement of the proposed competencies. The SmartPLS and SPSS software were used for data assessment. Additionally, we found high levels of teaching skills in the sample for all dimensions. Based on these findings, this study successfully achieved its goal of developing and validating a scale. We hope that this scale will be used not only for classificatory diagnoses but also to encourage reflection on teaching practices in higher education with a focus on innovation.

The English Diagnostic Test aims to assess reading comprehension skills for first-year students at the University of Costa Rica. In 2022, this test consisted of four instruments with 55 items. Instruments were based on an academic reading, following the criteria B2+ or C1 level according to Common European Framework of Reference for languages. This paper explores the evidence of validity and reliability from 1732 first-year students virtually assessed in March of 2022, using the platform of the Programa de Evaluacion en Lenguas Extranjeras (PELEx). Results from this study demonstrated the unidimensionality of the four instruments. Cronbach's alphas for the four instruments ranged from 0.79 to 0.84. Evidence collected in this study supports the work done by the School on Modern Languages in the development of valid and reliable instruments for the English Diagnostic Test, as part of the current needs of new students for undergraduate programs at the University of Costa Rica.

Objective: This study aimed to develop and test a scale for measuring the quality of blended learning models in higher education. Methods: This research adopts a sequential mixed-method approach to construct a new measurement scale. The first phase consisted of the inductive approach to identify the items, followed by exploratory factor analysis. The identified dimensions were tested for reliability and validity in the second phase. Results: The Blended Learning Quality Assessment (BLQA) contains 4 dimensions: Technology Integration, Pedagogy and Curriculum, Physical Infrastructure, and Educator Proficiency. The scale is comprised of 26 items assessing the quality of blended learning programs in higher education. The reliability and validity of the scale were established by confirmatory factor analysis (AVE > 0.6, Cronbach's alpha > 0.85). Conclusions: In the face of changing student expectations of quality, this study introduces a comprehensive measurement scale by which institutions of higher education may effectively assess their performance. Implications: Results contribute to extant literature by proposing a comprehensive scale to measure the quality of an institution's blended learning model. The scale integrates digital aspects of pedagogy, delivery, and infrastructure and can be used to identify the dimensions contributing most to student satisfaction.

The present study aimed to validate a 70-item Korean bilingual version of the Vocabulary Size Test (VST) using Rasch modeling. The goal was to assess the applicability of this Korean version of the VST for Korean learners of English in an English as a foreign language (EFL) context by examining validity evidence based on Messick's framework. Specifically, the study focused on the content, substantive, and external aspects of construct validity. However, the findings provided weak evidence supporting the utility of the VST as a measure of receptive vocabulary for Korean EFL learners. The test was deemed too easy and lacked the ability to effectively differentiate among varying levels of second language proficiency, with many test items exhibiting unexpected behavior. Additionally, the VST showed a weak correlation with another measure of second language proficiency. In light of these findings, the study offers specific recommendations for improving the test's validity and usefulness.

This study reports on two key aspects relating to the use of the Online Learning Readiness Self-Check (OLRSC) survey, which has been proposed as identifying non-traditional students' readiness for online learning, and their strengths and weaknesses in six key areas. The first aspect validates the use of the instrument based on data from 199 students engaged in an online tertiary enabling course at a regional university in Australia. Factor analysis verified the scale structure of the instrument; however, two items were removed prior to the final analysis due to low communality and/or high cross loading with other items. This is followed by an examination of whether the instrument might be useful for the early identification of students who are at risk of disengagement from the enabling program. While it was hypothesised that the instrument, which measured factors such as the quality of interaction with peers and instructors, their capacity to manage technology and how well they managed learning, should have been a useful tool to identify early disengagement, the hypothesis was not supported. No significant associations were identified between any of the instrument's scales and early withdrawal from the course or completion of the first unit of study. Future recommendations for educators are made with a view to improving student engagement.

In this study, it was aimed to develop an achievement test taking into account the subject acquisitions of the sound and properties unit in the sixth-grade science course. In the test development phase, firstly, literature review for the study was conducted. Then, 30 multiple choice questions in align with the subject acquisition in the 2018 science curriculum. This 30-question test was presented to opinion of three academicians and a science teacher for the validity of the test. Necessary adjustments were made in line with the opinions of the experts. Subsequently, the draft test, modified according to the experts' feedback, was applied to a total of 300 seventh grade students. After the analysis, the number of questions in the test was reduced to 27. As a result of item analysis, mean difficulty index value of the test was 0.41, and item discrimination index was 0.49. The reliability analysis for the developed test was found 0.92 by calculating the KR-20 reliability coefficient value. By considering, the validity and reliability analysis results, it was concluded that the final version of the developed test, grounded in Bloom's Taxonomy, is a valid and reliable test with different difficulty levels.

This study aimed to develop a valid and reliable scale that reveals secondary school pupils' attitudes toward science literacy. The survey model, one of the quantitative research methods, was used in the study. The validity and reliability study of the scale was carried out on secondary school pupils attending public schools in Turkey in the 2022-2023 academic year. Data were collected from 546 secondary school pupils. The structure of the draft scale, established through Exploratory Factor Analysis (EFA), consisted of 16 items and 4 dimensions. The scale was administered to 392 secondary school pupils to verify the structure revealed by EFA. This validated a 16-item and 4- dimension structure. The total variance explained by the scale was 50.11%. The Cronbach alpha coefficient, which indicates the scale's internal consistency, was calculated to be 0.867. Fit indexes were calculated as X2/df =2.38, NFI= 0.92, NNFI= 0.94, RFI= 0.90, CFI= 0.95, GFI= 0.93, AGFI= 0.90, SRMR= 0.055, IFI= 0.95 and RMSEA= 0.060. In conclusion, it can be said that the "Attitude Towards Science Literacy Scale" is qualified to measure the attitude of secondary school pupils towards science literacy.

This study aimed to develop a valid and reliable measurement tool that will determine the readiness of parents of students starting the first grade of primary school to support their children during the first formal teaching of reading and writing skills. The sample consisted of 524 parents of students starting the first grade in the provinces of Ankara, Samsun, and Bartin. The scale development study was begun by first creating an item pool in line with the literature, after which a draft form was prepared on the basis of the opinions of language, field and measurement and evaluation experts. The final form was delivered to the parents online and in person, and exploratory factor analysis was conducted for the collected data. As a result of the analysis, it was determined that the scale consisting of 17 items and five factors explained 67% of the variance. Confirmatory factor analysis was performed to determine the fit of the created factorial structure and it was determined that the model fit indices were between perfect and good fit. In determining the reliability, the McDonald's ? reliability coefficient, which is suitable for multi-factor structures, was calculated and the reliability of the entire scale was found to be 0.81. On the basis of these findings, the scale was found to be a reliable and valid measurement tool suitable for measuring parents' readiness in supporting their children in formal early literacy teaching.

This study aimed to validate a modified Statistics Anxiety Scale for students in the United States taking university courses. Modifications were made by changing the wording of several items to be consistent with American English, and to accommodate students taking statistics courses in various formats. Items were added to investigate anxiety toward the use of statistical packages, and peer mentoring. Data from 352 participants and exploratory factor analyses were used to analyze the original 24-item SAS (SAS-O) and a version of the SAS with six additional items (SAS-M). The three-factor structure for SAS-O was consistent with the original validation study, explaining about 64% of the items' variance. The factor structure for SAS-M contained an additional two factors, that explained a total of 68 % of the items' variance. The factors were internally consistent, correlated with one another, and negatively correlated with Wise's Attitude Toward Statistics scale. Male students generally had lower application anxiety and examination anxiety than female students, and lower asking for help anxiety than non-traditional students.

The increasing popularity of the Common European Framework of Reference (CEFR) in non-native English-speaking countries has generated a demand for concrete examples in the creation of CEFR-based tests that assess the four main English skills. In response, this research endeavors to provide insight into the development and validation of a CEFR-based test aimed at evaluating undergraduate students' English proficiency for placement tests and exit exams. The CEFR served as the framework for item development while Classical Test Theory informed the test evaluation process. A sample of 2,248 first-year students participated in Testing 1 and 3,655 first- and second-year students took part in Testing 2. The results of the analysis of the multiple-choice listening and reading tests indicated favorable levels of item difficulty and discrimination indices, as well as high reliability coefficients obtained from Cronbach's alpha, Kuder-Richardson, and split-half reliability. The correlation and regression analyses revealed close relationships between the subtests and between each subtest and the total score, supporting the test's criterion validity. The study also demonstrated significant predictive validity on TOEIC scores. The findings of this study offer implications for the development of university-level English proficiency tests that integrate CEFR levels and CTT analysis.

The aim of this research is to adapt the scales "Homework Management, Homework Effort, Teacher Homework Involvement, Teacher Feedback and Parental Homework Support" into Turkish. The research data were collected from 1,698 secondary school students in grades 5 to 8. The sample was divided into four subgroups and explanatory factor analysis was conducted on two groups and confirmatory factor analysis was conducted on two groups. Concurrent validity analyses were carried out on all students. Data were collected from students studying in 24 classes of six different secondary schools in the Maltepe, Kartal and Pendik regions of Istanbul. 49.12% of this group of students are girls and 50.88% are boys, and the mean age of the participants is 11.84 years. In addition to the scales adapted to the Turkish language, homework behavior (homework completion, time spent on homework, going to school without homework) and academic achievement were measured for concurrent validity. The results of the EFA and CFA analyses were similar to the original scales for all scales. These findings regarding the number of sub-dimensions, the placement of scale items within these sub-dimensions, and the concurrent validity scores indicate that the Turkish versions of the five scales are valid and reliable for assessing mathematics homework at the secondary school level.

The study aims to assess online assessment practices in a public university, addressing questions about self-efficacy levels, tools used, challenges faced, and proposed solutions. The chosen methodology employs a cross-sectional survey design, collecting both quantitative and qualitative data from 50 instructors in Türkiye through a convenience sampling method. Results indicate a moderate level of self-efficacy among participants, with challenges identified in monitoring student progress objectively and incorporating alternative assessment techniques. The study highlights a preference for summative assessments, particularly assignments, projects, and quizzes. Discussions and e-portfolios are less favored. The instructors addressing challenges in online assessment employ various precautions across assessment tools, processes, assessors, and the Learning Management System (Canvas). The strategies include enhancing question quality, favoring higher-order thinking skills, utilizing diverse assessment tools, and implementing precautions like item banks. During the assessment process, precautions involve considerations for exam duration, informing students, and encouraging professional development. In the Learning Management System, instructors rearrange options, enforce single answers, and seek assistance for technical challenges. To ensure internal validity, teachers have opted for measures to prepare questions according to lesson achievements, improve communication with students, and use different measurement tools. Findings resonate with the Technological Pedagogical Content Knowledge (TPACK) model, showcasing the integration of technological, pedagogical, and content knowledge to enhance online assessments' reliability and validity. The findings suggest a need for professional development to enhance instructors' competencies in addressing challenges and promoting a more balanced use of assessment methods in online education.

This study aims to develop Nature of Science (NOS) measurement instrument for high school students in the Mathematics and Natural Sciences program using COVID-19 cases that had occurred since the end of 2019. This study also attempts to validate test items with the Rasch model approach. The participants in this study are 194 high school students from the Mathematics and Natural Sciences program. Test participants consist of 132 female students and 62 male students. Their age range is 18-21 years old. NOS measurement instrument is presented in multiple choice form, which consists of 16 questions with narration or readings about COVID-19. Data analysis is conducted by dividing the validity into three types, those are content aspect validity, psychometric aspect validity, and construct validity using Rasch model. Content validity is conducted with an assessment involving three experts related to the test material and measured scientific literacy achievement. Psychometric aspects validity involves three psychometricians associated with the construction of the test. Meanwhile, for construct validity, which refers to the concept of construct validity of Messick. The results shows that there are 8 of 16 items in the NOS measurement that occupies all aspects of validity. Regarding to content of construct validity, there are two items do not appropriate with the model, while with substantive validity 94.4% of the test are consistent with the used Rasch model. Regarding to external aspect of construct validity shows that the test instrument can differentiate test participants into two categories, each of which has high and low NOS abilities.

Self concept is an experiential formation gained as a result of certain experiences. The concept of self-concept has an interesting intersection with the psychological field of humour. The aim of the study is to examine the relationship between the humor styles and self-perceptions of primary school 4th grade students and to conduct the validity-reliability study of the humor styles measurement tool. The study group of the research was carried out with 525 students attending the 4th grade of primary school. "Humor Styles Questionnaire for Young Children" (HSQ-Y) and "Self-Perception Profile for Children" (CIBAP) were used as data collection tools. In the analysis of the research, first of all, the validity-reliability study of the humor styles questionnaire was conducted and the correlational scanning method of the general scanning model was used to examine the relationship between humor styles and self-perceptions of primary school students. In the results of the research; The humor styles questionnaire was found to be valid and reliable. In the relationship between; The sub-dimension of the humor styles questionnaire reveals the positive and significant relationship of the "participatory humor style" with all the sub-dimensions of the self-perception profile for children, and the "self-enhancing humor style" with the sub-dimension of "social acceptance". In the study, it was also observed that "aggressive humor style" was negatively related to "educational competence", "behavioral management", "social acceptance" "general self-worth" sub-dimensions, and "self-destructive humor style" was negatively related to "athletic competence" sub-dimensions.

The aim of this research is to develop a scale for determining pre-service teachers' attitudes towards recycling. The research was carried out using a quantitative research design. The research was carried out in the education faculties of two state universities located in the east and west of Türkiye. 284 pre-service teachers (62 males, 222 females) who were selected by the easily accessible sampling method participated in the research. During the scale development process, an item pool consisting of 56 statements was created. The draft scale, which was prepared after the expert opinion, was applied to the pre-service teachers. After validity and reliability analysis, three factors with 32 items were obtained, which explained 42.456% of the total variance. The factors were named "Responsibility and Behavior," "Consciousness and Awareness," and "Economic Value", respectively. The Cronbach"s Alpha coefficient was calculated as 0.893 for the "Responsibility and Behavior" factor, 0.785 for the "Consciousness and Awareness" factor, and 0.801 for the "Economic Value" factor. In addition, Cronbach's Alpha was calculated as 0.884 for the overall scale. According to the findings, it can be said that this scale developed in the research is sufficient in terms of validity and reliability. However, in future studies, similar scales with confirmatory factor analysis can be developed and applied to large samples to examine participants' attitudes toward recycling.

The COVID-19 epidemic has precipitated a rapid and widespread adoption of online education, leading to its normalization in contemporary society. Online education is evident across several educational levels. However, assessing the efficacy and effectiveness of these training programs can only be achieved by implementing a suitable evaluation methodology. One of the primary challenges associated with online education is the difficulty in assessing its quality and effectiveness. One of the contributing factors to this issue is the instructor's lack of technological skills and knowledge relevant to online teaching. This research aims to develop a scale (Online Evaluation Awareness-OnEvA) to determine the instructors' awareness of online evaluation. 165 participants' data from 63 universities was used for exploratory factor analysis. The items of the scale are designed to measure awareness in both pedagogical and technological dimensions. The items in the pedagogical dimension include the essential competencies that instructors should possess, and alternative evaluation methods offered online. In the technological dimension, the items are created to determine instructors' awareness of the use of technological platforms and tools. For the next step, a confirmatory factor analysis was performed to establish the scale's construct validity with 161 instructors. Additionally, the scale's internal consistency was determined to be high, with a Cronbach's alpha of 0.964. It is affirmed that this awareness scale developed within the scope of this research will contribute to the development of future models or frameworks related to the dimensions of evaluation knowledge in online learning.

This study was designed considering the necessity of a questionnaire (validated on Romanian population and built after consulting the available papers on the subject) for evaluating the resilience of adolescents. It was focused on further developing the ARES ("Adolescents' Resilience Evaluation Scale", built in 2018 as a pilot-study, with 62 subjects). This new form (ARES-i25) includes new theoretical aspects, new items and it was completed by 423 subjects. Using factorial exploratory analysis, five factors (which explained 72,1% of the variance of resilience) were identified: tenacity and self-efficiency; self-confidence; learn from life experiences; rapid recovery after trauma; social and familial resources. The reliability was proven by its internal consistency ([alpha]= 0.83 on a general level, and subscales 0.71<[alpha]> 0.89), while its concurrent validity was proven by 0.05 0.75 (comparing the results to those of BRS - Smith et al., 2008) thus proving the adequate psychometric qualities of the new form of ARES-i25. Future studies will focus on extending the sample and on applying ARES-i25 in other countries and creating programs for developing resilience.

There is a clear need for highly competent health sciences experts. No instrument currently exists for assessing the generic competences of health sciences students. The aim of this study is to develop and psychometrically test the Health sciences Generic Competence (HealthGenericCom) instrument. The instrument development four step process has been conducted with a cross-sectional study design and according to the COSMIN guidelines. Face and content validity was tested by 13 experts, structural validity was tested with exploratory factor analysis, and internal consistency was evaluated by calculating Cronbach's alpha. The structural validity was tested using data from Finnish health sciences students (n=276). The content validity index of the whole HealthGenericCom instrument was 1 for relevance and for clarity. Using exploratory factor analysis a model of eight factors (with 88 items) was created: 1) competence in leadership, administration, and finance; 2) competence in people-centred guidance; 3) competence in health promotion; 4) competence in evidence-based practice; 5) digital competence; 6) competence in work well-being and self-management; 7) competence in collaboration and problem-solving; and 8) competence in societal interaction. The HealthGenericCom was shown to be valid and reliable and provides an evidence-based conceptual framework that can be used in developing curriculums and competence management.

The importance of understanding student attitudes has become paramount in the successful deployment of blended learning. This study aimed to examine the factorial structure of a scale designed to assess university students' attitudes towards blended learning. Using a descriptive quantitative research approach, the study included a sample of 889 male and female students from the University of Tabuk, located in the Kingdom of Saudi Arabia. The participants were selected randomly from different academic majors and levels of study. The instrument employed in this study was the Blended Learning Attitudes Scale, a tool designed by the researcher and subjected to rigorous validation procedures. The researcher utilised exploratory and confirmatory factor analyses to understand the latent variables the scale represented comprehensively. The study's findings indicated the presence of a three-factor model, encompassing participants' perceptions of the nature of blended learning, its perceived importance, and their willingness to utilise it. The combined influence of these three factors accounted for 64% of the observed variance. The scale had noteworthy psychometric features, as evidenced by its high-reliability coefficients and robust validity indicators. This study presents a reliable instrument that educators and researchers may utilise to assess university students' attitudes towards blended learning.

This study aims to develop an online test that can be used to characterize students' conception of objects in static fluid. The test developed by carried out several stages, namely: modified previous essay test and formed the Tier-1 of multiple-choice questions with options taken from the findings previous studies; combined the reasons for choosing options in Tryout-1 and the findings of previous studies for forming Tier-2; expert validation process; refinement process, readability test tryout with revisions; data collection involving 318 pre-service elementary school teachers to characterize the online test based on item response theory; and revised some items. Rasch analysis was implemented to characterized the test and subjects. The developed test consists of 23 items in two-tier covering the context of floating, sinking, and suspending objects. The results of validation showed that in the development process, the test has very good for item validity. Rasch analysis showed that, overall, the test functioned well with its item reliability is very good category. Based on the findings and difficulty level, the test can be used for middle school students up to college level with some notion. Some limitations of the test are presented in this paper.

This study aims to develop a test to measure sixth grade students' success in 'Circulatory System'. For this purpose, a draft test containing 22 questions was prepared by the researchers. And then, the draft test was submitted to expert opinion and examined in terms of language and content. Following expert opinions, the 22 multiple-choice questions were administered to 128 seventh graders attended to two different secondary schools. Item analysis was performed in the data and thus, two questions were removed from the draft test. According to the findings, the overall item difficulty value of the 20-question final test was calculated as 0.654, and the item discrimination value was calculated as 0.54. KR-20 reliability coefficient of the test was 0.71. Seven of the questions are at the remembering level. Additionally, there were eight questions at the understanding level and five questions at the analysis level according to Bloom' revised taxonomy.

The insertion of Machine Learning (ML) in everyday life demonstrates the importance of popularizing an understanding of ML already in school. Accompanying this trend arises the need to assess the students' learning. Yet, so far, few assessments have been proposed, most lacking an evaluation. Therefore, we evaluate the reliability and validity of an automated assessment of the students' learning of an image classification model created as a learning outcome of the "ML for All!" course. Results based on data collected from 240 students indicate that the assessment can be considered reliable (coefficient Omega = 0.834/Cronbach's alpha [alpha] = 0.83). We also identified moderate to strong convergent and discriminant validity based on the polychoric correlation matrix. Factor analyses indicate two underlying factors "Data Management and Model Training" and "Performance Interpretation", completing each other. These results can guide the improvement of assessments, as well as the decision on the application of this model in order to support ML education as part of a comprehensive assessment.

Sense of coherence (SOC) is a relevant contributor and predictor of the individuals' mental and physical health. There are a number of studies about SOC, but only two validation articles of the sense of coherence scale (SOCS) were found on adolescents and none on children. The aim of this research was to validate the SOC scale in youth under 18. We hypothesized that younger children and children without psychiatric problems will have higher SOC than older ones, and children with psychiatric symptoms. We also wanted to examine the factor structure of both the 13 and the 29 item versions of the scale to study which is more valid in child and adolescent population. 199 children and 198 adolescents were included in the study; the mean age was 14.3 (SD 2.1) years. The sample included average youth from schools and youth under psychiatric treatment. Strength and Difficulties Questionnaire (SDQ) and Inventory of Life Quality (ILK) were used for validation of the SOCS. SOCS-13 was applied to compare SOC of children and adolescents. Children had higher SOC than adolescents in both samples. Males had higher SOC than females in children but not in adolescents. Psychiatric and behavioral symptoms were associated with a lower SOC regardless

The goal of this study is to create the Zero Waste Attitude Scale, which will be used to determine the zero-waste attitude of social studies teacher candidates and to conduct validity and reliability studies. The data for the study were collected with a 5-point Likert-type form from pre-service teachers studying in the social studies teaching department of some universities in Türkiye. Explanatory factor analysis, confirmatory factor analysis (CFA), and reliability studies were performed on the collected data. Cronbach's alpha and McDonald's Omega methods were used for reliability analysis. As a result of the analysis, it was determined that the scale consisted of 27 items and 3 factors. In total, the factors explained 50.09% of the common variance. As a result of the analysis, the fit index values of the scale [chi-square]/sd =1.96, RMSEA=0.06, PGFI=0.70, GFI=0.85, RMR=0.08, SRMR=0.06, NFI=0.95, AGFI=0.81, PNFI=0.84, CFI=0.97, RFI=0.94, NNFI=0.97, IFI=0.97, while GFI, RMR, AGFI, SRMR, and RFI values correspond to acceptable fit; [chi-square]/sd, RMSEA, IFI, NFI, NNFI , PGFI, PNFI, and CFI seem to correspond to a perfect fit. The reliability coefficient of the scale was 0.90 for both Cronbach Alpha and McDonald's Omega. The scores obtained from the scale are valid and reliable.

This article examines faculty motivation to integrate community engagement (CE) into teaching and research, in relation to faculty identity, rank and status, experience, and faith. Building upon previous research that focused on intrinsic and extrinsic motivators, our study also examined the role of an institutional definition of CE with clear criteria, as outlined by the Community Engagement Institutional Assessment (CEIA) rubric, in the motivational cycles of faculty reflection on current and aspirational aspects of CE. Surprisingly, our results illustrate that even when colleges and universities support CE across the institution, faculty may not be significantly motivated by this expressed valuing of CE. Importantly, our findings indicate that faculty would like to achieve the aspirational status on all criteria, pointing to the potential for the rubric to bridge the gap between institutional mission and individual faculty motivations. Enhancing this alignment may increase sustained and meaningful impact on the community.

The objective of this research is to construct a scale for assessing the extent of parents' 'sharenting' behavior and to assess its psychometric characteristics. The development of the Sharenting Scale commenced with a comprehensive review of relevant literature. Subsequently, a preliminary version of the scale was administered to 300 parents who utilize social media platforms. Exploratory Factor Analysis was conducted on the collected data, revealing a two-factor structure comprising nine items. The analysis indicated that the two-factor structure accounted for 66.51% of the total variance. Confirmatory Factor Analysis was conducted using data collected from 191 parents who completed the aforementioned scale. The goodness-of-fit indices indicated satisfactory fit values: X[superscript 2]/df= 2.06, RMSEA= 0.075, CFI= 0.96, IFI= 0.96, TLI= 0.95, GFI= 0.94, NFI= 0.93. The convergent validity of the scale was assessed through the calculation of Average Variance Extracted and Composite Reliability values. Furthermore, the internal consistency reliability of the Sharenting Scale was evaluated using Cronbach's Alpha coefficient, yielding a value of 0.82. Additionally, the stability of the scale was examined via a test-retest method, resulting in a correlation coefficient of 0.83. Based on these findings, it can be concluded that the Sharenting Scale demonstrates both validity and reliability as a measurement tool for assessing parents' 'sharenting' behavior.

Evaluation of child-friendly school (CFS) policies is essential to determine the achievements of school efforts in reducing violence cases. This research aims to proving the reliability and validity of CFS policy evaluation instruments in elementary schools with different locations. This investigation uses the Context Input Process Product (CIPP) evaluation model to confirm the factor structure or dimensions of several observed variables (items) to evaluate the reliability and validity of the CFS policy evaluation tool in elementary schools. The validity and reliability of previously created instruments are evaluated quantitatively, but this study utilises different subjects and study sites. There were 320 respondents, with 145 school principals and 175 teachers taken randomly. Confirmatory factors analysis (CFA) results show goodness of fit (GOF), and the model is acceptable. The CFS evaluation instrument can be accepted after eliminating several question items and modifying them. All items of the teal instrument meet the goodness of fit criteria in terms of chi-square and root mean square error of approximation (RMSEA). The instrument for evaluating CFS policies in primary schools using the CIPP model has met a valid and reliable psychometric property test so that it can be applied.

The objective of this study was to develop a measure that possesses both reliability and validity in order to evaluate innovative thinking within the realm of education. To achieve this, the instrument's validity and reliability were evaluated through quantitative methods in two distinct phases. A team of educational experts conducted the process of establishing content validity and ensuring that the items on the instrument accurately reflected the intended constructs of creative thinking. Following that, the assessment of concept validity was conducted using confirmatory factor analyses. The aforementioned investigations resulted in the discovery of a five-factor solution consisting of 25 elements, all of which demonstrated scores beyond the crucial threshold. This successful outcome confirmed the presence of distinct factors representing different dimensions of innovative thinking. The study enrolled 1250 students from vocational education institutions as participants. The data obtained from the participants was subjected to principal component analysis and confirmatory factor analysis, leading to the development of a model that exhibited a good match with the empirical data. This indicated the effectiveness of the developed instrument in measuring innovative thinking capacity. In conclusion, the research effectively developed an accurate and dependable tool for evaluating innovative thinking in the realm of education. The gathering of positive data from the participants and meticulous quantitative analyses were responsible for this.

This research paper investigated the importance of conducting measurement invariance analysis in developing measurement tools for assessing differences between and among study variables. Most of the studies, which tended to develop an inventory to assess the existence of an attitude, behavior, belief, IQ, or an intuition in a person's characterological profile, ignored testing measurement invariance for equivalency between comparable variables. With this finding, measurers lack in true validity and reliability and suffer methodological bias and have little or no chance to figure out the true differences between variables being studied. This article, therefore, explains the necessity and use of measurement invariance analysis when a researcher wanted to develop a new measurement tool or adapt a tool from one source language to another target language. The types of measurement invariance levels mentioned in this study are configural-invariance, scalar invariance, metric invariance and structural invariance analysis. The approaches used to conduct those invariance models and the way they have been interpreted were all discussed in great detail with a robust collection of supportive literature.

The COVID-19 pandemic has had a significant impact on high-stakes testing, including the national benchmark tests in South Africa. Current linear testing formats have been criticized for their limitations, leading to a shift towards Computerized Adaptive Testing [CAT]. Assessments with CAT are more precise and take less time. Evaluation of CAT programs requires simulation studies. To assess the feasibility of implementing CAT in NBTs, SimulCAT, a simulation tool, was utilized. The SimulCAT simulation involved creating 10,000 examinees with a normal distribution characterized by a mean of 0 and a standard deviation of 1. A pool of 500 test items was employed, and specific parameters were established for the item selection algorithm, CAT administration rules, item exposure control, and termination criteria. The termination criteria required a standard error of less than 0.35 to ensure accurate abilities estimation. The findings from the simulation study demonstrated that fixed-length tests provided higher testing precision without any systematic error, as indicated by measurement statistics like CBIAS, CMAE, and CRMSE. However, fixed-length tests exhibited a higher item exposure rate, which could be mitigated by selecting items with fewer dependencies on specific item parameters (a-parameters). On the other hand, variable-length tests demonstrated increased redundancy. Based on these results, CAT is recommended as an alternative approach for conducting NBTs due to its capability to accurately measure individual abilities and reduce the testing duration. For high-stakes assessments like the NBTs, fixed-length tests are preferred as they offer superior testing precision while minimizing item exposure rates.

Background: The STEM education system has garnered significant interest due to its innovative approach in creating a multidisciplinary and integrated knowledge structure that connects science, technology, engineering, and mathematics, and allows students to apply scientific knowledge in a comprehensive and holistic manner. Consequently, evaluating the teaching methods of teachers in accordance with STEM standards is critical. This assessment should take into account various educational objectives, including cognitive, skill-based, and emotional aspects. Purpose: This study aimed to evaluate the creative teaching practices of mathematics teachers for gifted students according to STEM standards. Method: The study applied the descriptive analytical method and developed a rating scale for evaluating creative teaching practices based on STEM standards, verifying the psychometric properties in several ways. The study sample consisted of 64 teachers of mathematics for gifted students. Results: The results showed that the degree of application of creative teaching practices by the teachers of gifted students according to STEM standards was at the moderate level in three domains: planning, implementation, and assessment. Conclusions: Despite the importance of achieving integration for STEM, the actual teaching practices of teachers of the gifted according to these standards were generally average and did not reach acceptable and ambitious levels.

High-stakes examinations enjoy widespread use as summative assessments in higher education. We review the arguments for and against their use, across seven common themes: memory recall and knowledge retention; student motivation and learning; authenticity and real-world relevance; validity and reliability; academic misconduct and contract cheating; stress, anxiety and wellbeing; and fairness and equity. For each theme, we evaluate empirical evidence for the perceived pedagogical benefits and pedagogical drawbacks of high-stakes examinations. We find that relatively few of the perceived academic benefits of high-stakes examinations have a strong evidence base. Support for their use is largely rooted in opinion and pragmatism, rather than being justified by scientific evidence or pedagogical merit. By contrast, there is substantial evidence for pedagogical drawbacks of high-stakes summative examinations. We conclude that the current heavy reliance on high-stakes final examinations in many university subjects is poorly justified by the balance of empirical evidence.