Search

The rise and growing prevalence of juvenile delinquency is a matter of concern for many parties. This study aims to establish a research instrument in the form of a questionnaire that can be deployed to assess the learning environment perceived by high school students. This research endeavor constitutes a developmental study, wherein the outcomes are a single survey instrument encompassing six variables, nineteen indicators, and forty questions. The data-collecting process involved the utilization of a Google Form across five schools in five districts, containing a total of 1615 participants. The analysis of expert data was conducted utilizing V. Aiken and field trials employing confirmatory factor analysis (CFA) Second Order. The findings of this study indicate that the diagnostic survey instrument used to assess the learning environment's impact on the mental health of high school students demonstrated validity, as evidenced by loading factor values exceeding the established minimal threshold. The reliability of the instrument remains insufficient. This survey can be utilized to detect adolescent persistent tendencies carried out by students or other school members that interfere with mental health: the emergence and significant raising of juvenile delinquency.

Teacher readiness is the willingness of a teacher to implement a planned program successfully. Readiness is crucial in ensuring a program can be implemented at the individual or organizational level. The readiness of science teachers to implement Classroom-Based Assessment (CBA) determines the direction and success of primary school assessments in Malaysia. This pilot study aims to create and evaluate the Inventory of Science Teachers' Readiness in Implementing Classroom-based Assessment (ISTRI-CBA). There have been many studies on CBA. However, there are limitations in measuring the readiness of science teachers to implement CBA. The evaluation will be ineffective without a suitable tool to measure teacher readiness in CBA. Therefore, to determine the level of readiness of science teachers, the researcher needs an instrument that is valid, reliable, and appropriate to the context of the Ministry of Education, culture, and the current situation in Malaysia. It is necessary to have a conceptually and psychometrically substantial inventory. This challenge was addressed by developing the ISTRI-CBA, comprising five measurement dimensions: knowledge about CBA, skills of CBA, resource support, attitudes, and professional values. The development of ISTRI-CBA requires validity and reliability for its use. This study aims to (1) test the quality characteristics of the ISTRI-CBA items and (2) determine the reliability of the ISTRI-CBA obtained using the Rasch Model measurement. The research involves the administration of a survey questionnaire to 44 science teachers in a district in Malaysia. The findings show that the ISTRI-CBA, comprising 157 items, has good psychometric characteristics and meets the measurement criteria of the Rasch measurement model. The item quality and reliability also prove the suitability of the whole dimension. The study's findings provide evidence of the empirical implications that consistently support ISTRI-CBA as a valid and reliable instrument to measure teachers' readiness to implement CBA in science subjects. The findings also reveal that the ISTRI-CBA can measure science teachers' readiness to implement CBA.

Despite growing interest in evaluating the social and emotional learning of students and the development of standardized assessment tools for this purpose, there remains a dearth of validated instruments for evaluating teachers' social and emotional skills. We set out to address this knowledge gap by investigating the psychometric characteristics of the Social-Emotional Competence Teacher Rating Scale (SECTRS) questionnaire, an instrument originally developed and validated in North America. Participants were 572 teachers from Italy (n=324), Latvia (n=139), and Portugal (n=109) ranging from 40 to 59 years of age. We performed confirmatory factor analysis procedures to validate a four-factor model measuring Teacher-student relationships, Emotion regulation, Social awareness, and Interpersonal relationships. The data supported this factorial structure, with a total of 14 items included in the final model. The outcomes of a multi-group comparison indicated that the model exhibited partial invariance, up to and including metric invariance, across the three cultural settings. We discuss these findings in relation to selecting appropriate instruments for assessing the social and emotional skills of teachers in different cultural contexts.

The study aims to introduce to the Turkish culture a measurement tool that has proven validity and reliability in determining the level of quiet quitting among teachers. It involves the analysis of the validity and reliability of the Quiet Quitting Scale, as the scale is adapted to the Turkish culture. The scale, originally developed in English, was adapted to Turkish using data from teachers employed in public schools who were selected through convenience sampling. Confirmatory factor analysis was initially used to assess the construct validity of the original structure of the scale within the Turkish context. The findings indicated a good fit to the four-factor model, supported by adequate factor loadings and fit indices, thus confirming the scale's validity within the Turkish culture. Reliability evaluation included internal consistency coefficients, test-retest stability, and composite reliability, all exceeding the threshold values. The test-retest analysis confirmed the stability of the scale, while the composite reliability analysis further supported its reliability. Measurement invariance across gender and tenure was examined, confirming that the scale can provide reliable comparisons across these demographic groups. Overall, these results demonstrate the successful adaptation of the Quiet Quitting Scale to Turkish culture and are supported by strong evidence of its validity and reliability.

Mental imagery is a vital cognitive skill that significantly influences how reality is perceived while creating art. Its multifaceted nature reveals various dimensions of creative expression, amplifying the inherent complexities of measuring it. This study aimed to shorten the Mental Imagery Scale in Artistic Creativity (MISAC) via the Ant Colony Optimization algorithm (ACO), a metaheuristic methodology for developing psychometrically robust brief scales. Answering 63 items in the original version of MISAC demands a higher cognitive load and, consequently, more time. Therefore, our goal was to shorten it while preserving its psychometric properties. In this study, responses to the MISAC were obtained from 500 undergraduate students enrolled in an art education program. The items on the short form of the MISAC were selected based on pre-specified validity criteria and content representability. The 28-item short form of MISAC demonstrated comparable performance to the original version regarding construct validity, criteria-related validity, and reliability coefficients. Moreover, strict invariance was attained across both gender groups in the validation process of the short form. These results highlight the utility of the shortened version of the MISAC as a valid measure with minimal loss of information of scores compared to the full version.

In the present study, the Teacher Formative Assessment Literacy Scale (TFALS), developed by Yan and Pastore (2022a), was translated into Turkish to examine the factor structure and psychometric characteristics of the scale in a Turkish sample. Data was collected from 318 teachers, of whom 168 were males and 150 were females, working in different state schools in a city in the Central Anatolia Region of Türkiye. As the first step, the scale items were translated and back-translated by experts in both English and Turkish. Afterward, experts were presented with the scale to check for consistency and accuracy based on the feedback received. A pilot study was carried out to establish the linguistic equivalence of the scale, followed by an examination of its structural validity in a Turkish sample. To demonstrate evidence of the confirmed factor structure of TFALS with 22 items, the confirmatory factor analysis (CFA) was conducted. The CFA results demonstrated that the three-factor model of the TFALS-Turkishversion had adequate fit indices. The Cronbach's alpha coefficient of the total scale was found to be 0.93. The Cronbach's alpha for each of the dimensions of TFALS was 0.90 for the conceptual dimension (7 items), 0.86 for the practical dimension (8 items), and 0.88 for the socio-emotional dimension (7 items). Composite reliability coefficients of the dimensions ranged from 0.78 to 0.84. The results of this study provide important evidence for the validity and reliability of the Turkish version of the TFALS, confirming that it has good psychometric properties in a Turkish sample.

The Torrance Tests of Creative Thinking Figural Forms A and B are widely used to measure creative potential. Despite their common application in research, there has been a lack of focus on the psychometric properties of the tests. Thus, the scoring of the items is based on some unexamined hypotheses. The items are hypothesized to be equally difficult, and the response categories are hypothesized to be equally distributed. Additionally, it is hypothesized that the items measure a single cognitive factor for each creative thinking skill and that each creative thinking skill is a different cognitive factor. Given the impact of these hypotheses on the validity of the test scores, it is crucial to investigate these four hypotheses. In the present study, Rasch-based analyses and correlation analyses were conducted to examine all these hypotheses for Form A. The data were collected from 157 second-grade students in Turkey. The findings showed that a) the items were equally difficult for only elaboration, internal visualization, and humor; b) the response categories were equally distributed for only resistance to premature closure and elaboration; c) the items measured a single cognitive factor for each creative thinking skill; and d) certain creative thinking skills were highly correlated (r [greater than or equal to] 0.90). Overall, the items in Form A possess sufficient quality for assessing the majority of the creative thinking skills. Nevertheless, some revisions to the scoring of the items may be needed.

The aim of this research is to adapt the scales "Homework Management, Homework Effort, Teacher Homework Involvement, Teacher Feedback and Parental Homework Support" into Turkish. The research data were collected from 1,698 secondary school students in grades 5 to 8. The sample was divided into four subgroups and explanatory factor analysis was conducted on two groups and confirmatory factor analysis was conducted on two groups. Concurrent validity analyses were carried out on all students. Data were collected from students studying in 24 classes of six different secondary schools in the Maltepe, Kartal and Pendik regions of Istanbul. 49.12% of this group of students are girls and 50.88% are boys, and the mean age of the participants is 11.84 years. In addition to the scales adapted to the Turkish language, homework behavior (homework completion, time spent on homework, going to school without homework) and academic achievement were measured for concurrent validity. The results of the EFA and CFA analyses were similar to the original scales for all scales. These findings regarding the number of sub-dimensions, the placement of scale items within these sub-dimensions, and the concurrent validity scores indicate that the Turkish versions of the five scales are valid and reliable for assessing mathematics homework at the secondary school level.

This study aims to develop Nature of Science (NOS) measurement instrument for high school students in the Mathematics and Natural Sciences program using COVID-19 cases that had occurred since the end of 2019. This study also attempts to validate test items with the Rasch model approach. The participants in this study are 194 high school students from the Mathematics and Natural Sciences program. Test participants consist of 132 female students and 62 male students. Their age range is 18-21 years old. NOS measurement instrument is presented in multiple choice form, which consists of 16 questions with narration or readings about COVID-19. Data analysis is conducted by dividing the validity into three types, those are content aspect validity, psychometric aspect validity, and construct validity using Rasch model. Content validity is conducted with an assessment involving three experts related to the test material and measured scientific literacy achievement. Psychometric aspects validity involves three psychometricians associated with the construction of the test. Meanwhile, for construct validity, which refers to the concept of construct validity of Messick. The results shows that there are 8 of 16 items in the NOS measurement that occupies all aspects of validity. Regarding to content of construct validity, there are two items do not appropriate with the model, while with substantive validity 94.4% of the test are consistent with the used Rasch model. Regarding to external aspect of construct validity shows that the test instrument can differentiate test participants into two categories, each of which has high and low NOS abilities.

This study was designed considering the necessity of a questionnaire (validated on Romanian population and built after consulting the available papers on the subject) for evaluating the resilience of adolescents. It was focused on further developing the ARES ("Adolescents' Resilience Evaluation Scale", built in 2018 as a pilot-study, with 62 subjects). This new form (ARES-i25) includes new theoretical aspects, new items and it was completed by 423 subjects. Using factorial exploratory analysis, five factors (which explained 72,1% of the variance of resilience) were identified: tenacity and self-efficiency; self-confidence; learn from life experiences; rapid recovery after trauma; social and familial resources. The reliability was proven by its internal consistency ([alpha]= 0.83 on a general level, and subscales 0.71<[alpha]> 0.89), while its concurrent validity was proven by 0.05 0.75 (comparing the results to those of BRS - Smith et al., 2008) thus proving the adequate psychometric qualities of the new form of ARES-i25. Future studies will focus on extending the sample and on applying ARES-i25 in other countries and creating programs for developing resilience.

There is a clear need for highly competent health sciences experts. No instrument currently exists for assessing the generic competences of health sciences students. The aim of this study is to develop and psychometrically test the Health sciences Generic Competence (HealthGenericCom) instrument. The instrument development four step process has been conducted with a cross-sectional study design and according to the COSMIN guidelines. Face and content validity was tested by 13 experts, structural validity was tested with exploratory factor analysis, and internal consistency was evaluated by calculating Cronbach's alpha. The structural validity was tested using data from Finnish health sciences students (n=276). The content validity index of the whole HealthGenericCom instrument was 1 for relevance and for clarity. Using exploratory factor analysis a model of eight factors (with 88 items) was created: 1) competence in leadership, administration, and finance; 2) competence in people-centred guidance; 3) competence in health promotion; 4) competence in evidence-based practice; 5) digital competence; 6) competence in work well-being and self-management; 7) competence in collaboration and problem-solving; and 8) competence in societal interaction. The HealthGenericCom was shown to be valid and reliable and provides an evidence-based conceptual framework that can be used in developing curriculums and competence management.

The importance of understanding student attitudes has become paramount in the successful deployment of blended learning. This study aimed to examine the factorial structure of a scale designed to assess university students' attitudes towards blended learning. Using a descriptive quantitative research approach, the study included a sample of 889 male and female students from the University of Tabuk, located in the Kingdom of Saudi Arabia. The participants were selected randomly from different academic majors and levels of study. The instrument employed in this study was the Blended Learning Attitudes Scale, a tool designed by the researcher and subjected to rigorous validation procedures. The researcher utilised exploratory and confirmatory factor analyses to understand the latent variables the scale represented comprehensively. The study's findings indicated the presence of a three-factor model, encompassing participants' perceptions of the nature of blended learning, its perceived importance, and their willingness to utilise it. The combined influence of these three factors accounted for 64% of the observed variance. The scale had noteworthy psychometric features, as evidenced by its high-reliability coefficients and robust validity indicators. This study presents a reliable instrument that educators and researchers may utilise to assess university students' attitudes towards blended learning.

Sense of coherence (SOC) is a relevant contributor and predictor of the individuals' mental and physical health. There are a number of studies about SOC, but only two validation articles of the sense of coherence scale (SOCS) were found on adolescents and none on children. The aim of this research was to validate the SOC scale in youth under 18. We hypothesized that younger children and children without psychiatric problems will have higher SOC than older ones, and children with psychiatric symptoms. We also wanted to examine the factor structure of both the 13 and the 29 item versions of the scale to study which is more valid in child and adolescent population. 199 children and 198 adolescents were included in the study; the mean age was 14.3 (SD 2.1) years. The sample included average youth from schools and youth under psychiatric treatment. Strength and Difficulties Questionnaire (SDQ) and Inventory of Life Quality (ILK) were used for validation of the SOCS. SOCS-13 was applied to compare SOC of children and adolescents. Children had higher SOC than adolescents in both samples. Males had higher SOC than females in children but not in adolescents. Psychiatric and behavioral symptoms were associated with a lower SOC regardless

The objective of this research is to construct a scale for assessing the extent of parents' 'sharenting' behavior and to assess its psychometric characteristics. The development of the Sharenting Scale commenced with a comprehensive review of relevant literature. Subsequently, a preliminary version of the scale was administered to 300 parents who utilize social media platforms. Exploratory Factor Analysis was conducted on the collected data, revealing a two-factor structure comprising nine items. The analysis indicated that the two-factor structure accounted for 66.51% of the total variance. Confirmatory Factor Analysis was conducted using data collected from 191 parents who completed the aforementioned scale. The goodness-of-fit indices indicated satisfactory fit values: X[superscript 2]/df= 2.06, RMSEA= 0.075, CFI= 0.96, IFI= 0.96, TLI= 0.95, GFI= 0.94, NFI= 0.93. The convergent validity of the scale was assessed through the calculation of Average Variance Extracted and Composite Reliability values. Furthermore, the internal consistency reliability of the Sharenting Scale was evaluated using Cronbach's Alpha coefficient, yielding a value of 0.82. Additionally, the stability of the scale was examined via a test-retest method, resulting in a correlation coefficient of 0.83. Based on these findings, it can be concluded that the Sharenting Scale demonstrates both validity and reliability as a measurement tool for assessing parents' 'sharenting' behavior.

Evaluation of child-friendly school (CFS) policies is essential to determine the achievements of school efforts in reducing violence cases. This research aims to proving the reliability and validity of CFS policy evaluation instruments in elementary schools with different locations. This investigation uses the Context Input Process Product (CIPP) evaluation model to confirm the factor structure or dimensions of several observed variables (items) to evaluate the reliability and validity of the CFS policy evaluation tool in elementary schools. The validity and reliability of previously created instruments are evaluated quantitatively, but this study utilises different subjects and study sites. There were 320 respondents, with 145 school principals and 175 teachers taken randomly. Confirmatory factors analysis (CFA) results show goodness of fit (GOF), and the model is acceptable. The CFS evaluation instrument can be accepted after eliminating several question items and modifying them. All items of the teal instrument meet the goodness of fit criteria in terms of chi-square and root mean square error of approximation (RMSEA). The instrument for evaluating CFS policies in primary schools using the CIPP model has met a valid and reliable psychometric property test so that it can be applied.

Background: The STEM education system has garnered significant interest due to its innovative approach in creating a multidisciplinary and integrated knowledge structure that connects science, technology, engineering, and mathematics, and allows students to apply scientific knowledge in a comprehensive and holistic manner. Consequently, evaluating the teaching methods of teachers in accordance with STEM standards is critical. This assessment should take into account various educational objectives, including cognitive, skill-based, and emotional aspects. Purpose: This study aimed to evaluate the creative teaching practices of mathematics teachers for gifted students according to STEM standards. Method: The study applied the descriptive analytical method and developed a rating scale for evaluating creative teaching practices based on STEM standards, verifying the psychometric properties in several ways. The study sample consisted of 64 teachers of mathematics for gifted students. Results: The results showed that the degree of application of creative teaching practices by the teachers of gifted students according to STEM standards was at the moderate level in three domains: planning, implementation, and assessment. Conclusions: Despite the importance of achieving integration for STEM, the actual teaching practices of teachers of the gifted according to these standards were generally average and did not reach acceptable and ambitious levels.

Currently, Developmental scales for children aged 0-6 years are a particularly valuable resource for assessing developmental milestones in children. Most scales are developed based on a broad conceptual framework, and their metric validation is insufficient and of low quality. The aim of this systematic review is to analyse the psychometric quality of these tests and identify aspects in need of improvement. To this end, the PRISMA methodology and the WOS and ProQuest databases were used to search for articles addressing this topic. A total of 680 articles were identified, of which 72 were selected using the established inclusion and exclusion criteria. The results indicate a scarcity of independent studies on the statistical measurement of the scales. The selected articles are very heterogeneous and validate these tests using adaptations of common metrics. Most perform cross-cultural, concurrent, and prognostic validations of the tests. We conclude that the quality of the scale metrics and other common aspects of these tests need to be improved, particularly sample sparsity and heterogeneity, as well as cultural biases. We underline the importance of applying for advances in metrics for the construction of developmental scales and recommend the use of computerised versions to improve their ease of use and efficiency.

There is no need or point to testing of knowledge, attributes, traits, behaviours or abilities of an individual if information obtained from the test is inaccurate. However, by and large, it seems the estimation of psychometric properties of test items in classroomshas been completely ignored otherwise dying slowly in most testing environments. In the quest to obtain sound and efficient test results, it is imperative that assessorsrely on some psychometric properties to make informed classrooms decisions. These psychometric properties can be estimated using KuderRichardson20 Formula. In this study, 30 multiple-choice items were administered and used for the study. The strength of each item was analysed by looking at their difficulty level and how theydiscriminated among the students. Reliability tests were also conducted in addition to the item analysis to observe the quality of the test as a whole. With lucid prose, KR-20 was used to estimate the psychometric properties of 30 set integrated science test items (which werescored dichotomously)to serve as a primer for assessorsin higher institutions. The procedure produced coefficient value of 0.6915which is approximately 0.7 implying that the reliability of the test was high.The procedure we used to arrive at the obtained coefficient is extensively outlined in the paper. We concluded thatthe suggested procedure (KR-20) for estimating psychometric properties may have a paradigm shift in classroom testing situations where it will communicate to teachers on the efficiency and process of teachermade tests. In essence, this could enhance the quest of obtaining the real knowledge, attributes, traits, behaviours or abilities of students by using test items that are reliable and dependable.

Cognitive diagnostic models (CDMs) have received sustained attention in educational settings because they can be used to operationalize formative assessment to provide diagnostic feedback and inform instruction. A large number of CDMs have been developed over the past few years. An important component of all CDMs is a Q-matrix that specifies a particular hypothesis about the relationship between each test item and its required attributes. The purpose of this study was to construct and validate a Q-matrix for the reading comprehension section of the Islamic Azad University English Proficiency Test (IAUEPT), as an advanced English placement test designed to measure the language ability of Ph.D. candidates who tend to pursue their studies in the IAU. To achieve this, using item responses of 1152 candidates to twenty items of the reading section of the test, an initial Q-matrix was constructed based on theories and models of second/foreign language (L2) reading comprehension, previous applications of CDMs on L2 reading comprehension, and brainstorming and consensus of five content experts. Then, the initial Q-matrix was empirically validated using the method proposed by de la Torre and Chiu (2016) and checking mesa plots, and heatmap plot. Five attributes were derived for the reading comprehension section: vocabulary, grammar, making an inference, understanding specific information, and identifying explicit information. Finally, the analysis of the Generalized Deterministic Inputs, Noisy "and" Gate (GDINA) regarding absolute fit at the item- and test-level as well as three residual-based statistics showed the accuracy of the Q-matrix and a perfect model-data fit.

The aim of this study was to develop a valid and reliable measurement instrument to find out adolescents' relative deprivation levels and to determine the statistical characteristics of the instrument. The Relative Deprivation Scale-Adolescent Form was prepared and applied to 586 adolescents within the scope of the study. Exploratory Factor Analysis (EFA) was performed on the data obtained. As a result of EFA, a 3 component and 16-item form was created. Following this, the form was addressed to 320 adolescents and Confirmatory Factor Analysis (CFA) was performed on the data obtained. Goodness-of-fit values obtained from the CFA were as follows: X[superscript]/df = 2.69, RMSEA = 0.073, CFI = 0.93, IFI = 0.93, TLI = 0.91 and GFI = 0.90. In terms of these values, it can be concluded that RDS-AF has a 16-item and 3-factor structure and acceptable fit values. Criterion validity of the scale was analysed with Multidimensional Perceived Support Scale and Ostracism Experience Scale for Adolescents. Correlation coefficients between RDS-AF and these scales were found as 0.63 and 0.44. Reliability of the scale was examined within the scope of internal consistency and stability. Cronbach's Alpha coefficient calculated to determine internal consistency was found as 0.89; while the Pearson Product Moment correlation coefficient calculated within the scope of testretest carried out to determine stability was found as 0.76.These findings confirm that RDS-AF is a valid and reliable measurement instrument that can be used to determine the relative deprivation levels of adolescents.

Introduction: Given the global concern for attracting more and better candidates to teaching careers, we must have instruments to help us identify these potential candidates. In Chile, there needs to be more evidence of the motivational and perceptual factors that influence the choice of studies in Education. The aim is to study the psychometric properties of the Fit-Choice scale in the Chilean population. This scale was developed in Australia by Watt & Richardson (2007) and translated into Spanish by Gratacós & López-Jurado (2016) and identifies factors that influence the choice of careers in education. Method: A cross-sectional instrumental design was adopted. A total of 921 students from four Chilean universities (65% women) who are in their fifth year of initial teacher training for early childhood education (9.1%), primary education (17.1%), and various disciplines of secondary education (73.8%) participated in the study. The instrument's factor structure was evaluated through a confirmatory factor analysis with a maximum likelihood estimator. Evidence of internal consistency was obtained using McDonald's Omega ([omega]), obtaining good reliability indexes. Results: The results show that the version of the scale is valid and reliable for use in the Chilean context. The factor structure of the original scale, which consists of two subscales and 18 factors, is tested. The findings are consistent with the version validated in other Spanish-speaking countries. Discussion or Conclusion: This scale is valid and reliable, and its use is appropriate for Spanish-speaking contexts such as Chile. The psychometric characteristics show that it is possible to use this instrument for its specific purposes but also, given its cross-cultural validity, to conduct comparative research with other countries where it has been validated.

The purpose of this study was to examine the psychometric properties of the Self-Efficacy Questionnaire (SEQ), a self-reported questionnaire using Rasch analysis, a one-parameter logistic probability model based on scientific measurement principles. Rasch analysis was completed using the rating scale model. The various analyses allow researchers to examine the item-level psychometric properties of the SEQ, which result in measures that provide evidence for validity, reliability, and sensitivity of the instrument. Rasch analysis demonstrated that the latent trait established by the SEQ, Perceived Self-efficacy (called self-efficacy from here on), was a unidimensional construct that could be measured on a linear scale. The instrument demonstrated sound item-level psychometric properties, including a wide span of item difficulty, along with limited ceiling and no floor effects. Person reliability was good, and the SEQ separated raters into at least three statistically different levels of self-efficacy. These results provide evidence for the SEQ's validity, reliability, and sensitivity. Based on this preliminary analysis, the SEQ demonstrated more than adequate item-level psychometric properties for use, although more research needs to be done. Further, instructors could use the SEQ to give preliminary information on whether or not a class assignment leads to increased self-efficacy in undergraduate and graduate students.

This study aimed to examine the psychometric properties of the Turkish version of Sosu Critical Thinking Disposition Scale (TV-CTDS). The data were gathered from two independent samples consisting of undergraduate and graduate students from four different universities in the Black Sea region of Turkey. After the translation procedure, the psychometric properties of the TV-CTDS, including factor structure, measurement invariance, convergent validity, discriminant validity, and reliability, were investigated. The results of the study revealed that the two-factor model (critical openness and reflective skepticism) of the TV-CTDS presented a better fit to the data than the one-factor model, and two-factor model is invariant across different samples (undergraduate and graduate students) and genders. Also, the TV-CTDS showed convergent validity and discriminant validity across two different samples, and its internal consistency was adequate. Therefore, it can be said that the TV-CTDS can be used by educators, researchers, and professionals to assess undergraduate and graduate students' critical thinking dispositions in Turkey.

This study aims to develop a measurement tool to be used to determine the attitudes of pre-service teachers towards virtual classroom environments. For this purpose, the literature on the subject was examined, and student opinions were taken. As a result of these processes, a 50-item piloting form of the scale was prepared. The prepared scale items were presented to the expert opinion in terms of content validity, and after the feedback obtained from the experts, some items were rearranged with minor corrections and transformed into a 50-item scale. The scale was administered to 282 students, 234 female and 48 male, studying in different teaching programs and different grade levels at Gazi University Gazi Faculty of Education in the spring term of the 2021-2022 academic year. Validity and reliability analyses of the scale were made based on the data set obtained as a result of the application. Exploratory Factor Analysis (EFA) was performed for construct validity, and as a result of the Exploratory Factor Analysis (EFA), a scale consisting of 46 items and 2 sub-dimensions was obtained. The total variance explanation rate of the two factors in the structure of the scale was 62.79%. The reliability analysis results obtained for the scale revealed that the Cronbach's alpha reliability coefficient for the overall scale was 0.98, and the reliability coefficients for the sub-factors were 0.98 and 0.96, respectively.

This study aimed to investigate the psychometric properties of the Wechsler-4 Intelligence Scale who are deaf with Mild Intellectual Disability. Descriptive survey method was used. The sample included (174) deaf students in Jordan, ranging in age from (6-16.11) years. The scale was also applied in sign language. Validity indicators were found which were Content Validity (80%), Construct Validity (1.939- 0.489), Concurrent Validity with Goodenough- Harris Drawing Test (0.688) and Achievement (0.887), and the correlation coefficients ranged between subtests and the total score of the scale Between (0.487 - 0.898). Also, the significance of Reliability scale was the Test Re-test method (0.866), the arbitrator's agreement (78.2%), and the half-way method for individual questions (0.76), the marital questions (0.75), and the correlation coefficient between odd and even paragraphs (0.868). The results showed that the level of total intelligence was (IQ = 62.54). And the existence of differences in the level of arithmetic average intelligence (Verbal Comprehension Index, VCI) = (62.02), (Perceptual Reasoning Index, PRI) = (66.63), (Working Memory Index, WMI) = (74.50), and (Processing Speed Index, PSI) = (82.68), and Full-Scale IQ (FSIQ) = (62.54).And the presence of statistically significant differences in the level of Intelligence (WMI and PSI) in favor of females. There were no differences in IQ, attributable to the variable degree of hearing impairment for each of the tests (VCI, PRI, WMI, PSI, and FSIQ). The study recommends related to the understanding of sign language of deaf Mild Intellectual Disability.

This study describes the characteristics of the test and its items used in the national-standardized school examination by applying classical test theory and focusing on the item difficulty, item discrimination, test reliability, and distractor analysis. We analyzed response data of 191 12th graders from one of public senior high schools in Yogyakarta City, Indonesia,to the examination on the elective mathematics subject. The results showed that both multiple-choice and essay items contained in the test were at a moderate level of difficulty. The lowest item difficulty index went to the multiple-choice item where students failed in interpreting straight and dashed lines and went to the essay item that required complex intra-mathematical connections. In addition, we only found one item which was poor in distinguishing student competence. Furthermore, students' test scores on multiple-choice and essay items were reliable. Although most multiple-choice items had at least two functioning distractors, it was still found two items whose all distractors were not functioning. In this article, we provide some suggestions concerning improvement towards mathematics learning practices.

This study aimed to develop a useful test to measure university students' spatial abilities validly and reliably. Following a sequential explanatory mixed methods research design, first, qualitative methods were used to develop the trial items for the test; next, the psychometric properties of the test were analyzed through quantitative methods using data obtained from 456 university students. As a result, a multiple-choice spatial ability test with 27 items and five options was created, divided into three subtests: spatial relations, spatial visualization, and spatial orientation. The results suggested that scores obtained from the spatial ability test and its subtests are valid and reliable.

In recent years, research has focused on the factor structure of the Teacher Sense of Efficacy Scale (TSES), and the significant effects of teachers' self-efficacy on both teachers' outcomes (teachers' performance, enjoyment of teaching, and commitment to teach), and students' outcomes (student learning achievements, motivation, and own sense of efficacy. However, current literature shows that very limited research on the factor structure of the TSES for teachers has been conducted in the Vietnamese educational context. Thus, this study explored the factor structure of the 12-item TSES for a group of 395 in-service teachers from 24 high schools in Vietnam. Both exploratory factor analysis and confirmatory factor analysis were performed to explore the possible factor structure of the TSES and confirm the latent structural validity of the TSES model. The results of factorial analysis indicated that the three-factor structure of the original TSES, which included efficacy for instructional practices, efficacy for classroom management, and efficacy for student engagement, was appropriate for high school teachers in Vietnam. The reliability of each of the three subscales and the whole scale was satisfactory. The findings suggested that the application of TSES was suitable for Vietnamese in-service teachers to assess their self-efficacy. The study recommended that future studies should examine the factor structure of the TSES for a group of pre-service teachers in Vietnam to compare the experience levels of efficacy beliefs between pre-service and in-service teachers.

Self-determination theory (SDT) is a significant theoretical framework for investigating and comprehending student learning and motivation, which are crucial aspects of physical education. The purpose of this study is to identify the reliability and validity of the Malay language version of SIMS-14 items, as well as to determine the effect of four-week intervention teaching utilizing the flipped classroom method affects primary school students' situational motivation. A total of 421 students participated in this study. Reliability analysis based on the Rasch model found that the individual reliability value was 0.91 and the items reliability was 0.85. CFA analysis reported X[superscript 2]/df = 2.037, CFI = 0.969, GFI = 0.907 and RMSEA = 0.074 with internal validity for each variable based on Cronbach Alpha's ([alpha]) values ranging from 0.87 to 0.92. As for the value of Construct Validity (CR), the value of 0.88 to 0.95 is obtained by fulfilling the condition [greater than or equal to] 0.60 and the value of Average Variance Extracted (AVE) is between 0.70 to 0.86. Therefore, the data collected using SIMS-14 items were analyzed with One-Way ANCOVA and the results affirmed that students from the experimental group exhibited an enhancement in situational motivation based on flipped classroom method better than the control group. Besides, the results of the study revealed that the SIMS-14 items consist of four factors that are consistent and prove the quality of psychometry. In addition, the SIMS-14 items instrument attempts to represent constructs of intrinsic motivation, identified regulation, external regulation, and amotivation that can be widely used for assessment in the context of PE.

The argument-based approach is the current framework for validity and validation. One of the criticisms is that understanding and applying this approach to practice are complicated and require abstract thinking. Teachers or school administrators in teaching and learning need support in their validation practice. Due to the abstract structure of validity, the test users and instructors who are not familiar with psychometrics may face problems in gathering validity evidence. Especially in classroom assessment, teachers may deal with understanding the complex methods of validation. In line with this need, the purpose of this study is to help instructors validate their assessment practices by providing a pathway to guide them through their validation processes and to make the validation process more obvious in classroom assessment. For this purpose, a checklist including the validity indicators for classroom assessment is developed. In this development process, Sireci's (2020) 4-step validation which is based on AERA et al. (2014) Standards and Bonner's (2013) study as a framework were followed. The validity indicators were composed by simplifying the AERA's standards and the ones which are relevant to classroom assessment were selected. In addition to the standards, the aforementioned studies were investigated and the validity indicators that may be applicable in classroom assessment were determined.

Student well-being has gradually become a topic of interest in higher education, and the accurate, valid, and reliable measure of well-being constructs is crucial in the South African context. This study examined item bias and configural, metric and scalar invariance of the Satisfaction with Life Scale (SWLS) for South African first-year university students. A cross-sectional design was used. A sample of 780 first-year South African university students was included. Confirmatory factor analysis, differential item functioning measurement invariance, and internal consistency were tested. A one-factor structure was confirmed. Item 1 of the SWLS was particularly problematic concerning bias (uniform and non-uniform bias). Measurement invariance was established; however, Item 1 was again problematic, resulting in partial metric and scalar invariance. The scale was reliable (Cronbach's [alpha] was 0.83; McDonald's omega [omega] was 0.83). This study contributes to the limited research on the specific psychometric properties of the SWLS in a diverse higher education setting. The results could assist with valid and reliable measurements when developing interventions to enhance student well-being.

Cloze tests are gap-filling tests designed to measure overall language ability and reading comprehension in a second language. Due to their ease of construction and scoring, cloze tests are widely used in the context of second and foreign language testing. Previous research over the past decades has shown the reliability and validity of cloze tests in different contexts. However, due to the interdependent structure of cloze test items, item response theory models have not been applied to analyze cloze tests. In this research, we apply a method to circumvent the problem of local dependence for analyzing cloze tests with the Rasch model. Using this method, we applied the Rasch model to a cloze test composed of eight passages each containing 8-15 gaps. Findings showed that the Rasch model fits the data and thus it is possible to scale persons and cloze passages on an interval unidimensional scale. The test had high reliability and was well-targeted to the examinees. Implications of the study are discussed.

This study aimed to develop the "Lesson Study Model Perception Scale" (LSMPS) and to determine the psychometric properties of the scale. The study was designed as a survey model. A survey model is a research approach that aims to describe a situation as it is. When all the findings obtained to determine the psychometric properties of the scale developed within the scope of the research are evaluated together, it is investigated that the measurements obtained from the scale and the inferences to be made based on these findings are reliable and valid. Existing literature revealed that there are limited number of studies that determine how the LS model is perceived by teachers. It is seen that none of these studies attempted to develop a scale to measure teachers' perceptions of the LS model. The lack of a study in this context in the literature shows the originality of the study.

Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to examine the validity of the University of Tehran English language proficiency test (UTEPT) using 6 aspects of Messick's validation framework (i.e., content, structural, external, generalizability, substantive, and consequential). To examine each validity dimension, the Rasch model was considered. To this end, the data of 394 test takers who had taken the test in 2023 were cleaned and analyzed for the assumptions of the Rasch model and then for the 6 aforementioned validity aspects. The results indicated that the structural (i.e., unidimensionality), generalizability (i.e., measurement invariance), and substantive aspects held. However, the evidence for the content, external, and consequential aspects of validity was less definitive. The implications of the findings for the validity of the test, for the realm of language testing, and for item developers and item writers will be discussed.

Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification. Determining the validity of the source of DIF has implications for how it is handled in practice. We demonstrate a form of sensitivity analysis that can point to model misspecification induced by item complexity as a possible cause of DIF, and show how such a cause of DIF might be accommodated through attempts to generalize the IRT model for the studied item(s) in psychometrically and psychologically plausible ways. In both simulated illustrations and empirical data from TIMSS 2011 and TIMSS 2019 4th and 8th Grade Math and Science, we have found that using a form of proposed IRT model generalization can substantially reduce DIF when IRT model misspecification is at least a partial cause of the observed DIF. By demonstrating item complexity as a possible valid source of DIF and showing the effectiveness of the proposed approach, we recommend additional attention toward model generalizations as a means of addressing and/or understanding DIF.

The current article evaluates a national English language proficiency test known as the "MSRT test" which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have obtained the minimum English proficiency level and can be graduated. The present paper seeks to examine the test and its psychometrics characteristics due to the significance of such a high-stakes examination that may have social and long-lasting effects on the participants. It is claimed that the test measures participants' "knowledge of language" for communication rather than their "knowledge about language" in a constrained context. As a result, the test dimensionality and validity are up for debate. It was found that fundamental revisions in terms of test format and content are required to improve the test quality. The current study examined the areas that are yet unexplored and attempts to describe the MSRT assessment comprehensively.

Alienation is a psychological state in which a teacher feels and develops relatively loss of relationship with others. First and foremost, in the present study, it was found that the standardized Alienation Scale by Hardeo Ojha constructed in the year 2010 was appropriate in measuring alienation in general social context for adults above twenty one years of age and it required a few modifications to cater specifically in terms of secondary school teachers context which led to further developing and validating alienation scale on secondary school teachers. The psychometric properties of alienation of secondary school teachers were explored. The study assessed the level of alienation dimension-wise of two hundred secondary school teachers teaching in Punjab (India). The scale was made reliable and valid using Content validity, Exploratory Factor Analysis, Confirmatory Factor Analysis, Cronbach's alpha, Average Variance Extracted, Composite Reliability. The reliability statistics using Cronbach's alpha is greater than 0.80 of overall alienation scale ([alpha]=.878), social isolation ([alpha]=0.892), work alienation ([alpha]=0.869) and cultural estrangement ([alpha]=0.875) with average variance extracted greater than 0.40 and composite reliability greater than 0.70 for all the factors. Therefore, validity and reliability analysis showed that the scale possesses adequate homogeneity and internal consistency. Thus, the alienation scale can be considered appropriate to measure level of alienation of secondary school teachers. Secondly, for field testing the applicability of the developed and validated scale of alienation, it was administered on 500 secondary school teachers. The objective was to conduct comparative analysis of alienation and its dimensions with respect to gender. The findings revealed no significant difference with respect to gender in alienation, social isolation and cultural estrangement. Significant differences were found in case of work alienation wherein the female secondary school teachers were on the higher end in comparison to the male secondary school teachers.

This research aimed to investigate animation-based achievement tests according to the item format, psychometric features, students' performance, and gender. The study sample consisted of 52 fifth-grade students in Samsun/Turkey in 2017-2018. Measures of the research were open-ended (OE), animation-based open-ended (AOE), multiple-choice (MC), and animation-based multiple-choice (AMC) achievement tests developed for the unit "Motions of the Earth" of the subject area "Earth and Universe" of the science course. Tests were compared to item difficulty, item discrimination, internal consistency levels, and students' performance and gender. Additionally, predicting students' science grades was tested by animation-based open-ended and multiple-choice tests. Paired sample t-tests, Pearson's correlation coefficient, Friedman test, Wilcoxon test, two-way mixed ANOVA tests, and multiple regression analysis were applied to analyze research data. Research results show no significant difference between animation-based and traditional tests' validity and reliability levels. Research result also shows that students' test scores were significantly higher at animation-based tests than traditional tests. Besides, students' test scores differed according to the animation type used in tests. However, gender was not a significant variable on students' test scores. Finally, despite using animation as a significant predictor of Science grades, just animation based multiple-choice test has significantly predicted students' Science grades. Future research can investigate variables that affect students' participation in animation-based tests and their opinions on animation-based tests. The finding regarding the animation type variable can be investigated in-depth in terms of the effect levels of the visual and auditory elements added to the animations by including an equal number of items on the test.

Personal multicultural experience may contribute to an individual's competency in working with multicultural clients. Individuals with higher multicultural exposure and interactions are expected to have greater cultural resources that are crucial when working with diversity. Thus, this study aims to examine the psychometric properties of the Malaysian version of the Multicultural Experience Inventory-Revised (MEI-R). The MEI-R is a self-rated questionnaire that measures individuals' multicultural exposure and interactions during their formative years and current multicultural encounters. This study involved 205 counsellor trainees who were selected using cluster random sampling. Previously the Malay translated and adapted MEI-R had undergone the preliminary exploratory factor analysis. In this study, the focus is to examine and confirm the factor structure, reliability and validity of the translated and adapted MEI-R. This study also reported the value of external validity. In this study, the results confirm the factor structure, reliability, and validity of the translated and adapted MEI-R. All in all, the translated and adapted MEI-R has high reliability and sufficient validity values, indicating that it may be used successfully on counsellor trainees of all genders.

Purpose: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language--Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online. Method: The TNL-2 was administered to 357 school-age children at risk for language and literacy difficulties as part of a randomized controlled trial, across three annual cohorts, at three time points (pretest, posttest, and 5-month follow-up). Cohort 3 students were tested using an online format at posttest and at follow-up. We compared the Cronbach's alpha internal consistency reliability of the TNL-2 online testing scores with in-person scores from TNL-2 normative data and Cohort 3 in-person testing at pretest, and interrater reliability for Cohort 3 across test points. In addition, we examined measurement invariance across test occasions and the criterion validity of the TNL-2, the latter based on its correlations with narrative sample measures (Mean Length of Utterance in words and the Monitoring Indicators of Scholarly Language rubric). Results: Internal consistency reliability, interrater reliability, and measurement invariance analyses of the online and in-person administration of the TNL-2 yielded similar outcomes. The criterion validity of the TNL-2 was found to be good. Conclusions: TNL-2 psychometric properties from online administration were generally in the "good" range and were not significantly different from in-person testing. When administered online using standardized procedures, the TNL-2 is valid and reliable for use in assessing narrative language proficiency in school-age children at risk for language and learning difficulties.

Parenting style was a set of parental attitude and behavior communicated by parents to children, forming an emotional climate condition used by parents to raise children. The study on parenting style had been conducted for a long time, but measurement of parenting style in Indonesia was still experiencing problem due to lack of sufficient and proper instrument, despite the monumental need for a valid and reliable instrument. The aim of this study was to examine the factor structure, internal consistency and others psychometric properties of the Indonesian version of the parenting styles and dimensions questionnaire-short form (PSDQ-SF). The instrument comprises 32 items (12 questions regarding the authoritative style, 15 questions regarding the authoritarian style, and five questions regarding the permissive style). The research sample consisted of 169 mothers with children of 5-7 years of age. Research was conducted in Sukoharjo, Central Java, Indonesia. Structural equation modelling (SEM) with LISREL 9.20 was utilized as the data analysis technique. Data analysis results by CFA second order showed that construct validity testing fulfilled the minimum criteria, with the factor loading range of 0.51-0.99. The reliability score's Cronbach's alpha also fulfilled the requirement, including the authoritative parenting style 0.86; the authoritarian parenting style 0.76 and the permissive authoritarian parenting style 0.67. These findings support the PSDQ-SF original structure. The results showed that the adaptation of PSDQ-SF in Indonesia was valid and reliable to use in measurement of parenting styles of parents of children of 5-7 years of age in Indonesia.

Despite widespread use of the Student Course Engagement Questionnaire (SCEQ; Handelsman, Briggs, Sullivan, & Towler, 2005) for the purposes of measuring college student engagement in scholarship of teaching and learning (SoTL) contexts, few studies have been published regarding its psychometric validity. The current study examined the structural and criterion validity of models proposed in the original study and in a subsequent validation study. The results indicated that neither model provided adequate fit to the current data. Concerns regarding structural, criterion, and content validity are discussed, and recommendations regarding the use of the SCEQ are provided in the context of current psychometric evidence and relevant theories of student engagement.

In this study, we use face and content validity to determine whether a modified game-based testing instrument is appropriate and relevant for quantifying preschool children's emotional, cognitive, and attitudinal affinity with nature. Six environmental psychology experts completed a questionnaire and subsequent interviews with three of them provided insight into whether the features of the tool can measure a child's affinity with nature. Interrater agreement and content validity indexes establish whether the instrument meets four established validation criteria: clarity; ease of use; appropriateness; and relevancy. Results indicate that the modified device does not measure the original core concept: affinity with nature, and that face and content validation outcomes do not yield acceptable outputs. As a result, the foundation and key characteristics of the instrument were revised to enhance its ability to produce trustworthy results and more accurately measure the revised core concept of connection to nature and environmental knowledge.

This research examines psychometric properties of the 10-item Perceived Academic Social Influence Scale (PASIS) across gender groups with samples from Finland and Taiwan (Total N = 4727, 50.2% female adolescents). Results of composite scores, factor loadings, item-total correlations, and values of square root of Average Variance Extracted (AVE) confirmed strong reliability and validity of the scale. A Multi-Group Confirmatory Factor Analysis (MGCFA) revealed that measurement was equivalent at the level of scalar invariance across gender groups. Among three subcomponents of PASIS, latent mean score of teacher factor turned out to be higher than peer and parent factors regarding math achievement for female and male adolescents from both countries. Findings indicate that the PASIS is a reliable and valid measure to assess the perceptions of academic social influence for math learning, which can be utilized in different cultural contexts.

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterised by difficulties in communication and repetitive behaviors. The early detection of ASD is a clinical priority in education centres and medical services. COREAT is a computer adaptation of the Repetitive Behavior Scale-Revised (RBS-R) which has been designed to facilitate the diagnosis of individuals with ASD and intellectual disability. This article describes the development, an initial evaluation of the feasibility and the preliminary outcomes of COREAT. The development of COREAT consists of two phases. Phase 1: Performing a prior analysis of the psychometric properties of the RBS-R scale. Phase 2: Developing the mobile application (pilot tests, testing real cases n = 11, and final feedback). Descriptive data of the pilot study shows that 91.31% of participants indicate that COREAT is very accessible and intuitive. COREAT proves to be a useful diagnostic resource for professionals and families. Cross-cultural differences must be analysed.

This study aimed to adapt the Triarchic Model of Grit Scale (TMGS) and Perceived Academic Underachievement Scale (PAUS) to a Turkish state university context and provide evidence of its validity.. The relationships between the scales were also examined. The data of this study was obtained from three different study groups consisting of college students attending a state university located in the Middle Black Sea Region of Turkey. The psychometric properties of the PAUS were examined with the first study group, the psychometric properties of the TMGS were examined with the second study group, and the relationships between both scales and their relations to academic self-efficacy were examined with the third study group. Exploratory Factor Analysis, Confirmatory Factor Analysis, and Pearson's product-moment correlation coefficient were used to analyze data. Results showed that both scales have sufficient validity and reliability. Furthermore, there was a negative relationship between grit and perceived underachievement, a positive relationship between grit and academic self-efficacy, and a negative relationship between perceived underachievement and academic self-efficacy. These findings suggest that adapted scales are valid and reliable measurement tools that can be used to determine perceived academic underachievement and grit levels among adults and teacher candidates.

Student understanding of chemical equilibrium in aqueous solutions (CEAS) plays a vital role in their upper secondary school chemistry learning and everyday life. Diagnosis of students' alternative conceptions (ACs) of the CEAS will provide teachers with valuable information to make instructional decisions on student learning. This study aims to develop and validate an instrument to diagnose students' ACs about the CEAS, including ionization equilibrium, water self-ionization equilibrium, the equilibrium of salt hydrolysis, and precipitation and dissolution equilibrium. Using Treagust (1998)'s development framework, we have developed 25 two-tier multiple-choice items for the CEAS diagnostic test. After completing the corresponding courses, 750 Grade 11 students from five public schools responded to the CEAS diagnostic test. Rasch modeling approach was employed to provide psychometric properties of the CEAS diagnostic test consisting of one-dimensionality, reliability, and validity. This study identified 15 ACs toward the CEAS. This study found that most students performed better on concept tiers rather than reasoning tiers. In addition, students have difficulties in connecting acidity, solubility, ionization, and chemical reaction and in using mathematical thinking to do transformation between concentration, equilibrium constant, and pH value.

This study presents the development of a mathematical creativity test and exploration of its psychometric properties. The study was conducted in six public schools and a high ability center between 2015 and 2018. The sample of the study included 1129 middle school students. The Mathematical Creativity Test (MCT) consists of problem posing, making conjecture, and proof subtests. Each test has two items. The scores of the MCT are composed of fluency, flexibility, and creativity quotient. For construct validity, EFA yielded a 3-factor solution, namely, problem posing, making conjecture, and proof subtests. CFA confirmed the 3-factor solution, and all fit indices were found to be good. For criterion validity, one-way ANOVA for independent samples was conducted in different classes, and it showed that there was a significant difference, and Pearson's correlation coefficient was investigated between MCT scores and the report card grades of the mathematics lesson. There was a strong and positive correlation between the two variables. The internal consistency and the interrater reliability of the test scores were high.