Search

Cognitive diagnostic models (CDMs) have received sustained attention in educational settings because they can be used to operationalize formative assessment to provide diagnostic feedback and inform instruction. A large number of CDMs have been developed over the past few years. An important component of all CDMs is a Q-matrix that specifies a particular hypothesis about the relationship between each test item and its required attributes. The purpose of this study was to construct and validate a Q-matrix for the reading comprehension section of the Islamic Azad University English Proficiency Test (IAUEPT), as an advanced English placement test designed to measure the language ability of Ph.D. candidates who tend to pursue their studies in the IAU. To achieve this, using item responses of 1152 candidates to twenty items of the reading section of the test, an initial Q-matrix was constructed based on theories and models of second/foreign language (L2) reading comprehension, previous applications of CDMs on L2 reading comprehension, and brainstorming and consensus of five content experts. Then, the initial Q-matrix was empirically validated using the method proposed by de la Torre and Chiu (2016) and checking mesa plots, and heatmap plot. Five attributes were derived for the reading comprehension section: vocabulary, grammar, making an inference, understanding specific information, and identifying explicit information. Finally, the analysis of the Generalized Deterministic Inputs, Noisy "and" Gate (GDINA) regarding absolute fit at the item- and test-level as well as three residual-based statistics showed the accuracy of the Q-matrix and a perfect model-data fit.

Language testing and assessment have grown in popularity and gained significance in the last few decades, and there is a rising need for assessment literate stakeholders in the field of language education. As teachers play a major role in assessing students, there is a need to make sure they have the right level of assessment knowledge and skills to accomplish their duties as assessors. The present study sought to develop and validate an assessment literacy test. To this end, a thirty-five scenario-based Language Assessment Literacy Test (LALT) was developed based on the seven standards covered by the Standards for Teacher Competence in Educational Assessment of Students (1990). Construct validity of the test was investigated by collecting data from 168 Iranian EFL teachers. To investigate the validity of the measure, tests of reliability, item difficulty, and item discrimination were carried out. The test was then subjected to EFA (Exploratory Factor Analysis whose results showed a seven-factor solution for the test items. The implications of the study for EFL teachers, language testers, teacher trainers, and curriculum developers are discussed.

The documentation of test takers' achievements has been accomplished through large-scale assessments to find general information about students' language ability. To remove subjectivity, Cognitive Diagnostic Assessment (CDA) has recently played a crucial role in perceiving candidates' latent attribute patterns to find multi-diagnostic information rather than single proficiency classification. However, there are some gaps in the literature about in detail investigation of test takers' listening comprehension language ability in responding to placement test items of a public English language center. The present study aims to validate an English placement test at a language center through a retrofitting process. In an exploratory mixed-method design, 449 participants from the same language center, including 274 females and 175 males, were selected. The performance of randomly selected participants in a language center placement test was analyzed by applying the GDINA model from R-studio packages, to detect Differential Item Functioning (DIF). Results of the study revealed DIF in some items since there is some bias in test items. The implication of this study is to provide meaningful interpretations of respondents' attributes and improve teaching and learning by finding the strengths and weaknesses of candidates. For this purpose, the findings derived from the result of the study can raise the awareness of test developers in preparing unbiased items for the placement test, and at the same time, assist test-takers to become more critical of their English language achievements. It is also helpful for materials developers to become aware of developing materials free from bias.

This study reports on developing and validating the School Alienation in Online Schooling Scale (SAOSS). School alienation in online schooling is conceptualized as opposed to school belonging and the main reason for minimal participation, reduced educational benefits, and school dropout in school aged-children, especially during the online learning forced due to the COVID-19 Pandemic. This study includes three phases. The first study included item generation and analysis. After the initial analysis, 13 items from the tool were retained. In the second study, exploratory factor analysis was conducted. Two factors emerged from principal component analysis (PCA). In the third study, we investigated the confirmatory factor analysis of SAOSS with a sample of urban students in Iran (grades 7-9, n = 317). The SAOSS has important implications for researchers, school counselors and psychologists, policymakers, and stakeholders. Implication for theory, practice and future research is discussed.

Social emotions such as shame and guilt are critical to social-emotional development in any culture because they help children and adolescents learn to adhere to the social rules and norms of their culture. However, most instruments that currently measure these emotions were validated only in samples from Western countries. This study aimed to translate and validate the "Brief Shame and Guilt Questionnaire for Children" (BSGQ-C) in children and adolescents living in Iran. A total of 453 children and adolescents aged 8 to 16 years filled out the BSGQ-C, consisting of 2 scales (Guilt: 6 items; Shame: 6 items) and questionnaires for social anxiety and worry. Factorial validity was confirmed by the intended two-factor structure, with an adequate test-score reliability for the scales. Concurrent validity was also confirmed: as expected, shame but not guilt was related to symptoms of social anxiety and worry.

The current article evaluates a national English language proficiency test known as the "MSRT test" which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have obtained the minimum English proficiency level and can be graduated. The present paper seeks to examine the test and its psychometrics characteristics due to the significance of such a high-stakes examination that may have social and long-lasting effects on the participants. It is claimed that the test measures participants' "knowledge of language" for communication rather than their "knowledge about language" in a constrained context. As a result, the test dimensionality and validity are up for debate. It was found that fundamental revisions in terms of test format and content are required to improve the test quality. The current study examined the areas that are yet unexplored and attempts to describe the MSRT assessment comprehensively.

Objective: Cyberbullying, which is defined as an intentional, aggressive, and repetitive behaviour where a person or group uses electronic devices (primarily the Internet and smartphones), is a new concept specifically for the Iranian educational system. We examined the Bullying and Cyberbullying Scale for Adolescents' (BCS-A) psychometric properties in Persian-speaking Iranian adolescents. Design: A sample of 301 students studying in Arak city, Iran (female = 154) completed bullying and cyberbullying scale (BCS-A), School Belonging scale (SBS), and Youth Internalizing and Externalizing Screener (YIBS and YEBS). Result: Confirmatory factor analyses indicated that the BCS-A measurement model, which structured each of the 13 items as indicators of the four victimization factors (i.e., physical, verbal, relational, and cyber), provided adequate-data model fit. These analyses also revealed that both victimization and cyber-victimization had adverse predictive effects on school belonging and positive predictive effects on internalizing and externalizing problems. Furthermore, bullying significantly predicted school belonging and mental health problems. Conclusion: This study is the first to examine the psychometric properties of BCS-A in the Iranian sample. This study is an essential step in validating the scale for Iranian adolescents. This study has some implications for educators, researchers and policymakers.

Despite the importance of academic reading in higher education, the current literature lacks a valid instrument comprising different components of academic reading at a graduate level. This article reports on the development of an academic reading instrument for (Iranian) MA students of applied linguistics. To this end, based on a thorough review of the relevant literature and interviews with experts, a preliminary theoretical framework was proposed and an instrument with 50 items was developed. The instrument was validated through conducting exploratory factor analysis (EFA) with 345 participants and a further confirmatory factor analysis (CFA) with 207 participants. The results of the EFA and CFA led to the emergence of an 8-component instrument with 37 items. The components include reading strategies, English language proficiency, content knowledge, statistical literacy, genre awareness, information literacy, interaction with teaches and peers (interactive reading), and critical reading. The implications are discussed.

This study aimed to investigate the reliability and validity of the Childhood Career Development Scale (CCDS) on a sample of 1018 Iranian elementary school students. The Confirmatory factor analysis revealed that the original eight-factor model was of a good fit. Measurement invariance analyses indicated equivalence across gender and grade. A factorial MANOVA was applied to assess gender and grade mean differences in CCDS subscales. Concurrent validity of the CCDS subscales with the measures of Locus of Control and the children's Industry was confirmed. The CCDS Persian version proved to have good psychometric indexes for assessing children's career development.

The purpose of this study was to investigate the validity of the vocabulary subsection of a high-stakes university entrance exam for Ph.D. programs using the argument-based approach. All the three different versions of the test administered in a period of five years and the responses of 12,500 test-takers were studied. The study focused on four inferences of domain definition, evaluation, generalization and explanation mainly using corpus linguistics, the Rash measurement model and factor analysis. The results indicated substantial threats to the validity of the test in terms of vocabulary choice, item difficulty, item discrimination, construct representation, and reliability.

The present study investigated the speaking module of TOEFL iBT with an emphasis on the dichotomy of independent and integrated tasks. The potential differences between the two speaking conditions were intended to be explored based on the oral performance elicited from a group of Iranian test takers. To collect the required data, a simulated version of TOEFL iBT characterized with all test rubrics as practiced by ETS was applied. A total number of 224 oral samples were transcribed and then quantified in terms of complexity and fluency by some internet-based programs including "Coh-Metrix 3" and "Syllable Counter." Moreover, the accuracy of each oral performance was manually computed for comparison purposes. The results revealed that the two speaking contexts were significantly different in terms of linguistic accuracy as well as two complexity measures representing latent semantic analysis and the mean number of modifiers per noun phrase. However, the two speech-eliciting contexts did not trigger any significant difference in the participants' oral language performance in terms of fluency and two other complexity measures, namely lexical diversity and left-embeddedness. The findings may have some implications for all TOEFL iBT stakeholders concerning the speaking subtest.

This study sought to develop and validate a classroom-based language assessment literacy scale to measure teachers' perceived classroom-based assessment knowledge and practice. Exploratory factor analysis revealed that the scale items clustered around four factors: (a) purposes of assessment and grading, (b) assessment ethics, (c) student involvement in assessment, and (d) feedback and assessment interpretation. Moreover, the scale was administered to 348 Iranian English as a foreign language teachers. The findings showed that the majority reported to be literate in classroom-based language assessment and agreed to the allocation of more space to classroom-based language assessment in teacher education courses. The findings suggest that the newly-developed scale can serve as a valid and reliable tool to explore language teachers' classroom-based assessment literacy.

While there is a burgeoning of short-term research in self, peer, and teacher assessment, there is a paucity of longitudinal studies in this kind of assessment. Furthermore, oral assessment in English as a foreign language (EFL) context is relatively underexplored. The current study was designed to investigate the reliability and validity in 30 oral presentations that spanned over a period of four months, including variables such as the students' gender, ability, and the topic of presentations. The results indicated that reliability indices of all 30 oral assessments were high, ranging from 0.70 to 0.95 as measured by Cronbach Alpha. In addition, validity indices improved over time, with the later presentations enjoying higher validity indices than the preceding ones. The gender of the assessors did not affect the total mean score of the presentations. Also, students' self-assessments were not significantly different from the scores of the teacher, although they appeared slightly higher. There was no significant correlation between self-assessment and teacher-assessment.

The Parents' Evaluation of Developmental Status (PEDS), PEDS: Developmental Milestones (PEDS: DM) and PEDS tools (i.e., the PEDS and PEDS:DM combined for use) are parent-reported screening tools frequently used to identify young children requiring early intervention. An ideal screening tool for all contexts would be brief, inexpensive with appropriate test items and good psychometric properties. A scoping review was conducted to review studies that used the PEDS, PEDS:DM, and PEDS tools to screen for the need for further referrals and evaluation through parent report. Thirty articles, ranging from 2003 to 2020, conducted in high-income countries (HICs) and lower-middle income countries (LMICs), were included from the 1,468 records identified. Studies conducted in HICs (n = 19) included screening of special population groups and comparing validated tools. LMIC studies (n = 11) focused on translations, combination of the PEDS tools, validations of tools, and use of an app-based tool (mHealth). High referral rates were obtained with PEDS (23-41%) and PEDS:DM (12-54%) in LMICs where at-risk populations are more prevalent and cultural differences may affect tool validity. A global dearth of research on PEDS:DM and PEDS tools exist; the review highlights factors that influence the validity and impact widespread use of the screening measures, especially in diverse populations and LMICs.

Student engagement is a critical component of e-learning, which became an important focus for most academic institutions during the COVID-19 pandemic. University students' engagement is measured using various scales with different subscales. This study aimed to evaluate the psychometric properties of the Persian version of the University Student Engagement Inventory (P-USEI). A cross-sectional methodology study was conducted among Iranian university students (n = 667) from April to May 2020. After forward-backward translation, the content, and construct validity, and reliability of the scale were assessed. The results obtained from the confirmatory factor analysis confirmed that the P-USEI has three factors: cognitive, emotional, and behaviour. The findings of the study supported the adequate reliability, factorial, convergent, and discriminant validities of P-USEI in a sample of Iranian students. The P-USEI dimensions have predictive value for important academic variables that can be generalized by developing the research through a psychometric evaluation on student engagement.

Large-scale standardized ESL tests such as the International English Language Testing System (IELTS) are widely used around the world to measure the language proficiency of test-takers and make different decisions based on their scores. Reading comprehension is an integral part of such tests which requires test-takers to read passages and answer a set of questions. Although IELTS is a popular standardized test and is used for making critical decisions about test-takers, very few attempts have been made to explore the validity of the exam and especially the reading part of the General Training Module. With this in mind, the purpose of the present study was to use a nonparametric item response theory model, called Mokken Scale Analysis (MSA), to examine the validity of the reading part of the General Training module of IELTS. To this end, item responses of 352 test-takers to the reading comprehension test were analyzed. The results of item scalability, total scalability, and item-pair scalability showed that the reading part is a weak unidimensional scale. Using Monotone Homogeneity Model (MHM), the monotonicity results also indicated that there are some items which violate the monotonicity assumption, although their values are insignificant. The analysis of unidimensionality using the AISP revealed that there are two scales and four unscalable items in the reading part. Therefore, the Mokken scale analysis did not support the unidimensional structure of the reading part of the General Training module of IELTS.

The Online Interaction Learning Model was founded on constructivist learning theory. It is an input-process-output model based on moderating variables, the inputs, which includes all of the characteristics of the courses, the instructors, EFL learners, and the technology. Due to the fact that the studies considering the pivotal role of the Online Interaction Learning Model are scarce in number, this study was conducted to validate a newly-designed questionnaire via exploratory and confirmatory factor analyses. Two hundred fifty-nine Iranian university and higher education institutes EFL learners were asked to participate. The newly-developed questionnaire consisted of 35 items measuring the five constructs of the Online Interaction Learning Model (Course materials, Instructor performance, Learning practices, Student-to-student interaction, and Access to technology). The results from EFA, CFA, and reliability analyses revealed that the new questionnaire is a valid and reliable instrument measuring Online Interaction Learning Model. Moreover, there was a significant positive correlation between each component of the Online Interaction Learning Model and EFL learners' GPA as well as between the total Online Interaction Learning Model and student academic achievement. Male and female EFL learners' scores on the online interaction learning model were quite different from each other.

Increasing children's access to media has attached greater significance to media literacy education, the content and methods of which have changed with media development. This study aimed to investigate the effects of the Community of Inquiry (CoI) method on media literacy competencies in elementary students. To this end, 95 female sixth-grade elementary students were selected from Moalem Elementary School, Hamedan, Iran, in the academic year 2019-2020 as the sample using multistage random cluster sampling. This study was a quasi-experimental study with a pretest-posttest design. The participants were randomly assigned to three groups, i.e. CoI, Direct Teaching (DT), and Control (CON). For data collection, three tests including functional evaluation, self-evaluation, and parent evaluation were used, whose reliability and validity had been verified using Cronbach's alpha coefficient, content validity ratio (CVR), and content validity index (CVI), was employed to collect data and evaluate media competency dimensions. The results from the analysis of variance (ANOVA) and the post hoc Scheffé's test demonstrated the significantly higher media literacy level of students in the CoI group compared with the DT and CON groups at a 95% confidence interval. A significant difference was also observed in the subscales of Critical Consumption, Functional Prosumption, and Critical Prosumption. Based on these findings, the CoI is suggested to be applied in the design, development, and implementation of media literacy programs to allow students to use media properly, critique their content, and actively participate in online content creation.

The present research aimed to conceptualize the construct of Teacher Assessment Identity (TAI) by designing and validating a questionnaire in the Iranian EFL context. In so doing, a tentative scale with 96 items was piloted on 340 novice and experienced Iranian EFL teachers using Exploratory and Confirmatory Factor Analysis (EFA, CFA). The results of the analyses led to the removal of 33 items, leaving the questionnaire with 61 items on a five-point Likert scale. Moreover, the results revealed that the construct of TAI has 12 factors including assessment "knowledge", "beliefs", "attitudes", "skills and confidence", "practices", "use assurance", "feedback", "rubric/criteria", "consistency and consequence", "grading/scoring", "question-types", and "roles". Likewise, the convergent validity and reliability of the instrument to measure the construct of concern was statistically confirmed (p>0.05). The findings have various implications for EFL teachers, teacher trainers, course designers, and language researchers by raising their awareness of assessment identity and its underlying components.

Investigating the processes underlying test performance is a major source of data supporting the explanation inference in the validity argument (Chappelle, 2021). One way of modeling the cognitive processes underlying test performance is by constructing a Q-matrix, which is essentially about summarizing the attributes explaining test-takers' response behavior. The current study documents the construction and validation of a Q-matrix for a high stakes test of reading within a generalized-deterministic inputs, noisy "and" gate (G-DINA) model framework. To this end, the attributes underlying the 20 items of the reading comprehension test were specified through retrospective verbal reports and domain experts' judgments. In the ensuing stage, the Q-matrix thus developed along with item response data of 2625 test-takers were subjected to empirical analysis using the procedure suggested by de la Torre and Chiu (2016). Item-level results showed that, except for one item, the processes underlying the other items were captured by compensatory and additive models. This finding has significant implications for model selection for DCM practitioners.

Student evaluation apprehension as one of the detrimental factors in an English as a foreign language (EFL) context, reduces and gradually diminishes student participation in classroom activities, since learners are mostly concerned with how others (teacher and classmates) evaluate/judge their performance. Due to the fact that the studies considering the important role of student evaluation apprehension are scarce in number, this study was conducted to validate the newly-designed questionnaire via exploratory and confirmatory factor analyses and find the relationship between student evaluation apprehension and academic achievement, gender, and educational level of 258 EFL students. The results from EFA, CFA, and reliability analyses revealed that the new questionnaire is a valid and reliable instrument measuring EFL students' evaluation apprehension. Moreover, a significant negative correlation was observed between student evaluation apprehension and academic achievement. Besides, it was found that females experience evaluation apprehension more than males, and BA students were also found to have more evaluation apprehension than their MA counterparts.

Psychotic-like experiences (PLEs), or subclinical hallucinations and delusions, are common symptoms among young adults. Therefore, the current study aimed to assess the psychometric properties of the Psychotic-Like Experiences Questionnaire for Children (PLEQ-C) in Iranian school students. The study method was cross-sectional, and the population consisted of Iranian school students aged 9-12 years, from whom 455 students were selected through the convenience sampling method. The participants then completed the PLEQ-C, Prodromal Questionnaire-Brief (PQ-B), and Community Assessment of Psychotic Experiences-42 (CAPE-42). The PLEQ-C's psychometric properties were analyzed using the confirmatory factor analysis while the reliability was tested using Cronbach's alpha. The convergent validity was assessed using the PQ-B and CAPE-42 measures. The findings showed that the PLEQ-C has satisfactory internal reliability (Cronbach's alpha of 0.83), and the one-factor structure provides a good fit for the observed data. The PLEQ-C was also significantly correlated with the PQ-B and CAPE-42 questionnaires. Given the study findings, it is concluded that the PLEQ-C has good validity for Iranian school students aged 9-12 years and can be used as a reliable and valid measure in psychological evaluations in the Iranian context.

Background: Today, methods that enable students to benefit from online programs to the fullest and learn independently and self-directed are of critical importance. Many scales have been developed to measure self-directed learning in the physical classroom. This study was conducted to design and assess the psychometric properties of an instrument to assess learning process in a virtual environment. Materials and methods: A questionnaire for assessing s learning process in a virtual environment was developed following six steps. The process began with a systematic search for related articles. A qualitative study was then conducted to identify self-directed learning strategies and processes in virtual environments. The identified strategies were then compared with those from a literature review, and the scale items were developed accordingly. Expert validation, exploratory factor analysis, and reliability analysis were conducted to ensure questionnaire validity and reliability. This study included online postgraduate students from Iranian medical science universities in 2019. Results: The scale consisted of 5 factors and 44 items. In exploratory factor analysis, five subscales explained 90% of the total variance. Cronbach's alpha was 0.91 for the total scale. The interclass correlation coefficient between the test and retest was 0.77. Conclusion: A questionnaire designed to assess learning process in a virtual environment for postgraduate virtual students has reasonable psychometric properties, including reasonable internal reliability and construct validity.

Teacher agency is a pivotal element of professionalism and second/foreign language (L2) education. However, its role in L2 assessment has remained under-researched. Part of this negligence is due to the absence of a validated questionnaire to measure the construct and its underlying components. To address this gap, drawing on the ecological perspective, the present study developed a scale on teacher ecological assessment agency (TEAA) by gleaning data from 539 Iranian EFL teachers. The results of exploratory and confirmatory factor analysis (EFA, CFA) culminated in 5 components and 32 items in the scale. The components were labelled "Iterational", "Projective", "Teachers' Practical-Evaluative View", "Schools' Practical-Evaluative Effect", and "Professional/Democratic Community's Practical-Evaluative Effect". Furthermore, the convergent validity and reliability of the scale were statistically approved (p > .05). The study presents some implications for EFL teachers, teacher trainers, and assessment policy-makers in that they can understand and highlight the pivotal role of teacher agency in L2 assessment practices.

Individuals are controlled by tests in every advanced society when they want to be admitted in educational courses, to proceed from one stage to the next, or to be given a certificate (Shohamy, 2001b). Accordingly, the present study was carried out to construct and validate educational, social, and psychological consequences questionnaires of English Language Proficiency (EPT) as a high-stakes test in Iran. To achieve the goals, after initial piloting of the item pool, a total number of 252 non-English PhD students completed the final researcher-made questionnaires developed using a comprehensive review of the related literature, experts' opinions, documents, and interviews. A number of statistical procedures were taken to validate the current questionnaires including Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). EFA was utilized to determine the underlying factors of the scale that affect the variables in a data structure without setting any predefined structure to the outcome and to verify the number of factors; subsequently, these results were confirmed in the CFA phase. Ultimately, the results were discussed and implications of the questionnaires were presented as follows.

Language testing has witnessed three major trends in the 1990s: theoretical, methodological, and analytical. Theoretically, emphasis has been placed on the further understanding of the construct of language proficiency. Methodologically, there has been an outburst of interest in language performance testing and the promotion of the professional standards of test development and use. Analytically, emphasis has been placed on the implementation of Item Response Theory (IRT), G-theory, and the understanding of the multiple sources of variance in test performance. After a review of these trends, the current paper presents a complete picture of language assessment from an Archimedean point. It argues that language assessment, seen from such a point, has four intertwined but self-informed pillars: construct issues, psychometrics, edumetrics, and construct-irrelevant factors.

Test validity can be jeopardized to the extent that test scores are contaminated by factors other than those intended by the test. Many method specific factors and examinees' personal characteristics can influence test performance. In this study the contribution of four construct-irrelevant factors, namely, exam anxiety, reading anxiety, ambiguity tolerance, and attitudes towards reading to reading comprehension test performance was examined. Correlation and multiple regression analysis showed that reading anxiety and attitudes toward reading significantly contribute to reading test performance while exam anxiety and ambiguity tolerance do not. This finding shows that examinees' reading anxiety and attitudes toward reading can invalidate the reading comprehension test scores to a certain degree. Implications and limitations of the findings are discussed and some recommendations for test administrators and teachers are provided.

Shifting focus of asocial language tests toward social considerations recalls their ideological basis (Mirhosseini, De Costa, 2020). The recurrent exposure to and involvement in discursive constructions of high stakes' contents, may bring along certain sociocultural conceptualizations and values by test audiences (van Dijk, 1998). Thus, unless a clear perception of their contents is gained, any discussions on test misuses, fairness, and negative consequences seem ungrounded. To complement prior findings on sociocultural meanings of the IELTS test contents (Noori & Mirhosseini, 2021), and as another phase of triangulated approach to my dissertation study, the mediated contents through IELTS teachings were recorded through a micro-ethnography of 22 online IELTS classes offered by an IELTS center in Iran. Bridging critical views of language testing and critical discourse analysis, qualitative content analysis was conducted in search of reflected topics. The emerging 89 codes sat together in four prominent categories outlining the whole content of IELTS pedagogical practices: Entertainment, Money, Education, Immigration, and a Miscellaneous set of minor topics. The findings reflected a homogeneous conceptual flow through inclusion/exclusion/contrast of certain limited value-laden topics restricted to core communities in the contents of IELTS tests, preparation materials, and pedagogical practices. I suggest inclusion of sociocultural content-wise considerations in language teaching and testing contents including test and content validity perspectives, and as new test facet to be accounted for in washback, fairness, and consequential validity frameworks. Reconsideration of test content validity is also put forwarded in terms of included test topics and their value implications. These perspectives which account for inclusive views and long wished glocalization, will manifest "the road not taken" (Frost, 1916, p.9)/wrongly taken in language assessment and teaching and will further their literacy.

Shame is a significant factor for psychological problems in adolescents. The present study aims to assess the Persian version of the Adolescent Shame-Proneness Scale (ASPS) among Iranian adolescents. Participants of this correlation study were 2291 high school students aged 12-18 (1296 girls and 1036 boys), selected through a multistage random cluster sampling method. The results indicated that the ASPS has adequate validity and reliability. Assessment of model fit using confirmatory factor analysis revealed satisfactory goodness of fit indices. Similar to the original version of ASPS, a three correlated factor model was confirmed in the present sample, and girls scored higher on all three subscales of ASPS. This scale can be a reliable and flexible instrument for measuring the significant emotion of shame in Iranian adolescents in research and clinical settings and can help expand the shame literature.

In this study the validity of partial dictation as a measure of overall language proficiency was examined. Two partial dictation tests along with a C-Test, a cloze test, and a reading comprehension test, as criterion measures, were administered to a group of Iranian EFL learners. The coefficients of correlation between partial dictation and criterion measures were computed. Correlations revealed that partial dictation highly correlates with the cloze test, the C-Test, and the reading comprehension test. Principal components analysis showed that all the variables (four C-Test passages, two dictation passages, one cloze passage, and one reading comprehension passage) formed one single factor which explained 58% of the variance. All the variables had high loadings on the factor. These findings were interpreted as evidence of the similarity of the construct measured by partial dictation and other measures employed in the study. Desiderata for future research and potential applications of partial dictation in foreign language testing and teaching are discussed.

The present study is conducted to implement the newly developed questionnaire to assess the readiness of academics for Implementation of e-learning programs. The questionnaire was developed and its validity and reliability were evaluated. Then a cross-sectional study was conducted including 907 academics in three categories (faculties, students, and employees) of Shiraz University of Medical Sciences. Data were analyzed in SPSS-16 using descriptive and inferential statistics. The results of the implementation of the questionnaire showed a significant relationship between e-learning knowledge and participants' position in the university, as the professors and students had higher levels of this knowledge compared to the university employees (P<0.001). There was a significant relationship between e-learning knowledge and an academic degree in the study subjects (P=0.004). Skills and attitude were also significantly related to the variables of position, academic degree, and place of residence and hours of internet use. Skills, knowledge and attitude were all related to computer and internet access and language used on the internet.

By shifting the focus of studies in applied linguistics from negative psychology to positive psychology, psychological capital (PsyCap) consisting of self-efficacy, hope, optimism, and resilience can be an influential factor in the language classrooms. Prior studies have emphasized the role that PsyCap plays in management, though little attention has been given to it in education. Therefore, to address this gap, this research intends to assess the role of PsyCap in learners' second/foreign (L2) willingness to communicate (WTC), L2 motivational self system, and L2 achievement. To achieve this goal, 317 Iranian English as a foreign language (EFL) learners took part in the present study and completed the measures of PsyCap, L2 WTC, and L2 motivational self system. The findings of structural equation modeling demonstrated that the learners' PsyCap was a positive significant predictor of L2 WTC, L2 motivational self system, and L2 achievement. These findings confirm the influential role of PsyCap in language education. Based on the findings, some recommendations were presented on how to apply PsyCap to the realm of language education.

The purpose of this study was to design a comprehensive and native scale, and to investigate the validity and reliability of teachers' academic emotions scale including anxiety, happiness, anger, pride, hope and despair, exhaustion, shame and guilt through a nine-factors TAE model (second order hierarchy) and a two-factors TAE model (third-order hierarchy). A sample of 114 teachers was obtained from the population through multistage random sampling. Considering the questionnaire items and sample size, Partial Least Square Structural Equation Modeling (SEM-PLS) method was used to analyze the data of the questionnaire. Reliability was measured by three criteria: Cronbach alpha, composite reliability (CR), and consistency and validity of the questionnaire by two convergent and divergent validity criteria. Findings indicate that the reliability and validity of all dimensions were acceptable. Standardized coefficients and significance coefficients (t values) indicate the effect of specific structures in that path on each other are significant, and subsequently, the research hypotheses are confirmed. Furthermore, the contribution of R2 values in all dimensions was evaluated moderate to high in measuring all teachers 'emotions. The CVRed and CVCom coefficients indicate that the quality of the internal model and the external model are higher than average and according to GOF, the predictive value is generally much higher than strong, and this TAE model has a prediction power up to 97% of the covariance based models. Finally, in order to compare two models of second order and third order hierarchical TAE, the goodness of fit information measures were evaluated and the second-order hierarchical model was considered a better model for TAE.

Language assessment knowledge (LAK) is essential for EFL teachers in developing sound assessments and making informed decisions about the progress and achievement of students. It is also essential to have sound measures of teachers' LAK to help them improve their professional accomplishments. To address the issue, this study was designed in multiple stages to develop a test to measure EFL teachers' LAK. First, EFL teachers' needs were identified using an already validated questionnaire (Farhady & Tavassoli, forthcoming). Second, the topics identified through needs analysis were crosschecked with the topics in the assessment textbooks to assure appropriate content coverage. Third, based on the data obtained from needs assessment of 246 EFL teachers and the content of popular language assessment textbooks, a scenario-based LAK test with closed-item formats was developed in six parts, each focusing on one major area of language assessment. Fourth, after having the test reviewed by experts, it was revised and piloted with 50 EFL teachers, necessary revisions were made based on the results of piloting, and the test was finalized and administered to 164 EFL teachers. The data analysis revealed that contrary to teachers' claims in needs assessment, the majority of them had low levels of LAK and they showed willingness to improve their LAK. Further, possible relationships between teachers' LAK and their gender, field of study, educational level, teaching context, and teaching experience were investigated. The findings are presented and implications and applications of the study are explained.

There exists cross-cultural differences in English classes regarding the factors that demotivate students and lead to dropout. The present study, following the guidelines suggested by Rowsell (1992), mainly aimed to design and validate a questionnaire for the reasons for dropout. To do so, the researchers, first, interviewed with 20 translation teachers and experts based on criterion sampling and the results emerged from the interviews were categorized into 16 common themes. Then, the questionnaire items including 28 items were constructed based on the commonalities emerged from the responses, and it was administered to 90 subjects during the two phases of pilot study. The researchers opted for factor analysis to determine the hidden traits of the questionnaire. Initially, PCA extracted 9 factors with eigenvalues greater than 1.0, accounting for 78% of the variance. Out of 28 items, 26 items had loadings of 0.40 or greater on any factor. During the second phase of the pilot study, the questionnaire was administered again to 90 subjects, and this time, PCA extracted 8 factors, accounting for 75% of the variance. Finally, the researchers explored the students' justifications for the major reasons for dropout from English institutes. The study offers practical implications for language teachers and students.

In this study, the cloze-elide test was developed and administered under time constraints. This research is aimed to examine the validity and reliability of the speeded cloze-elide test and investigate its relationship with reading comprehension, C-Test, and multiple-choice cloze test. Processing speed is a vital indicator to distinguish high to low levels of language proficiency. The obtained test scores of the test takers' performance in the restricted time reveal their level of overall language proficiency. One-hundred fifty Iranian undergraduate English students were selected to participate in this study. A reading comprehension test, C-tests, multiple-choice cloze tests and speeded cloze-elide tests were presented to the students. The Cronbach's alpha reliability revealed that speeded cloze-elide test is highly reliable. Moreover, the principal component analysis resulted in the presence of one component which supports the unidimensionality of the data. The findings also illustrated that the C-Test is a slightly better measure of reading comprehension than multiple-choice cloze test and speeded cloze-elide test. Based on the analysis of data, time limitations increase the test validity and test reliability on the cloze-elide test.

Teacher agency as an influential factor in teacher professionalism has recently gained global inquiry in the EFL context. However, no valid instrument has ever been designed to evaluate EFL teachers' ecological agency. This gap prompted the researchers of the current study to develop and validate a questionnaire to assess EFL teachers' ecological agency. In the first phase, a comprehensive review of the literature and semi-structured interviews were conducted to determine the underlying components of the teacher ecological (TEA) questionnaire based on Priestley et al.'s ("Flip the System" 134-148, 2015) ecological agency model. In the second phase, the newly developed TEA questionnaire including 40 items was subjected to reliability and validity issues. Therefore, it was piloted with 222 Iranian EFL teachers selected through non-probability convenience sampling. The Cronbach alpha results confirmed an acceptable reliability index (0.858). The results of factor analysis revealed that the number of items was reduced to 37 and indicated that the data on teacher ecological agency loaded on 3 components: iterational (9 items), practical-evaluative (14 items), and projective (10 items). In addition, the structural equation modeling (SEM) results confirmed that the model enjoyed sound psychometric properties. The upshots of the current study have undoubtedly significant implications for teacher educators and teaching practitioners.

The Oral Motor Assessment Scale (OMAS) is a diagnostic tool used to assess the oral motor skills in individuals with neurological and neuromuscular disorders. This assessment was developed by Brazilian researchers and for the first time, its validity and reliability was examined in Brazil. The purpose of the present study was to examine the validity and reliability of the adopted Persian version of the OMAS (OMAS-P) to assess the oral skills of Iranian individuals with cerebral palsy (CP). In this non-experimental descriptive-analytical study 120 people (60 children and adolescents with CP) aged 3 to 15 years and 60 healthy subjects) participated. The research was carried out in number of stages including translation and adaptation of the OMAS to Persian (OMAS-P) in a forward-backward way. The oral motor skills functionality of the 120 people was examined using the OMAS-P. To assess the repeatability and reliability of the OMAS-P the assessments was repeated on the participants with CP disorder after two weeks. Results corresponding to this study indicated a reasonable agreement (Kappa >0.7) for all the OMAS-P items. The mean values of the OMAS-P items were appreciably different between the two groups (p < 0.001). The Persian version of the OMAS (OMAS-P) indicated consistent psychometric properties and can be used as a reliable tool for oral motor skills assessment in people with CP. However, it seems that by specifying factors such as the time frame for the OMAS, the position of the child during assessment, and whether or not parents use facilitating techniques, the comprehensiveness and efficiency of the OMAS data will also upgrade.

Listening comprehension in English, as one of the most fundamental skills, has an essential role in the process of learning English. Non-parametric item Response Theory (NIRT) is a probabilistic-nonparametric approach to item response theory (IRT) which determines the one-dimensionality and adaptability of test. NIRT techniques are a useful tool for researchers who wish to construct one-dimensional tests. The current study utilized the NIRT to examine adaptability of TEOFL iBT listening test, administered on 400 EFL university students in the Iranian context. The results illustrated no main concerns in terms of item adaptability. It was concluded that the ordering of items according to their mean is invariant across examinees. Dimensionality analysis results depicted that the test is one dimensional -confirming evidence of the validity of the test in measuring a single ability dimension. The empirical application depicted a potential and feasible approach, whereby NIRT could be used as a valuable method for exploring the behavior of scaled items in response to varying levels of a latent trait in education research.

Listening comprehension in English, as one of the most fundamental skills, has an essential role in the process of learning English. Mokken scale analysis (MSA) is a probabilistic-nonparametric approach to item response theory (IRT) which determines the one-dimensionality and scalability of test. Mokken scaling techniques are a useful tool for researchers who wish to construct unidimensional tests or use questionnaires that comprise multiple binary or polytomous items. The current study utilized the MSA to examine one-dimensionality and scalability of TEOFL iBT listening test, administered on 400 EFL university students in the Iranian context. The results illustrated no main concerns in terms of item scalability. Monoton homogeneity model (MHM) fitted all the items of the test very well as measured by the scalability coefficients and restscore groups method. Considering the invariant item ordering (IIO), it was concluded that the ordering of items according to their mean is invariant across examinees, although HT was small. Dimensionality analysis results using the automated item selection procedure (AISP) depicted that the test is unidimensional-confirming evidence of the validity of the test in measuring a single ability dimension. The empirical application depicted a potential and feasible approach, whereby MSA could be used as a valuable method for exploring the behavior of scaled items in response to varying levels of a latent trait in education research.

This study was set to prepare and validate the Achievement Emotions Questionnaire-Foreign Language Class (AEQ-FLC) for use in the context of English as a foreign language (EFL). The AEQ is largely used and validated with different cohorts of students in different domains. However, despite its need for valid measurement instruments to serve the increasing interest in researching second language emotions, the language classroom is a domain that has been largely overlooked in the validation project. To fill this measurement lacuna, data were collected from 748 Iranian EFL learners, and the collected data were submitted to confirmatory factor analysis (CFA). The CFA results indicated that the psychometric properties of the AEQ-FLC could be substantiated, and that its structure was invariant across gender and learning context. The implications for the use of the AEQ-FLC in both research and practice are discussed.

Despite the recent theoretical and empirical interest in understanding teachers' motivation to conduct research, there is an absence of an appropriate quantitative instrument to measure it. Thus, drawing on an argument-based approach to validation, Deemer, Martens, and Buboltz's (2010) Research Motivation Scale (RMS) was adapted and a network of empirical evidence was established in 2 separate studies with 202 and 201 Iranian school English teachers (SETs) to construct such an instrument. We interpreted our findings across 4 inferences (i.e., target domain, scoring, generalization, and extrapolation), judging if the evidence supported our proposed interpretation of the scores. The overall process resulted in the 22-item Teacher Research Motivation Scale (TRMS) with 3 dimensions, namely Intrinsic Research Motivation (IRM), Extrinsic Research Motivation (ERM), and Research Failure Avoidance (RFA), offering preliminary support for the interpretation of the TRMS scores as a measure of Iranian SETs' motivation to conduct research. Potential implications and suggestions for future research are discussed.

Although fairness in assessment practices has gained noticeable attention over the recent years, there has been a long-lasting study to design and validate a questionnaire to measure it from a psychometric perspective. Thus, this study aims to develop and validate a questionnaire with adequate psychometric properties to measure fairness in classroom assessment. Using a random sampling method, two samples of male and female university students for the first pilot (n = 128) and the second pilot (n = 360) were selected from Ayatollah Borujerdi University and Lorestan University. Drawing on the past literature, a pool of items (n = 118) were extracted and subjected to a 12-step systematic procedure, including content analysis and sampling; creating an item bank; running the first pilot; creating item pool one; expert judgment to evaluate the sub-scales; running an interview and think-aloud protocol; running Cronbach's alpha; running the second pilot; running exploratory factor analysis, confirmatory factor analysis, and Cronbach's alpha; creating item pool two; expert review; and translation and translation quality check. Findings yielded a 110-item questionnaire with 10 sub-scales: learning materials and practices (18 items); test design (24 items); opportunities to demonstrate learning (8 items); test administration (21 items); grading (11 items); offering feedback (6 items); tests results interpretation (5 items); decisions based on tests results (3 items); test results consequences (4 items); and students' fairness-related beliefs and attitudes (10 items). The hope is that this questionnaire can serve research and educational purposes.

The current study reports the results of a project aimed at assessing L2 listening comprehension by drawing on two approaches to dynamic assessment: interventionist and interactionist. The former approach was actualized by providing two graduated hints which were fixed and standardized for all test takers while the latter was actualized by asking test takers to enter into dialogue with the tester to receive more flexible mediation. By taking into account how much mediation (how many hints) each test taker uses, the computerized listening test automatically provides three scores: traditional score, dynamic score, and learning potential score. 91 grade nine students at Iranian junior high schools took the computerized dynamic test. The findings of the study indicated that while having validity, the test could improve test takers' listening comprehension ability. Moreover, the test made it possible to obtain information regarding test takers' potentiality for learning which goes beyond and over their initial performance level. The pattern of mediation use by test takers across different test items indicated that more challenging listening questions are in need of more flexible and open-ended mediation. Using three scores for each test taker, language teachers can more effectively tailor their instruction to their learners' needs.

An increased enthusiasm on teacher accountability, in recent times, has led policy makers and teachers to a significant care over evaluating teachers' success. To this aim, a 40-item Teacher Success questionnaire was developed and validated by the application of the Rasch model. The Rasch model is used to decide whether the scores of an instrument are meaningful, significant, and purposive. The test was developed in Persian to be used for Iranian teachers. The Rasch rating scale model for polytomous data was used to examine the psychometric qualities of the scale in terms of dimensionality, use of response category, sample appropriateness, and reliability. The test was administrated to 828 Iranian EFL students. The results revealed that the Rasch model fits the test after deleting 8 items from the scale. Moreover, it is confirmed that the scale enjoyed suitable reliability. This proposes that the questionnaire is potentially valid and can be used as a measure of teachers' success in the Persian language settings.

Test method is deemed to affect test scores along with examinee ability (Bachman, 1996). In this research the role of method facet in reading comprehension tests is studied. Bachman divided method facet into five categories, one category is the nature of input and the nature of expected response. This study examined the role of method effect in the Iranian University Entrance Exam (UEE). Research showed the current test method of assessing reading can highly impact test takers? performance and thereby examinees? test scores. Hence, different test formats may extract various traits and therefore, contaminate test scores and threaten validity. The researchers using exploratory factor analysis (EFA) extracted a second method factor in the reading comprehension section of the UEE which is composed of a multiple-choice cloze passage and multiple choice questions based on sustained texts. Results of the analysis showed that cloze test can create construct-irrelevant method variance, contaminating test scores, and led to violation of the unidimensionality assumption of the test.

Test impact, widely recognized as the influence of testing on learning and teaching, affects a set of stakeholders including test takers. This study defines the construct of test impact on test takers and describes the construction and validation of the scale of test impact on test takers (TITT). 410 participants having passed a language test in University Entrance Examination (UEE) were asked to answer the questionnaire containing 64 items. Exploratory factor analysis was applied in the study and yielded evidence for the expected five factor structure of the TITT scale, including the components of test results, test awareness, test experience, test importance, and test sociocognitive effects. The final TITT Scale and its subscales consisting of 56 items demonstrated an acceptable internal consistency and expected levels of stability of the responses across time. Cronbach's alpha was 0.93 for the global TITT scale and between 0.78 and 0.88 for the five subscales. Implications are discussed and suggestions are provided for possible utilization and improvement of the scale, and future validity testing.

Teacher evaluation and certification is a proper approach taken to assess teacher knowledge base and to guarantee that teacher candidates are qualified and have met particular teaching standards. To this end, teacher-education university (i.e., Farhangian University) of Iran recently adopted a teacher evaluation and certification policy, nationally called ASLAH, which mandates all teacher candidates to earn a teaching certification by passing a comprehensive exam. The purpose of the present mixed-method study was to describe the development and validation of 'a written assessment framework', as one of the requirements of ASLAH project, that would measure English teacher candidates' professional knowledge and competency to teach English. The data were collected through a series of interviews with teacher educators and subject-matter experts (N=15), questionnaire surveys that involved 320 English language teachers, and test performance of 62 English teacher candidates. First, the study dealt with the development of the hypothesized framework that included items assessing teacher Content-Knowledge (CK) competency by virtue of nine domain-specific courses recommended by experts' qualitative and quantitative data. The items were empirically determined for content specification and validity, item difficulty and item discrimination. An initial piloting of the newly developed tool to teacher candidates showed tests as valid and reliable instruments for measuring teachers' CK competency. Perceived 'fairness', 'consequences', and 'quality of the results' of the present certification policy and practice were also explored from the eyes of all participants. The results showed that they were not negative about the possible test consequences and fairness. However they did not appear to be strongly positive about the practicality of teacher evaluation and certification project in the present context of teacher-education university. Policy recommendations and implications of the findings were discussed.

Examining the long-term impact of bullying can facilitate using retrospective bullying experiences questionnaire (RBEQ) which provides information regarding bystander, bully and victim through childhood to adolescence. This study aimed to investigate the validity and reliability of this questionnaire in Iranian samples. A total of 92 male and 283 female university students participated in this study. Factor structure of the questionnaire was investigated by exploratory and confirmatory factor analyses. The results of principal components analyses showed that questionnaires' items in the primary, middle and high school parts consisted of three separate factors: bystander, victim and bully. However, bullying sub-types could not be identified as separate components. Regarding confirmatory factor analyses, the extracted single-factor models revealed optimal goodness of fit indexes and high loading factor. The results of the criterion validity of the RBEQ with the Buss--Perry aggression questionnaire showed positive significant correlations between all factors of the questionnaires. Reliability of the factors of bystander, victim and bully in three educational levels was also confirmed by internal consistency and split-half coefficients. The results indicated that the Persian version of the RBEQ has appropriate validity and reliability in Iranian university students.