Search

Lesson planning is a core part of teachers' professional competence. Written lesson plans play a significant role in science teacher education as a preparation for demonstration lessons during the final teacher certification exam. However, the few existing scoring rubrics on lesson plans are not particularly theoretically sound and are barely tested for the validity of score interpretations. In response to the demand for transparent and applicable criteria, we developed the rubric to assess science lesson plans (RALP) to assess science teachers' lesson plan quality. We employed a mixed‐methods approach: First, we present multiple sources of validity evidence (based on test content, internal structure, relations to other variables, and consequences of testing) as mainly quantitative indicators for the quality of the RALP. Based upon that, we applied the RALP to lesson plans written by preservice and trainee science teachers (N = 100) and provided a qualitative analysis of six cases to illustrate common patterns in these lesson plans. Results indicate that teacher educators consider the RALP criteria (N = 24) relevant and objectively applicable. Correlation analyses of the scores and two teacher educators' holistic quality assessment of all lesson plans provide convincing evidence that the RALP can discriminate lesson plan quality levels. Moreover, comparisons between preservice science teachers and trainee science teachers reveal that trainee teachers score significantly higher than preservice teachers, indicating that the RALP is sensitive to differences in teaching and planning experience. The application and in‐depth analysis of three criteria of the RALP illustrate these differences in levels of planning quality. We discuss possible applications of the RALP in science teacher education and research in science teaching. [ABSTRACT FROM AUTHOR]

The development of metaknowledge about models (MKM) and metaknowledge about the modelling process (MKP) are important in pre-service science teachers (PSTs) education. MKM refers to knowledge about the model's entities and its purposes, while MKP refers to knowledge about the components and structure of the modelling process. Assessing MKM and MKP is crucial to foster this knowledge in PSTs' education. However, assessment instruments focus on MKM rather than MKP, and the connection between MKM and MKP had not been examined deeply. This study validates and applies a diagram task for assessing PSTs' MKP. For validation, ten experts were surveyed and think-aloud interviews were conducted with ten PSTs. The findings support valid interpretations of PSTs' MKP based on the diagram task. In the main study, the diagram task was administrated to 63 PSTs, along with an MKM questionnaire. PSTs' MKP ranged from simple conceptions of modelling as a linear process including few components to sophisticated conceptions of modelling as an iterative process including multiple components. Furthermore, it was found that knowledge about using models to predict a phenomenon is an aspect connecting sophisticated MKM and MKP, indicating that this aspect is crucial to foster both, PSTs MKM and MKP. [ABSTRACT FROM AUTHOR]

Scientific reasoning competencies are relevant science competencies and therefore the development of assessment instruments for scientific reasoning competencies has become an integral part of science education research. However, some authors have questioned the validity of the instruments available so far, since their psychometric quality has not been evaluated satisfactorily. In this study, an established German multiple-choice instrument to assess scientific reasoning competencies has been translated into English and Spanish and the translated versions were evaluated based on the translation, review, adjudication, pretesting and documentation (TRAPD) approach. Based on samples of German (N = 497), Australian (N = 103), and Chilean (N = 135) pre-service science teachers, statistical analyses (e.g. dimensionality and DIF analyses) provide psychometric evidence for test equivalence between the German and the translated versions of the instrument. Known groups comparisons provide evidence for the valid interpretation of the test scores as measures of scientific reasoning competencies. It is discussed that further studies might evaluate additional sources of validity evidence for the translated versions of the instrument, particularly focusing on cultural specificities. Independent of this need for further research, it is suggested that the three versions can be used to assess the scientific reasoning competencies of pre-service science teachers whose first language is English, German, or Spanish. [ABSTRACT FROM AUTHOR]

Students’ and pre-service teachers’ conceptions of scientists have been assessed in a variety of studies. One of the most commonly used instruments is the Draw-A-Scientist Test (DAST) which offers the advantage that no verbal skills are needed by the participants. In some studies, methodical challenges related to the DAST have been discussed; for example, the lack of drawing abilities among the subjects or the impact of the prompt itself on the drawings which lead to invalid interpretations. This study aims to evaluate the eligibility of the DAST or similar instruments to validly assess conceptions of scientists and their work. Pre-service science teachers in two cohorts (N1 = 79,N2 = 101) were prompted to draw their conceptions of a scientist, the location at which the scientist is working, and his/her scientific activity. The participants of cohort 2 were also asked to give written descriptions of their drawings and information on the conditions while they were drawing. From the results, several points of methodical criticism can be made which question the valid interpretation of DAST-drawings. Instead of using the DAST, we suggest developing and evaluating other formats, such as open-ended or closed-ended instruments which could produce a more validly interpretable assessment of individuals’ conceptions in this field. [ABSTRACT FROM PUBLISHER]

The aim of this study was to improve the criterion-related test score interpretation of a text-based assessment of scientific reasoning competencies in higher education by evaluating factors which systematically affect item difficulty. To provide evidence about the specific demands which test items of various difficulty make on pre-service teachers’ scientific reasoning competencies, we applied a general linear mixed model which allows estimation of the impact of item features on the response observations. The item features had been identified during a standard setting process. Results indicate important predictive potential of one formal item feature (length of response options), two features based on cognitive demands (processing data from tables, processing abstract concepts) and one feature based on solid knowledge (specialist terms). The revealed predictive potential of item features was in accordance with the cognitive demands operationalised in our competence model. Thus, we conclude that the findings support the validity of our interpretation of the test scores as measures of scientific reasoning competencies. [ABSTRACT FROM PUBLISHER]