Search

We report on the development of a rubric to reliably qualify and score responses to the Views of Nature of Science Questionnaire (VNOS): The VNOS Analysis and Scoring Rubric (VAScoR). The VAScoR is designed to (a) provide systematic guidance for the qualitative analysis, and score assignment to nuanced categories, of VNOS responses, (b) explicitly scaffold qualitative inferencing and standardize score assignment to substantially lessen the burden of, and variance in, analyzing and scoring the VNOS, and (c) improve the viability and meaningfulness of cross‐study comparisons drawing on VNOS data. The rubric adopted the VNOS's consensus NOS framework and further delineated core and related elements across 10 target NOS aspects. The VAScoR's reliability was examined in two studies that drew on VNOS questionnaires completed by 185 preservice secondary science teachers (58% female; 126 undergraduate and 59 graduate students) enrolled over several years in a combined undergraduate and graduate licensure program in a large U.S. Midwestern university. In Study I, VAScoR analyses of 86 VNOS questionnaires undertaken by a single author were used to examine the rubric's intra‐rater reliability, which resulted in a robust Cronbach's alpha value of 0.81. In Study II, analyses by four authors of a randomly generated, overlapping set of 18 questionnaires were used to examine inter‐rater reliability, which was supported with substantial consensus among raters as indicated by a Cohen's kappa of 0.71. Further evidence for the VAScoR's inter‐rater reliability was indicated by moderate to strong consistency among four raters with an overall Pearson's correlation coefficient of 0.82, and coefficient values ranging from 0.77 to 0.89 for six possible rater pairings. [ABSTRACT FROM AUTHOR]

This study pursued two major objectives. The first was to use bibliometric techniques to examine bidirectionality in the relationship between teachers and researchers, as indicated by collaborative authorship among these communities. The second was to explore more deeply knowledge mobilization to classrooms by documenting the extent to which research is cited in science education practitioner journals (SEPJ). Specifically, we examined: (a) the frequency of collaboration between researchers and practitioners in the writing of journal articles for both practitioner‐focused and academic journals in science education, and (b) the extent to which authors of articles in practitioner‐focused journals drew on academic research to support their advocacy for and/or description of science education programs, policies, or practices. Findings indicate that writing collaborations among academic researchers and practitioners are relatively infrequent, even on practitioner‐focused articles. Also, articles in SEPJs more often cite books and other resources over academic journals, even those academic journals focused on informing science education teaching and learning. Recommendations include providing open access to published research, development of research summaries for lay audiences, and incentivizing practitioners to engage in research and writing. This study explores only one mechanism by which knowledge can be mobilized to classrooms and only one type of dissemination product (i.e., journal articles) upon which researchers and practitioners can collaborate. Additional limitations are noted including the applicability of the findings only to the specific journals and timeframes analyzed. [ABSTRACT FROM AUTHOR]

This study evaluated the representations of nature of science (NOS) in U.S. state science standards, and examined the changes in these representations from documents advanced in the 1980s through 2016. Drawing from the consensus perspective on NOS and prior studies focusing on the analysis of textual content, documents were inspected for 10 target NOS aspects: the empirical, tentative, inferential, creative, theory-driven, and social NOS, in addition to the myth of "The Scientific Method," the nature of scientific theories and laws, and the social and cultural embeddedness of science. Ninety-eight state documents from 48 states were analyzed and multiple editions were collected from 34 states. Additionally, relevant materials from the Next Generation Science Standards (NGSS) were assessed for their coverage of the same NOS aspects. Collected materials were scored as whole documents, including over 11,000 pages of text in total, on each target aspect, which reflected the treatment (naïve vs. informed) of NOS in text and the manner of presentation (explicit vs. implicit). Overall, surprisingly, state standards documents have improved very little with respect to their NOS coverage over the last 30 years. NOS standards documents remain silent on a majority of key aspects of NOS, and the number of aspects showing explicit, informed representations has held constant. The NGSS performed well compared to many contemporary documents, but they failed to address all target NOS aspects in a desirable manner. Further analysis raised concerns with the degree that states fully adopt and disseminate standards in manner consistent with the NGSS despite stated intentions, which may negatively impact NOS coverage in instructional resources and classroom enactments. To improve NOS representations in standards, recognizing the role these documents play in shaping instructional materials and teaching in the science classroom, exemplars from analyzed materials were highlighted with informed and explicit representations of multiple aspects.

The present study examined students' attitudes toward science and associated constructs, based on the theories of reasoned action and planned behavior, and explored relationships between individual and school-related variables common to the research literature. Responses from 1,291 students in Grades 5 through 10 were collected using the 30-item Behaviors, Related Attitudes, and Intentions toward Science (BRAINS) Survey along with background information questions. Additional self-report data were collected from teachers (n = 56; 82.4%) in participating schools (n = 68) to obtain information about their education and experience, characteristics and practices, as well as other classroom variables, which could influence students' outlook. Student information, teacher data collected, and other data compiled about participating schools, were used to explore patterns in students' attitudes, beliefs, and intentions. These variables were used to generate multivariate multilevel models through a forward construction process. The final model presented favors individual variables to explain differences in students' responses on all five of the BRAINS subscales, more than group-level variables captured. Of the predictor variables explored, students' perceived science ability and frequency of talk with family were influential on all subscales, and increasing these variables had a positive effect on the estimated mean scores according to the final model presented. Findings from this study also include commonly observed relationships, such as the decline in attitudes over time, but these were found to be less pervasive in this sample. The paper concludes with a discussion about the comparative ineffectiveness of teacher and school-related variables in explaining students' attitudes toward science in this study, in light of design decisions and limitations, to guide future investigations.

The aim of the present study is to enable future studies into students' attitudes toward science, and related constructs, by developing and validating an instrument suitable for cross-sectional designs. Following a thorough review of the literature it was determined that many extant instruments included design aspects that appeared to be limited in some way. The BRAINS (Behaviors, Related Attitudes, and Intentions toward Science) Survey was designed to address core criticisms that have been leveled against many existing instruments. BRAINS was rooted in a theoretical framework drawn from the theories of reasoned action and planned behavior (TRAPB). Initial development involved review by an expert panel, adaptation for online delivery and a pilot on this platform. To establish the psychometric validity of the 59-item instrument it was administered to a representative, random sample of 1,291 Illinois students in grades 5 through 10. Confirmatory factor analysis and subsequent refinement yielded a 30-item instrument with five factors and a good statistical fit including a RMSEA of 0.04 and a CFI of 0.95. The five factors, or constructs, of the final instrument model reflect the underlying TRAPB framework: attitudes toward science, behavioral beliefs about science, intentions to engage in science, normative beliefs, and control beliefs.

This study assessed the (i) ways in which, and extent to which, several aspects of nature of science (NOS) are represented in high school biology and physics textbooks in the United States (U.S.); (ii) extent to which these representations have changed over the course of several decades; and (iii) relative impact of discipline, and textbook publishers versus authors on the observed patterns. NOS aspects included the empirical, tentative, inferential, creative, theory-laden, and social NOS; myth of "The Scientific Method"; nature of theories and laws; and social and cultural embeddedness of science. The sample included 34 (16 biology and 18 physics) textbooks, which commanded significant shares of the U.S. science textbook market. Textbooks were selected from seven "connected series" (three in biology and four in physics), which spanned 1-5 decades, with five series spanning, at least, 3 decades. Textbooks were scored for the accuracy and manner in which, as well as the extent (in textbook pages) to which, the target NOS aspects were represented. Analyses indicated that, on average, only less than 2.5% of the analyzed textbook pages were dedicated to addressing NOS constructs. Overall, representations of NOS in the textbooks did not differ by content area, were discernibly less than favorable, and did not improve substantially over the past several decades. These trends are incommensurate with the emphasis placed in U.S. reform efforts on helping precollege students develop informed NOS conceptions. Finally, the data strongly suggested that textbook authors have a relatively greater impact on the observed patterns when compared to textbook publishers.