Search

The ground-breaking image of a black hole's event horizon, which captured the public's attention and imagination in April 2019, was captured using the power of interferometry: many separate telescopes working together to observe the cosmos in incredible detail. Many recent astrophysical discoveries that have revolutionized the scientific community's understanding of the cosmos were made by interferometers such as LIGO, ALMA, and the Event Horizon Telescope. Astro 101 instructors who want their students to learn the science behind these discoveries must teach about interferometry. Decades of research show that using active learning strategies can significantly increase students' learning and reduce achievement gaps between different demographic groups over what is achieved from traditional lecture-based instruction. As part of an effort to create active learning materials on interferometry, we developed and tested a new "Lecture-Tutorial" to help Astro 101 students learn about key properties of astronomical interferometers. This paper describes this new "Lecture-Tutorial" and presents evidence for its effectiveness from a study conducted with 266 Astro 101 students at the University of North Carolina at Chapel Hill.

In this paper we put forth a model for physics course reform that uniquely uses proven, research-based active-learning strategies to help students improve their physics knowledge and problem-solving skills. In this study, we compared the exam performance of students in two sections of the same introductory physics course. One section (the traditional section, N = 258) was taught by an instructor who is highly regarded for his lectures, but did not use any active-learning teaching strategies. The other section (the reformed section, N = 217) was taught by an instructor who had never before taught a physics class, but who was trained in physics and astronomy education research and who used active-learning teaching strategies. Students in the reformed section significantly outperformed students in the traditional section on common exam questions over the course of the semester, regardless of whether the question was conceptual or quantitative. This reform effort has been successful at improving students' learning and significantly increasing the department's use of active-learning strategies at the introductory level and beyond.

The discovery and characterisation of planets orbiting distant stars has shed light on the origin of our own Solar System. It is important that college-level introductory astronomy students have a general understanding of the planet formation process before they are able to draw parallels between extrasolar systems and our own Solar System. In this work, we introduce the Planet Formation Concept Inventory (PFCI), an educational research tool used to assess student learning on the topic of planet formation. The PFCI Version 3 was administered to N = 561 students pre-instruction and N = 374 students post-instruction. Here, we present a Classical Test Theory (CTT) analysis of the PFCI Version 3. Ultimately, we conclude that the PFCI is a reliable and valid instrument that can differentiate experts from novices, and can be used to assess college-level introductory astronomy students' learning on the topic of planet formation. Initial findings on class normalised gain scores indicate that the PFCI may be capable of assessing the effectiveness of different instructional models. In the future, we recommend a national study of the PFCI to discern its ability to provide insight regarding the ascribed characteristics of learners and the effectiveness of different instructional strategies being used to teach this topic.

[This paper is part of the Focused Collection on Astronomy Education Research.] This paper presents the first item response theory (IRT) analysis of the national data set on introductory, general education, college-level astronomy teaching using the Light and Spectroscopy Concept Inventory (LSCI). We used the difference between students' pre- and postinstruction IRT-estimated abilities as a measure of learning gain. This analysis provides deeper insights than prior publications both into the LSCI as an instrument and into the effectiveness of teaching and learning in introductory astronomy courses. Our IRT analysis supports the classical test theory findings of prior studies using the LSCI with this population. In particular, we found that students in classes that used active learning strategies at least 25% of the time had average IRT-estimated learning gains that were approximately 1 logit larger than students in classes that spent less time on active learning strategies. We also found that instructors who want their classes to achieve an improvement in abilities of average [Delta Theta] = 1 logit must spend at least 25% of class time on active learning strategies. However, our analysis also powerfully illustrates the lack of insight into student learning that is revealed by looking at a single measure of learning gain, such as average [Delta Theta]. Educators and researchers should also examine the distributions of students' abilities pre- and postinstruction in order to understand how many students actually achieved an improvement in their abilities and whether or not a majority of students have moved to postabilities significantly greater than the national average.

This article reports on an investigation into the correlations between students' understandings of introductory astronomy concepts and the correctness and coherency of their written responses to targeted Lecture-Tutorial questions.

Light and spectroscopy are among the most important and frequently taught topics in introductory college-level general education astronomy courses (hereafter Astro 101). This is due to the fact that the vast majority of observational data studied by astronomers arrives at Earth in the form of light. While there are many processes by which matter can emit and absorb light, Astro 101 courses typically limit their instruction to the Bohr model of the atom and electron energy level transitions. In this paper, we report on the development of a new "Lecture-Tutorial" to help students learn about other processes that are responsible for the emission and absorption of light, namely molecular rotations, molecular vibrations, and the acceleration of charged particles by magnetic fields. Note that this paper primarily focuses on describing the variety of representations and reasoning tasks designed for this "Lecture-Tutorial"; while the end of this paper highlights some data that are suggestive of the "Lecture-Tutorial's" effectiveness, our more comprehensive analysis of its efficacy will be presented in a future publication.

When considering the variety of questions that can be used to measure students' learning, instructors may choose to use multiple-choice questions, which are easier to score than responses to open-ended questions. However, by design, analyses of multiple-choice responses cannot describe all of students' understanding. One method that can be used to learn more about students' learning is the analysis of the open-ended responses students' provide when explaining their multiple-choice response. In this study, we examined the extent to which introductory astronomy students' performance on multiple-choice questions was comparable to their ability to provide evidence when asked to respond to an open-ended question. We quantified students' open-ended responses by developing rubrics that allowed us to score the amount of relevant evidence students' provided. A "minimum rubric score" was determined for each question based on two astronomy educators perception of the minimum amount of evidence needed to substantiate a scientifically accurate multiple-choice response. The percentage of students meeting both criteria of (1) attaining the minimum rubric score and (2) selecting the correct multiple-choice response was examined at three different phases of instruction: directly before lab instruction, directly after lab instruction, and at the end of the semester. Results suggested that a greater proportion of students were able to choose the correct multiple-choice response than were able to provide responses that attained the minimum rubric score at both the post-lab and post-instruction phases.

What are the underlying worldviews and beliefs about the role of science in society held by students enrolled in a college-level, general education, introductory astronomy course (Astro 101)--and are those beliefs affected by active engagement instruction shown to significantly increase students' conceptual knowledge and reasoning abilities related to astronomy? To help answer this question, we administered Cobern's (Cobern 2001) "Thinking About Science Survey Instrument" (TSSI) to an Astro 101 class in the spring 2011. The TSSI probes students' beliefs about the relationship between science and many aspects of contemporary society. In this paper, we analyze the 442 pre-instruction and 294 post-instruction student responses we received to the TSSI. Many students select responses to the TSSI's items indicating they have positive views about the role of science in society. We also see a slight increase in the number of positive responses pre- to post-instruction. While there are limitations to the inferences one can draw from responses to a Likert scale survey such as the TSSI, this work nevertheless provides an important first step in a larger project to understand and affect the worldviews of general education, introductory astronomy students. To better interpret the significance of these results, we conclude by comparing the TSSI data to preliminary data from a related study in which we collected students' written responses to a series of provocative, open-ended prompts on the relationship between science and society. (Contains 12 tables and 9 figures.)

The Zooniverse projects turn everyday people into "citizen scientists" who work online with real data to assist scientists in conducting research on a variety of topics related to galaxies, exoplanets, lunar craters, and solar flares, among others. This paper describes our initial study to assess the conceptual knowledge and reasoning abilities of citizen scientists participating in two Zooniverse projects: Galaxy Zoo and Moon Zoo. In order to measure their knowledge and abilities, we developed two new assessment instruments, the Zooniverse Astronomical Concept Survey (ZACS) and the Lunar Cratering Concept Inventory (LCCI). We found that citizen scientists with the highest level of participation in the Galaxy Zoo and Moon Zoo projects also have the highest average correct scores on the items of the ZACS and LCCI. However, the limited nature of the data provided by Zooniverse participants prevents us from being able to evaluate the statistical significance of this finding, and we make no claim about whether there is a causal relationship between one's participation in Galaxy Zoo or Moon Zoo and one's level of conceptual understanding or reasoning ability on the astrophysical topics assessed by the ZACS or the LCCI. Overall, both the ZACS and the LCCI provide Zooniverse's citizen scientists with items that offer a wide range of difficulties. Using the data from the small subset of participants who responded to all items of the ZACS, we found evidence suggesting the ZACS is a reliable instrument (alpha = 0.78), although twenty-one of its forty items appear to have point biserials less than 0.3. The work reported here provides significant insight into the strengths and limitations of various methods for administering assessments to citizen scientists. Researchers who wish to study the knowledge and abilities of citizen scientists in the future should be sure to design their research methods to avoid the pitfalls identified by our initial findings. (Contains 3 tables, 9 figures, and 1 note.)

We introduce the Newtonian Gravity Concept Inventory (NGCI), a 26-item multiple-choice instrument to assess introductory general education college astronomy ("Astro 101") student understanding of Newtonian gravity. This paper describes the development of the NGCI through four phases: Planning, Construction, Quantitative Analysis, and Validation. We discuss the evolution of the instrument through three versions, including the refinement of a set of four concept domains and nine examples of items to illustrate how expert review, student interviews, and Classical Test Theory statistics informed our approach. We conclude that the NGCI is a reliable and valid instrument. (Contains 10 tables, 9 figures, and 1 note.)

This paper is the first in a series of investigations into the data from the recent national study using the Light and Spectroscopy Concept Inventory (LSCI). In this paper, we use classical test theory to form a framework of results that will be used to evaluate individual item difficulties, item discriminations, and the overall reliability of the LSCI. We perform an analysis of individual students' normalized gains, providing further insight into the prior results from this data set. This investigation allows us to better understand the efficacy of measuring student achievement using the LSCI. Future papers will discuss our investigation of the data from the recent national study using item response theory (IRT). (Contains 8 figures and 1 table.)

This is the third of five papers detailing our national study of general education astronomy students' conceptual and reasoning difficulties with cosmology. In this paper, we use item response theory to analyze students' responses to three out of the four conceptual cosmology surveys we developed. The specific item response theory model we use is known as the partial credit model. Since readers may be unfamiliar with the partial credit model, we provide a pedagogical introduction to this model. We use the partial credit model to assess the reliabilities of the four survey forms and to determine the probabilities of students achieving different scores on survey items. (Contains 3 tables and 12 figures.) [For Part II, see EJ956292.]

This is our fourth paper in our five paper series describing our national study of general education astronomy students' conceptual and reasoning difficulties with cosmology. While previous papers in this series focused on the processes by which we collected and quantitatively analyzed our data, this paper presents the most common pre-instruction conceptual and reasoning difficulties identified from our qualitative analysis of students' written responses. We discuss students' naive ideas about the expansion and evolution of the universe, the Big Bang, interpreting Hubble plots, and the evidence for dark matter in spiral galaxies. (Contains 10 figures.) [For Part III, see EJ971055.]

Concept inventories (CIs)--typically multiple-choice instruments that focus on a single or small subset of closely related topics--have been used in science education for more than a decade. This paper describes the development and validation of a new CI for astronomy, the "Star Properties Concept Inventory" (SPCI). Questions cover the areas of stellar properties (focussing primarily on mass, temperature, luminosity, and lifetime), nuclear fusion, and star formation. Distracters were developed from known alternative conceptions and reasoning difficulties commonly held by students. The SPCI was tested through an iterative process where different testing formats (open-ended, multiple-choice + explain, and multiple-choice) were compared to ensure that the distracters were in fact the most common among the testing population. Content validity was established through expert reviews by 26 astronomy instructors. The SPCI Version 3 was then tested in multiple introductory undergraduate astronomy courses for non-science majors. Post-test scores (out of 23 possible) were significantly greater (M = 11.8, SD = 3.87) than the pre-test scores (M = 7.09, SD = 2.73). The low post-test score--only 51.3%--could indicate a need for changing instructional strategies on the topics of stars and star formation. (Contains 7 tables and 2 figures.)

This is the final paper in a five-paper series describing our national study of the teaching and learning of cosmology in general education astronomy college-level courses. A significant portion of this work was dedicated to the development of five new "Lecture-Tutorials" that focus on addressing the conceptual and reasoning difficulties that our research shows students have with frequently taught cosmology topics, such as the expansion of the universe, the Big Bang, and dark matter. We conducted a systematic investigation of the implementation of these new "Lecture-Tutorials" and resulting learning gains in order to test the efficacy of these new "Lecture-Tutorials." Our investigation included classroom observations, results from pre-post testing using four conceptual cosmology surveys, and comparisons between classes in terms of the class time spent on cosmology topics and other instructional strategies used to teach cosmology. We used this combination of qualitative and quantitative research results to evaluate the conceptual understandings of students who used the new cosmology "Lecture-Tutorials" compared to those students who did not. The analysis of our data shows that, in many cases, classrooms that used the cosmology "Lecture-Tutorials" saw a greater increase in their students' conceptual cosmology knowledge compared to classrooms that did not use the cosmology "Lecture-Tutorials." However, our results also indicate how instructors implement the "Lecture-Tutorials" into their classrooms strongly influences their students' learning gains. (Contains 2 tables and 4 figures.) [For Part IV, see EJ971054.]

This is the second of five papers detailing our national study of general education astronomy students' conceptual and reasoning difficulties with cosmology. This article begins our quantitative investigation of the data. We describe how we scored students' responses to four conceptual cosmology surveys, and we present evidence for the inter-rater reliability of those scores. We devote the bulk of this article to a classical test theory analysis of the data. We calculate difficulties and discriminations for each item, and we compute Cronbach's [alpha] as a measure of the reliability of the surveys. We also discuss the implications this analysis has for the validity of the surveys. (Contains 5 tables.) [For Part I, see EJ956291.]

This is the first in a series of five articles describing a national study of general education astronomy students' conceptual and reasoning difficulties with cosmology. In this paper, we describe the process by which we designed four new surveys to assess general education astronomy students' conceptual cosmology knowledge. These surveys focused on the expansion and evolution of the universe, the Big Bang, and the evidence for dark matter in spiral galaxies. We also present qualitative evidence for the validity of these surveys. (Contains 6 tables and 2 figures.)

This is the second in a series of reports on a national study of the teaching and learning of astronomy in general education, nonscience major, introductory college astronomy courses (hereafter referred to as Astro 101). The analysis reported here was conducted using data from nearly 2000 students enrolled in 69 Astro 101 classes taught across the country. These students completed a 15-question demographic survey, in addition to completing the 26-question Light and Spectroscopy Concept Inventory (LSCI) pre- and post-instruction. The LSCI was used to determine students' learning via a normalized gain calculated for each student. A multivariate regression analysis was conducted to determine how ascribed characteristics (personal demographic and family characteristics), achieved characteristics (academic achievement and student major), and the use of interactive learning strategies are related to student learning in these classes. The results show dramatic improvement in student learning with increased use of interactive learning strategies even after controlling for individual characteristics. In addition, we find that the positive effects of interactive learning strategies apply equally to men and women, across ethnicities, for students with all levels of prior mathematical preparation and physical science course experience, independent of GPA, and regardless of primary language. These results powerfully illustrate that all categories of students can benefit from the effective implementation of interactive learning strategies. (Contains 4 tables, 2 figures, and 8 footnotes.)

Members of the Center for Astronomy Education (CAE) and the Conceptual Astronomy and Physics Education Research (CAPER) Team at the University of Arizona have conducted a systematic investigation into the use of wireless, electronic personal response systems (PRS), more commonly known as "clickers," to gather research data in the large enrollment introductory astronomy course for nonscience majors (Astro 101). We describe a study and data, which support the assertion that clickers can be used as a data gathering tool for conducting "real-time" research on student learning in the classroom setting. We also present data suggesting that students believe the use of clickers (1) is beneficial to their understanding of course concepts; (2) contributes to improving their exam grades; and (3) increases their interest in course topics "even" when the clickers are being used solely as research data gathering tools rather than the more traditional application in which clickers are used as an instructional device to gather student votes as part of Think-Pair-Share (TPS) or Peer Instruction (PI). Additionally, we offer a description of our classroom observations, which suggests that the use of color-coded A, B, C, D, E voting cards for gathering student answers in class may hold greater pedagogical value and provide a greater potential to gather accurate research results than do the use of clickers or Scantron[TM] forms. (Contains 3 tables and 1 figure.)

This study (Note 1) investigated the beliefs about stars that students hold when they enter an undergraduate introductory astronomy course for nonscience majors. Students' preinstructional ideas were investigated through the use of several student-supplied-response (SSR) surveys, which asked students to describe their ideas about topics such as what is a star, how is starlight created, how are stars formed, are all stars the same, and more. The results from more than 2,200 responses suggest that although students often have some initial knowledge about stars, their knowledge is often incomplete or incorrect in important ways that could negatively impact instructional objectives. (Contains 2 notes and 14 tables.)

Professional development for astronomy instructors largely focuses on enhancing their understanding of the limitations of professor-centered lectures while also increasing awareness and better implementation of learning strategies that promote a learner-centered classroom environment. Given how difficult it is to get instructors to implement well-developed and innovative teaching ideas, even when these instructors are supplied with significant and compelling education research data, one must wonder what is missing from the most commonly used professional development experiences. This article proposes a learner-centered approach to professional development for college instructors, which we call "situated apprenticeship." This novel approach purposely goes beyond simple awareness building and conventional modeling, challenging instructors to actively engage themselves in practicing teaching strategies in an environment of peer review in which participants offer suggestions and critiques of each other's implementation. Through this learner-centered teaching and evaluation experience, instructors' preexisting conceptual and pedagogical understandings of a particular instructional strategy are brought forth and examined in an effort to promote a real change of practice that positively impacts both their core pedagogical content knowledge and their skills in successfully implementing these teaching strategies. We believe that the adoption of our situated apprenticeship approach for professional development will increase the frequency and success of college instructors' implementation of research-validated instructional strategies for interactive learning. (Contains 3 figures and 1 note.)

This article describes the development and validation of the Light and Spectroscopy Concept Inventory (LSCI), a 26-item diagnostic test designed (1) to measure students' conceptual understanding of topics related to light and spectroscopy, and (2) to evaluate the effectiveness of instructional interventions in promoting meaningful learning gains in an introductory college astronomy course. We also present the final field-tested version of the LSCI for general use by the astronomy education community.

This research concerns the development and assessment of a program of introductory astronomy conceptual exercises called ranking tasks. These exercises were designed based on results from science education research, learning theory, and classroom pilot studies. The investigation involved a single-group repeated measures experiment across eight key introductory astronomy topics with 253 students at the University of Arizona. Student understanding of these astronomy topics was assessed before and after traditional instruction in an introductory astronomy course. Collaborative ranking tasks were introduced after traditional instruction on each topic, and student understanding was evaluated again. Results showed that average scores on multiple-choice tests across the eight astronomy topics increased from 32% before instruction, to 61% after traditional instruction, to 77% after the ranking-task exercises. A Likert scale attitude survey found that 83% of the students participating in the 16-week study thought that the ranking-task exercises helped their understanding of core astronomy concepts. Based on these results, we assert that supplementing traditional lecture-based instruction with collaborative ranking-task exercises can significantly improve student understanding of core astronomy topics. (Contains 2 tables and 4 figures.)

Seventy undergraduate class sections were examined from the database of Astronomy Diagnostic Test (ADT) results of Deming and Hufnagel to determine if course format correlated with ADT normalized gain scores. Normalized gains were calculated for four different classroom scenarios: lecture, lecture with discussion, lecture with lab, and lecture with both lab and discussion. Statistical analysis shows that there are no significant differences in normalized gain among the self- reported classroom formats. Prerequisites related to mathematics courses did show differences in normalized gain. Of all reported course activities, only the lecture and the readings for the course correlate significantly with the normalized gain. This analysis suggests that the ADT may not have enough sensitivity to measure differences in the effectiveness of different course formats because of the wide range of topics that the ADT addresses with few questions. Different measures of gain and their biases are discussed. We argue that the use of the normalized gain is not always warranted because of its strong bias toward high pretest scores. (Contains 10 tables and 3 figures.)

In this era of dramatically increased astronomy education research efforts, there is a growing need for standardized evaluation protocols and a strategy to assess both student comprehension of fundamental concepts and the success of innovative instructional interventions. Of the many topics that could be taught in an introductory astronomy course, the nature of light and the electromagnetic spectrum is by far the most universally covered topic. Yet, to the surprise and disappointment of instructors, many students struggle to understand underlying fundamental concepts related to light, such as blackbody radiation, Wien's law, the Stefan-Boltzmann law, and the nature and causes of emission and absorption line spectra. Motivated by predecessor instruments such as the Force Concept Inventory (FCI), the Astronomy Diagnostic Test (ADT), and the Lunar Phases Concept Inventory (LPCI), we call for, and are working on, the development and validation of a Light and Spectroscopy Concept Inventory. This assessment instrument should measure students' conceptual understanding of light and spectroscopy and gauge the effectiveness of classroom instruction in promoting student learning in the introductory astronomy survey course.

The project described here involved the design, implementation, and evaluation of an upper level, undergraduate elective course for science majors. Specific course goals were to help students gain an appreciation of the interdisciplinary nature of astrobiology, understand key ideas in astrobiology, and develop the skills necessary to communicate successfully with scientists across disciplines. (Contains 5 figures.)

Identifies specific difficulties students had with ionizing radiation and radioactivity using interviews. Explores students' pre-instruction thoughts on these topics. (Author/MM)

We present the results of a national study on the teaching and learning of astronomy as taught in general education, non-science-major, introductory astronomy courses. Nearly 4000 students enrolled in 69 sections of courses taught by 36 different instructors at 31 institutions completed (pre-and post-instruction) the Light and Spectroscopy Concept Inventory (LSCI) from Fall 2006 to Fall 2007. The classes varied in size and were from all types of institutions, including 2- and 4-year colleges and universities. Normalized gain scores for each class were calculated. Pre-instruction LSCI scores were clustered around ~25%, independent of class size and institution type, and normalized gain scores varied from about -0.07 to 0.50. To estimate the fraction of classroom time spent on learner-centered, active-engagement instruction we developed and administered an Interactivity Assessment Instrument (IAI). Our results suggest that the differences in gains were due to instruction in the classroom, not the type of class or institution. We also found that higher interactivity classes had the highest gains, confirming that interactive learning strategies are capable of increasing student conceptual understanding. However, the wide range of gain scores seen for both lower and higher interactivity classes suggests that the use of interactive learning strategies is not sufficient by itself to achieve high student gain. [DOI: 10.1119/1.3065023]

This article describes methods for teaching students about extra-solar planets in physics classes. Topics addressed include planetary orbits and the Doppler shift of light.