Search

Learning objectives (LOs) are used to communicate the purpose of instruction. Done well, they convey the expectations that the instructor--and by extension, the academic field--has in terms of what students should know and be able to do after completing a course of study. As a result, they help students better understand course activities and increase student performance on assessments. LOs also serve as the foundation of course design, as they help structure classroom practices and define the focus of assessments. Understanding the research can improve and refine instructor and student use of LOs. This essay describes an online, evidence-based teaching guide published by "CBE--Life Sciences Education" ("LSE") at http://lse.ascb.org/learning-objectives. The guide contains condensed summaries of key research findings organized by recommendations for writing and using LOs, summaries of and links to research articles and other resources, and actionable advice in the form of a checklist for instructors. In addition to describing key features of the guide, we also identify areas that warrant further empirical studies.

Studying the oral language growth of Spanish-speaking preschoolers in the United States is increasingly important given the critical role early language development plays in reading outcomes. In this article, we report on the Spanish and English growth trajectories observed in 124 bilingual preschoolers collected over 2 years in 36 classrooms across 5 states and the associations of growth in each language to language of instruction and home language exposure. Patterns indicate the need for Spanish instruction to maintain robust rates of Spanish growth and English growth rates in Spanish, bilingual, and English-only instruction. Significant differences in English and Spanish oral language abilities were also noted at the intercept between children who were Spanish dominant versus balanced bilinguals. Implications for research and practice are provided.

Spanish speakers in the United States are a steadily increasing population, up by 233% since 1980. Given the growing population of dual language learners (DLLs) and the large numbers of Spanish-speaking children enrolled in pre-kindergarten programs, addressing the educational needs of preschool-aged DLLs has become a national imperative. Specifically, the intersection of this growing population and the dearth of appropriate assessment tools to evaluate DLLs early language and literacy skills creates a need for assessments that accurately measure preschool performance. This manuscript reports on the iterative design process of a measure of Spanish phonological awareness for preschool-aged DLLs: Spanish Individual Growth and Development Indicators (S-IGDI) Primeros Sonidos. We employed measure design framework to develop the measure and tested item function within a study of 970, 4-5 year old DLLs. Results, including item level analyses and evidence regarding construct and criterion validity are reported. [This article was published in "Educational Assessment" (EJ1205857).]

Full-information item analysis provides item developers and reviewers comprehensive empirical evidence of item quality, including option response frequency, point-biserial index (PBI) for distractors, mean-scores of respondents selecting each option, and option trace lines. The multi-serial index (MSI) is introduced as a more informative item-total correlation, accounting for variable distractor performance. The overall item PBI is empirically compared to the MSI. For items from an operational mathematics and reading test, poorly performing distractors are systematically removed to recompute the MSI, indicating improvements in item quality. Case studies for specific items with different characteristics are described to illustrate a variety of outcomes, focused on improving item discrimination. Full-information item analyses are presented for each case study item, providing clear examples of interpretation and use of item analyses. A summary of recommendations for item analysts is provided.

Socioeconomic status (SES) is considered a major predictor of student and school achievement. In most cases, SES is not malleable or available for manipulation to improve students' learning and achievement. Therefore, we explored other student and school-related factors that may be malleable to reduce achievement differences between students and schools in Turkey. We used the TIMSS 2015 fourth-grade mathematics data and analyzed it using hierarchical linear modeling. We found that SES at both student and school levels is a dominant factor related to mathematics achievement and a much stronger predictor at the school level. Early literacy and numeracy activities, preschool education, intrinsic motivation, and engagement in instruction were found to be significantly and positively associated with higher achievement within schools. Similarly, among the school-level variables, we found significant and positive associations between schools' mathematics scores and instruction quality and school readiness, in the presence of SES. We recommend that preschool education and early literacy and numeracy activities at home should be promoted. Additionally, although the findings of this study indicate possible SES-based school segregation; parents, teachers, and school leaders, as well as students, should work toward a more positive school climate to reduce achievement disparities due to SES.

Researchers often use self-reported instruments to collect data from students when investigating the causes and effects of bullying. When completing the instrument, students may skip items despite anonymous data collection. To interpret data accurately, researchers must identify the causes of nonresponse. This study examined the impact of item (types of bullying and position) and student (sex and grade level) factors on nonresponse in bullying items. The sample included 10,681 students from grades 8, 9, and 11 who skipped at least one bullying item in the Minnesota Student Survey. Results showed that students were more likely to skip the items presented toward the end of the survey. The type of bullying had no impact on nonresponse. Male students and students at higher grade levels were more likely to skip the items. To alleviate the nonresponse issue, researchers are recommended to consider both survey length and student factors when administering bullying instruments.

Early comprehension is an important, but not well-understood, contribution to early literacy and language development. Specifically, research regarding the nature of skills representative of early comprehension, including how they contribute to later reading success, is needed to support best practices to adequately prepare students. This article describes the process involved in the creation and refinement of the newly developed comprehension Individual Growth and Development Indicators (IGDIs 2.0). Two theoretical models of early comprehension are discussed to highlight the inherent complexity of this domain. Results of three studies are presented: Study 1 outlines the initial piloting process, Study 2 represents a larger-scale investigation, and Study 3 describes further field testing and reveals the final IGDI 2.0 comprehension candidate: Which One Doesn't Belong (WODB). Results indicated WODB out-performed the other candidate measures across psychometric and pragmatic criteria. The utility of the WODB task within a Response to Intervention (RTI) framework is also discussed. [This article was published in "Assessment for Effective Intervention" (EJ1050548).]

Learning to read is one of the most important indicators of academic achievement. The development of early literacy skills during the preschool years is associated with improved reading outcomes in later grades. One of these skill areas,phonological awareness, shows particular importance because of its strong link to later reading success. Presented here are two studies that describe the development and revision of four measures of phonological awareness skills: Individual Growth and Development Indicators Sound Blending, Syllable Sameness, Rhyming, and Alliteration 2.0. The authors discuss the measure development process, revision, and utility within an early childhood Response to Intervention framework. [This article was published in "Journal of Learning Disabilities," (EJ1070909).]

Language skills developed during preschool contribute strongly to later reading and academic achievement. Effective preschool assessment and intervention should focus on core components of language development, specifically oral language skills. The Early Language and Literacy Individual Growth and Development Indicators (IGDIs) are a set of measures that have demonstrated utility in language and early literacy assessment, evaluation, and intervention studies. The purpose of this article is to describe two studies conducted to build on the existing oral language IGDI, Picture Naming, to increase utility for instructional decision making, particularly within an early childhood Response to Intervention framework. Study 1 outlines the initial development and piloting of potential measures and Study 2 describes the revision and continued analysis of the most promising measures. Results of Study 1 and Study 2 indicate that Picture Naming has continued utility as a measure of oral language skill development and that one newly developed oral language IGDI, Definitional Vocabulary, has potential utility. [This paper was published in "Assessment for Effective Intervention" (EJ1033214).]

Spanish speakers in the United States are a steadily increasing population, up by 233% since 1980. Given the growing population of dual language learners (DLLs) and the large numbers of Spanish-speaking children enrolled in pre-kindergarten programs, addressing the educational needs of preschool-aged DLLs has become a national imperative. Specifically, the intersection of this growing population and the dearth of appropriate assessment tools to evaluate DLLs early language and literacy skills creates a need for assessments that accurately measure preschool performance. This manuscript reports on the iterative design process of a measure of Spanish phonological awareness for preschool-aged DLLs: Spanish Individual Growth and Development Indicators ("S-IGDI") Primeros Sonidos. We employed measure design framework to develop the measure and tested item function within a study of 970, 4-5 year old DLLs. Results, including item level analyses and evidence regarding construct and criterion validity are reported.

The evidence is mounting regarding the guidance to employ more three-option multiple-choice items. From theoretical analyses, empirical results, and practical considerations, such items are of equal or higher quality than four- or five-option items, and more items can be administered to improve content coverage. This study looks at 58 tests, including state achievement, college readiness, and credentialing tests. The evidence here supports previous assertions. The article also clarifies distractor functioning criteria and offers a typology of items via distractor functioning.

Grounded in social construction theory, the current study investigates the learning context when studying financial planning in high school by analyzing the nesting of student, teacher and classroom characteristics. Key findings were that three student characteristics (initial financial knowledge, gender, senior grade level), one teacher variable (use of all curriculum assessments), and two classroom variables (proportion of junior students and students who spent more money per week) were significant predictors of students' financial knowledge gain. Significant predictors of students' behavior gain were one student characteristic (senior grade level), two student access to money variables (employment status, spending per week), and three classroom variables (mean initial financial behavior, proportion of students working part-time, proportion of rural students). Findings indicated that subject matter content alone was not sufficient to create behavior change; learning context must be considered.

This study examined the effect of schema-based instruction (SBI) on the proportional problem-solving performance of students with mathematics difficulties only (MD) and students with mathematics and reading difficulties (MDRD). Specifically, we examined the responsiveness of 260 seventh grade students identified as MD or MDRD to a 6-week treatment (SBI) on measures of proportional problem solving. Results indicated that students in the SBI condition significantly outperformed students in the control condition on a measure of proportional problem solving administered at posttest (g = 0.40) and again 6 weeks later (g = 0.42). The interaction between treatment group and students' difficulty status was not significant, which indicates that SBI was equally effective for both students with MD and those with MDRD. Further analyses revealed that SBI was particularly effective at improving students' performance on items related to percents. Finally, students with MD significantly outperformed students with MDRD on all measures of proportional problem solving. These findings suggest that interventions designed to include effective instructional features (e.g., SBI) promote student understanding of mathematical ideas.

Noncognitive characteristics are gaining importance in addressing the persistent challenges facing youth in diverse settings. Measurement invariance of two youth developmental assets, Support and Positive Identity, is evaluated across grade levels and English language learner (ELL) subgroups of Latino students in 6th through 12th grade. Explanatory item response modeling is used to evaluate measurement invariance. The measurement of Latino students' sense of support and positive identity varies depending on their developmental stage and language status. Students at later grade levels tend to require higher levels of Support to endorse items in the Support measure. There is a nonlinear relation between students' grade level and item functioning for Positive Identity; students' transition from middle to high school may influence the way they respond to Positive Identity items. This has implications for the measurement of assets with diverse Latino youth and for Latino youth development.

Early comprehension is an important, but not well-understood, contribution to early literacy and language development. Specifically, research regarding the nature of skills representative of early comprehension, including how they contribute to later reading success, is needed to support best practices to adequately prepare students. This article describes the process involved in the creation and refinement of the newly developed comprehension Individual Growth and Development Indicators (IGDIs 2.0). Two theoretical models of early comprehension are discussed to highlight the inherent complexity of this domain. Results of three studies are presented: Study 1 outlines the initial piloting process, Study 2 represents a larger-scale investigation, and Study 3 describes further field testing and reveals the final IGDI 2.0 comprehension candidate: Which One Doesn't Belong (WODB). Results indicated WODB out-performed the other candidate measures across psychometric and pragmatic criteria. The utility of the WODB task within a Response to Intervention (RTI) framework is also discussed.

Learning to read is one of the most important indicators of academic achievement. The development of early literacy skills during the preschool years is associated with improved reading outcomes in later grades. One of these skill areas, phonological awareness, shows particular importance because of its strong link to later reading success. Presented here are two studies that describe the development and revision of four measures of phonological awareness skills: Individual Growth and Development Indicators Sound Blending, Syllable Sameness, Rhyming, and Alliteration 2.0. The authors discuss the measure development process, revision, and utility within an early childhood Response to Intervention framework.

Language skills developed during preschool contribute strongly to later reading and academic achievement. Effective preschool assessment and intervention should focus on core components of language development, specifically oral language skills. The Early Language and Literacy Individual Growth and Development Indicators (IGDIs) are a set of measures that have demonstrated utility in language and early literacy assessment, evaluation, and intervention studies. The purpose of this article is to describe two studies conducted to build on the existing oral language IGDI, Picture Naming, to increase utility for instructional decision making, particularly within an early childhood Response to Intervention framework. Study 1 outlines the initial development and piloting of potential measures and Study 2 describes the revision and continued analysis of the most promising measures. Results of Study 1 and Study 2 indicate that Picture Naming has continued utility as a measure of oral language skill development and that one newly developed oral language IGDI, Definitional Vocabulary, has potential utility.

This study compared the effects of delivering a supplemental, small-group tutoring intervention on the mathematics outcomes of third-grade students at risk for mathematics difficulties (MD) who were randomly assigned to either a schema-based instruction (SBI) or control group. SBI emphasized the underlying mathematical structure of additive problems. All students at risk for MD identified through screening received a mathematics intervention in groups of 2-4 for 12 weeks across the school year. Results revealed that students in the SBI group outperformed students in the control group on a word problem solving (WPS) posttest ("g" = 0.46). The effect of SBI proved to be equivalent for students in both high and low at-risk subgroups. On a district-administered mathematics achievement test, SBI students scored significantly higher than control students (g = 0.34); however, there were no significant effects on the WPS retention test (8 weeks later). (Contains 3 tables and 1 figure.)

Although a substantial amount of research has been conducted on differential item functioning in testing, studies have focused on detecting differential item functioning rather than on explaining how or why it may occur. Some recent work has explored sources of differential functioning using explanatory and multilevel item response models. This study uses hierarchical generalized linear modeling to examine differential performance due to gender and opportunity to learn, two variables that have been examined in the literature primarily in isolation, or in terms of mean performance as opposed to item performance. The relationships between item difficulty, gender, and opportunity to learn are explored using data for three countries from an international survey of preservice mathematics teachers.

This study examined the effect of schema-based instruction (SBI) on 7th-grade students' mathematical problem-solving performance. SBI is an instructional intervention that emphasizes the role of mathematical structure in word problems and also provides students with a heuristic to self-monitor and aid problem solving. Using a pretest-intervention-posttest-retention test design, the study compared the learning outcomes for 1,163 students in 42 classrooms who were randomly assigned to treatment (SBI) or control condition. After 6 weeks of instruction, results of multilevel modeling indicated significant differences favoring the SBI condition in proportion problem solving involving ratios/rates and percents on an immediate posttest (g = 1.24) and on a 6-week retention test (g = 1.27). No significant difference between conditions was found for a test of transfer. These results demonstrate that SBI was more effective than students' regular mathematics instruction. (Contains 7 tables.)

The Teacher Education and Development Study in Mathematics (TEDS-M) of 2008 focused on how teachers are prepared to teach mathematics in primary and lower-secondary schools in 17 countries. The main results were published in 2012, and the associated public-use database provides a valuable source for secondary analysis of the collected data. The data originate from complex samples and present a hierarchical structure. With future teachers embedded in programs embedded in institutions, various types of cluster effects can be observed. Complex methods, including the use of sampling weights and replication methods for variance estimation, are therefore required for data analysis. This paper focuses on the aspects that need to be considered during any exploration of relationships between variables. Correlation analysis may produce misleading results if attention is not paid to the structure under which the data were collected. We illustrate our points with exemplary analysis of TEDS-M data and propose some guidelines to address the issue.