Search

A study was conducted to implement the use of a standardized effect size and corresponding classification guidelines for polytomous data with the POLYSIBTEST procedure and compare those guidelines with prior recommendations. Two simulation studies were included. The first identifies new unstandardized test heuristics for classifying moderate and large differential item functioning (DIF) for polytomous response data with three to seven response options. These are provided for researchers studying polytomous data using POLYSIBTEST software that has been published previously. The second simulation study provides one pair of standardized effect size heuristics that can be employed with items having any number of response options and compares true-positive and false-positive rates for the standardized effect size proposed by Weese with one proposed by Zwick et al. and two unstandardized classification procedures (Gierl; Golia). All four procedures retained false-positive rates generally below the level of significance at both moderate and large DIF levels. However, Weese's standardized effect size was not affected by sample size and provided slightly higher true-positive rates than the Zwick et al. and Golia's recommendations, while flagging substantially fewer items that might be characterized as having negligible DIF when compared with Gierl's suggested criterion. The proposed effect size allows for easier use and interpretation by practitioners as it can be applied to items with any number of response options and is interpreted as a difference in standard deviation units.

Person-fit analyses are commonly used to detect aberrant responding in self-report data. Nonparametric person fit statistics do not require fitting a parametric test theory model and have performed well compared to other person-fit statistics. However, detection of aberrant responding has primarily focused on dominance response data, thus the effectiveness of person-fit statistics in detecting different aberrant behaviors in ideal point data is unclear. This study compares the performance of nonparametric person-fit statistics in unfolding and dominance model contexts. Results for dominance data indicate that increases in detection rates depend, among other factors, on type of aberrant responding and person-fit statistic used. The detection of aberrant responses in ideal point data was ineffective using four nonparametric person-fit statistics, with slightly higher type I error and power less than 0.25. Additional research is needed to identify or develop nonparametric or parametric person-fit statistics effective for aberrant behavior exhibited in ideal point data.

A simulation study was conducted to investigate the heuristics of the SIBTEST procedure and how it compares with ETS classification guidelines used with the Mantel-Haenszel procedure. Prior heuristics have been used for nearly 25 years, but they are based on a simulation study that was restricted due to computer limitations and that modeled item parameters from estimates of ACT and ASVAB tests from 1987 and 1984, respectively. Further, suggested heuristics for data fitting a two-parameter logistic model (2PL) have essentially went unused since their original presentation. This simulation study incorporates a wide range of data conditions to recommend heuristics for both 2PL and three-parameter logistic (3PL) data that correspond with ETS's Mantel-Haenszel heuristics. Levels of agreement between the new SIBTEST heuristics and Mantel-Haenszel heuristics were similar for 2PL data and higher than prior SIBTEST heuristics for 3PL data. The new recommendations provide higher true-positive rates for 2PL data. Conversely, they displayed decreased true-positive rates for 3PL data. False-positive rates, overall, remained below the level of significance for the new heuristics. Unequal group sizes resulted in slightly larger false-positive rates than balanced designs for both prior and new SIBTEST heuristics, with rates less than alpha levels for equal ability distributions and unbalanced designs versus false-positive rates slightly higher than alpha with unequal ability distributions and unbalanced designs.

To design and deliver meaningful professional development programs for faculty who teach online, the unit responsible for these activities should have a clear idea of what content participants might find most beneficial to their practice, as well as what can improve instructor and student satisfaction. Using an online survey, this study explored the perceptions of 314 faculty members at a mid-southern university as they relate to the online environment and institutional factors, personal factors, and student engagement and active learning. Faculty reported high levels of satisfaction with the accessibility of their courses and the technical support they receive, but reported lower levels of satisfaction with the effectiveness of online communication tools. The results also revealed a significant difference in how faculty rated their satisfaction with student engagement and active learning based on their level of experience, indicating that alternative approaches to faculty development might be necessary for those new to online teaching and learning.

This study provides psychometric data for the Scholastic Inquiry Observation instrument and 6 years of research data from an inquiry-based professional training program. The rating instrument provides a resource for measuring 16 inquiry-related learning activities based on level of inquiry implementation and level of active student engagement. Observational data at the item level can be useful for inquiry-based professional development programs. Four scale score options are available for inquiry summarization (Inquiry Implementation for Hypothesis Usage; Implementation of Inquiry Communication; Student Engagement in Hypothesis Usage; Student Engagement in Inquiry Communication) and two scales measuring Student Interest and Mastery of Objectives. Comparisons of the types of inquiry most commonly used and those with the highest levels of active participation by middle school students in science and math classrooms are provided.

The generalized partial credit model (GPCM) is often used for polytomous data; however, the nominal response model (NRM) allows for the investigation of how adjacent categories may discriminate differently when items are positively or negatively worded. Ten items from three different self-reported scales were used (anxiety, depression, and perceived stress), and authors wrote an additional item worded in the opposite direction to pair with each original item. Sets of the original and reverse-worded items were administered, and responses were analyzed using the two models. The NRM fit significantly better than the GPCM, and it was able to detect category responses that may not function well. Positively worded items tended to be more discriminating than negatively worded items. For the depression scale, category boundary locations tended to have a larger range for the positively worded items than for the negatively worded items from both models. Some pairs of items functioned comparably when reverse-worded, but others did not. If an examinee responds in an extreme category to an item, the same examinee is not necessarily likely to respond in an extreme category at the opposite end of the rating scale to a similar item worded in the opposite direction. Results of this study may support the use of scales composed of items worded in the same direction, and particularly in the positive direction.

Objective: Guided by the Reasoned Action Approach, we used a salient belief elicitation (SBE) to elicit participant‐generated beliefs regarding abortion. SBE is a formative research technique used to elicit people's control (i.e., perceived facilitators and barriers associated with a behavior), behavioral (i.e., perceived positive and negative consequences of doing a behavior), and normative (i.e., influence of important people/peers regarding a behavior) beliefs regarding a particular behavior (i.e., abortion). Methods: We administered our SBE to English‐ and Spanish‐speaking U.S. adults (N = 608) from NORC's AmeriSpeak® panel. We used inductive content and thematic analyses to assess open‐ended questions. Results: We found that participants' control and behavioral beliefs referenced circumstances used to assess abortion attitudes in polling item (e.g., rape) and reasons people seek abortion (e.g., financial reasons) as well as potential negative emotions (e.g., shame) and positive consequences (e.g., autonomy) associated with abortion. Participants indicated pregnant people's partners and people seeking abortion as salient referents. Conclusion: Participants mentioned several contexts reflected in common measures used to assess abortion attitudes by national polls and surveys. However, we also found other relevant circumstances not reflected in common measures and a range of salient referents. We recommend abortion attitudes measures account for these participant‐driven salient beliefs. [ABSTRACT FROM AUTHOR]

This study examines how Latinx migrant generation and the circumstances of abortion may be linked to attitudes toward abortion legality among a sample of U.S.‐Latinx adults. Using Confirmatory Factor Analysis and Multiple‐Indicators Multiple‐Causes modeling, we found that abortion attitudes across different migrant generations are sensitive to circumstances motivating the abortion. We did not find significant differences across migrant generations for generally more endorsed circumstances, such as when the woman's health is at risk or when the pregnancy occurs as a result of rape. However, second and third generations were more inclined to endorse legal abortion than first‐generation for generally less endorsed circumstances, such as low income, being unpartnered, not wanting (more) children, or contraception failure. The social context in which one is raised (i.e., the United States for migrants' descendants or the country of birth for the first‐generation migrants) plays a role in shaping abortion attitudes regarding the less endorsed social‐related circumstances but not for more endorsed circumstances. Further research should consider the inner heterogeneity of the Latinx population as well as the multiple contexts of abortion. [ABSTRACT FROM AUTHOR]

In this study a standardized effect size was created for use with the SIBTEST procedure. Using this standardized effect size, a single set of heuristics was developed that are appropriate for data fitting different item response models (e.g., 2-parameter logistic, 3-parameter logistic). The standardized effect size rescales the raw beta-uni value using a pooled variation that incorporates the beta-uni inclusion factor. Although the heuristics for the standardized and unstandardized effect sizes provide similar true-positive and false-positive rates in most conditions, the standardized effect size provides higher true-positive rates for conditions where item response variability is smaller in proportion to raw score differences. Inflated false-positive rates were solely impacted by smaller sample sizes, whereas larger sample sizes improved true-positive rates. An empirical application is provided to demonstrate how the standardized effect size provides for a more consistent comparison across items with varying response distributions. This study lays the foundation for the utilization of a standardized effect size for both dichotomous and polytomous item response models using the suite of SIBTEST procedures. [ABSTRACT FROM AUTHOR]

In this paper, we explore the use of a generative metaphor for analyzing qualitative interviews on abortion attitudes. U.S. abortion attitudes are notably complex and multidimensional, thus, requiring subtle, complex, and multidimensional tools of study. We used the generative metaphor of a "doorway" as an analytic tool to enable new understandings of abortion attitudes as expressed across 24 one-on-one semi-structured qualitative interviews with U.S. adults. The doorway metaphor gave us an understanding of the ways in which participants thought of their abortion attitudes as open to revision or change to some degree while also being closed to revision in other ways. This spectrum of openness and closedness does not come into view when examining abortion attitudes through the dichotomous framings. In this methodological paper, we thoroughly describe how we used the metaphor to explicate the complexities and multidimensionalities of a person's abortion attitudes. [ABSTRACT FROM AUTHOR]

A study was conducted to implement the use of a standardized effect size and corresponding classification guidelines for polytomous data with the POLYSIBTEST procedure and compare those guidelines with prior recommendations. Two simulation studies were included. The first identifies new unstandardized test heuristics for classifying moderate and large differential item functioning (DIF) for polytomous response data with three to seven response options. These are provided for researchers studying polytomous data using POLYSIBTEST software that has been published previously. The second simulation study provides one pair of standardized effect size heuristics that can be employed with items having any number of response options and compares true-positive and false-positive rates for the standardized effect size proposed by Weese with one proposed by Zwick et al. and two unstandardized classification procedures (Gierl; Golia). All four procedures retained false-positive rates generally below the level of significance at both moderate and large DIF levels. However, Weese's standardized effect size was not affected by sample size and provided slightly higher true-positive rates than the Zwick et al. and Golia's recommendations, while flagging substantially fewer items that might be characterized as having negligible DIF when compared with Gierl's suggested criterion. The proposed effect size allows for easier use and interpretation by practitioners as it can be applied to items with any number of response options and is interpreted as a difference in standard deviation units. [ABSTRACT FROM AUTHOR]

Assessment is critical to rehabilitation practice and research, and self-reports are a commonly used form of assessment. This study examines a gender effect according to item wording on the "Perceived Stress Scale" for adults with multiple sclerosis. Past studies have demonstrated two-factor solutions on this scale and other scales measuring stress-related constructs with factor loadings being determined by item wording. Moreover, women have typically scored higher on these measured constructs. However, a literature review reveals that this gender difference often manifests only on the factor composed of negatively worded items. This study extends this line of research by examining gender differences on the "Perceived Stress Scale" on the negatively worded items at both the item and bundle levels after controlling for responses on the positively worded items. Implications of this study on the field of rehabilitation are discussed. (Contains 3 tables.)

Although research has indicated a link between gender and perceived illness severity and the employment status of people with multiple sclerosis (MS), it has not addressed questions regarding the relationship between those variables and specific types of employment concerns. In this study, a sample of 1,310 adults with MS replied to a mail survey eliciting their concerns regarding employment services and policies. Regardless of perceived severity and gender, adults with MS were dissatisfied with many important employment services and policies. Findings also indicated gender and severity interactions, which are discussed in terms of implications for rehabilitation interventions.

Although state agencies are required by law to assess their consumers' satisfaction with vocational rehabilitation (VR), each state uses its own instrument to measure satisfaction. This not only makes comparisons across states impossible but also means that the quality of these instruments varies widely from state to state. As with other satisfaction research in general, there have been, and continue to be, many problems with the measurement of consumer satisfaction in VR. The purpose of this study was to create a valid, reliable, multidimensional consumer satisfaction instrument specifically for clients of VR agencies, without the documented problems associated with much of the existing satisfaction research. (Contains 2 tables.)

Examines the relationships between organic chemistry achievement and a number of cognitive and noncognitive variables, and explores whether gender differences existed for any of these relationships. Concludes that general chemistry grade, ACT-math score, and motivation are significant predictors of organic chemistry achievement. Indicates gender differences in the prediction of achievement. (Author/KHR)

Item-objective congruence as developed by R. Rovinelli and R. Hambleton is used in test development for evaluating content validity at the item development stage. Provides a mathematical extension to the Rovinelli and Hambleton index that is applicable for the multidimensional case. (SLD)

Public reaction to Brett Kavanaugh's nomination to the Supreme Court of the United States initially centered around abortion. However, approximately two months after the nomination, sexual assault accusations against Kavanaugh were made public. We examined the extent that people's perceptions of Kavanaugh's stance on abortion and people's attitudes toward whether Kavanaugh committed sexual assault were associated with perceptions of Kavanaugh as a good Supreme Court justice. Data were collected from English- and Spanish-speaking participants (N = 2,883) in the United States via Qualtrics' panel. Using an exploratory hierarchical regression approach, we found that people's perceptions of whether Kavanaugh committed sexual assault was a stronger predictor of their attitudes toward Kavanaugh's quality as a Supreme Court justice [F(1,2855) = 1736.54, p <.001] than people's perceptions of him regarding abortion, after controlling for demographic characteristics and participants' abortion identity (e.g., identifying as pro-life, pro-choice). That sexual assault was a stronger predictor could suggest the importance of sexual assault regarding opinions of Supreme Court justices or potential over inflation of abortion as a salient issue. Researchers should investigate the saliency of sexual and reproductive health issues in relation to Supreme Court nominees. [ABSTRACT FROM AUTHOR]

As online learning is becoming more deeply entrenched in higher education, many institutions are designing professional development activities aimed at helping faculty improve their online teaching. The focus of this descriptive study was on identifying the preferences faculty who teach online have regarding how they want to learn about new technology, how to complete tasks in the online environment, and strategies they can use to enhance instruction. Additionally, the study sought to gauge faculty members' interest in working with other faculty to investigate online teaching issues. Results from a survey instrument administered to faculty who teach online at an institution in the mid-south indicate that faculty members prefer one-on-one meetings with instructional design experts, online resources, and informal interaction with colleagues. The authors recommend including faculty members' input in the design of professional development initiatives.

A simulation study was conducted to investigate the heuristics of the SIBTEST procedure and how it compares with ETS classification guidelines used with the Mantel–Haenszel procedure. Prior heuristics have been used for nearly 25 years, but they are based on a simulation study that was restricted due to computer limitations and that modeled item parameters from estimates of ACT and ASVAB tests from 1987 and 1984, respectively. Further, suggested heuristics for data fitting a two-parameter logistic model (2PL) have essentially went unused since their original presentation. This simulation study incorporates a wide range of data conditions to recommend heuristics for both 2PL and three-parameter logistic (3PL) data that correspond with ETS's Mantel–Haenszel heuristics. Levels of agreement between the new SIBTEST heuristics and Mantel–Haenszel heuristics were similar for 2PL data and higher than prior SIBTEST heuristics for 3PL data. The new recommendations provide higher true-positive rates for 2PL data. Conversely, they displayed decreased true-positive rates for 3PL data. False-positive rates, overall, remained below the level of significance for the new heuristics. Unequal group sizes resulted in slightly larger false-positive rates than balanced designs for both prior and new SIBTEST heuristics, with rates less than alpha levels for equal ability distributions and unbalanced designs versus false-positive rates slightly higher than alpha with unequal ability distributions and unbalanced designs. [ABSTRACT FROM AUTHOR]