Search

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies have compared the efficacy of different threshold-setting methods, they typically do so using simulated or small-scale data. When large-scale data are used in such studies, they often are not from a computer-adaptive test (CAT), use only a handful of items, or do not comprehensively examine different threshold-setting methods. In this study, we use reading test scores from over 728,923 3rd–8th-grade students in 2056 schools across the United States taking a CAT consisting of nearly 12,000 items to compare threshold-setting methods. In so doing, we help provide guidance to developers and administrators of large-scale assessments on the tradeoffs involved in using a given method to identify noneffortful responses.

BackgroundLimitations in physical functioning are a big concern especially for patients with chronic or musculoskeletal diseases. Therefore, physical functioning is often used as a core outcome of treatments. The generic patient-reported outcomes information system (PROMIS) physical function (PF) item bank has shown potential to measure PF with better precision, interpretability and lower respondent burden compared with traditional patient-reported outcome measures. This study provides an overview of the current evidence on the quality of the measurement properties of the translated Dutch–Flemish PROMIS-PF item bank and its subdomains, and their derived short forms and computer adaptive tests (CATs).MethodsPubMed was searched up to June 17th 2020 for validation studies of Dutch–Flemish PROMIS-PF in Dutch and Flemish adults. Quality assessment of the included studies was conducted using the COSMIN Risk of bias checklist. The COSMIN criteria for good measurement properties were used to judge the results of the studies, which were adjusted and added to where needed for this review, in the context of IRT instruments and item banks. The quality of evidence was summarized for each measurement property based on the Grading of Recommendation Assessment, Development, and Evaluation (GRADE) approach.ResultsEleven studies were included, evaluating the PROMIS-PF item bank, the Upper Extremity (UE) subdomain, and/or their derived short forms and CATs in different clinical populations. There is evidence for sufficient structural validity, measurement precision, construct validity, and cross-cultural validity of the Dutch–Flemish PROMIS-PF item bank. The upper extremity subdomain item bank shows high quality evidence for structural validity and measurement precision. Content validity of these item banks has not been thoroughly demonstrated in a Dutch–Flemish population. Furthermore, the derived instruments have far less robust evidence: there are fewer validation studies available and none examined their performance as stand-alone administered instruments.ConclusionsThe first studies into the Dutch–Flemish PROMIS-PF item bank and the UE subdomain show promising results, with especially high quality evidence for sufficient structural validity and measurement precision. However, more studies, and with higher methodological quality, are needed to study the instruments derived from these item banks. These studies should also evaluate content validity, reliability and responsiveness.

Computer adaptive testing (CAT) enables an individualization of tests and better accuracy of knowledge level determination. In CAT, all test participants receive a uniquely tailored set of questions. The number and the difficulty of the next question depend on whether the respondent&rsquo, s previous answer was correct or incorrect. In order for CAT to work properly, it needs questions with suitably defined levels of difficulty. In this work, the authors compare the results of questions&rsquo, difficulty determination given by experts (teachers) and students. Bachelor students of informatics in their first, second, and third year of studies at Subotica Tech&mdash, College of Applied Sciences had to answer 44 programming questions in a test and estimate the difficulty for each of those questions. Analyzing the correct answers shows that the basic programming knowledge, taught in the first year of study, evolves very slowly among senior students. The comparison of estimations on questions difficulty highlights that the senior students have a better understanding of basic programming tasks, thus, their estimation of difficulty approximates to that given by the experts.

Background The use of multidomain developmental screening tools is a viable strategy for pediatric professionals to identify children at risk for developmental problems. However, a specialized multidimensional computer adaptive testing (MCAT) tool has not been developed to date. Objective We developed an app using MCAT, combined with Multidimensional Screening in Child Development (MuSiC) for toddlers, to help patients and their family members or clinicians identify developmental problems at an earlier stage. Methods We retrieved 75 item parameters from the MuSiC literature item bank for 1- to 3-year-old children, and simulated 1000 person measures from a normal standard distribution to compare the efficiency and precision of MCAT and nonadaptive testing (NAT) in five domains (ie, cognitive skills, language skills, gross motor skills, fine motor skills, and socioadaptive skills). The number of items saved and the cutoff points for the tool were determined and compared. We then developed an app for a Web-based assessment. Results MCAT yielded significantly more precise measurements and was significantly more efficient than NAT, with 46.67% (=(75-40)/75) saving in item length when measurement differences less than 5% were allowed. Person-measure correlation coefficients were highly consistent among the five domains. Significantly fewer items were answered on MCAT than on NAT without compromising the precision of MCAT. Conclusions Developing an app as a tool for parents that can be implemented with their own computers, tablets, or mobile phones for the online screening and prediction of developmental delays in toddlers is useful and not difficult.

Background: Challenges exist in routinely collecting patient-reported outcomes (PROs) from patients at a busy ambulatory clinic. A number of validated Patient-Reported Outcomes Measurement Information System (PROMIS) subdomains allow for efficient PRO administration. Purpose: To determine the time to completion (TTC) of 3 PROMIS computer adaptive test (CAT) scores. CAT questionnaires were administered at the ambulatory clinic with the following PROMIS subdomains: Pain Interference (PI), Depression, and Physical Function for lower extremity (PF) or for upper extremity (UE). The secondary purpose was to determine the influence of patient demographic factors on TTC. Study Design: Cross-sectional study; Level of evidence, 3. Methods: Patients were recruited from 3 fellowship-trained upper extremity and sports medicine orthopaedic surgery clinics. PROMIS CAT questionnaires were administered to consecutive patients during the study period (July 2017–September 2017). The start and completion times of each CAT were recorded. The primary outcome of interest was TTC of the questionnaires. Patients were stratified into age quartiles to determine the impact of age on TTC. Patient demographic information, such as sex, race, and ethnicity, was determined retroactively. Results: A total of 1178 questionnaire sets consisting of 3658 individual PROMIS forms were analyzed. The mean TTC was 3.29 minutes for all 4 forms in aggregate, with PROMIS PI, PF, UE, and Depression taking on average 1.05, 0.74, 0.96, and 0.57 minutes to complete, respectively. Patients from the oldest age quartile (mean ± SD, 70.3 ± 7.5 years) had a statistically significant longer TTC as compared with the second quartile (41.2 ± 4.7 years) (3.70 vs 2.87 minutes; P < .05). Asian patients had the longest PROMIS PF TTC, while white patients completed PF with the shortest TTC (1.28 vs 0.68 minutes; P < .05). Patients of unstated ethnicity had a longer TTC for PF as compared with their Hispanic/Latino and non-Hispanic/Latino counterparts (0.91 vs 0.30 and 0.70 minutes; P < .05). Conclusion: PROMIS CAT forms are efficient tools for collecting patient-reported outcomes in the ambulatory orthopaedic surgery clinic. Older patients, Asian patients, and patients of unstated ethnicity took longer to complete the forms.

Background With the increasingly rapid growth of the elderly population, individuals aged 65 years and above now compose 14% of Taiwanese citizens, thereby making Taiwanese society an aged society. A leading factor that affects the elderly population is dementia. A method of precisely and efficiently examining patients with dementia through multidimensional computer adaptive testing (MCAT) to accurately determine the patients’ stage of dementia needs to be developed. This study aimed to develop online MCAT that family members can use on their own computers, tablets, or smartphones to predict the extent of dementia for patients responding to the Clinical Dementia Rating (CDR) instrument. Methods The CDR was applied to 366 outpatients in a hospital in Taiwan. MCAT was employed with parameters for items across eight dimensions, and responses were simulated to compare the efficiency and precision between MCAT and non-adaptive testing (NAT). The number of items saved and the estimated person measures was compared between the results of MCAT and NAT, respectively. Results MCAT yielded substantially more precise measurements and was considerably more efficient than NAT. MCAT achieved 20.19% (= [53 − 42.3]/53) saving in item length when the measurement differences were less than 5%. Pearson correlation coefficients were highly consistent among the eight domains. The cut-off points for the overall measures were − 1.4, − 0.4, 0.4, and 1.4 logits, which was equivalent to 20% for each portion in percentile scores. Substantially fewer items were answered through MCAT than through NAT without compromising the precision of MCAT. Conclusions Developing a website that family members can use on their own computers, tablets, and smartphones to help them perform online screening and prediction of dementia in older adults is useful and manageable. Electronic supplementary material The online version of this article (10.1186/s12991-019-0228-4) contains supplementary material, which is available to authorized users.

Objective To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Methods Individual interviews (n = 44) and focus groups (n = 65 individuals with SCI and n = 42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n = 877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n = 245) to assess test-retest reliability and stability. Participants and Procedures A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. Results We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury – Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. Conclusions The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM.

Delay discounting has been linked to important behavioral, health, and social outcomes, including academic achievement, social functioning and substance use, but thoroughly measuring delay discounting is tedious and time consuming. We develop and consistently validate an efficient and psychometrically sound computer adaptive measure of discounting. First, we develop a binary search–type algorithm to measure discounting using a large international data set of 4,190 participants. Using six independent samples ( N = 1,550), we then present evidence of concurrent validity with two standard measures of discounting and a measure of discounting real rewards, convergent validity with addictive behavior, impulsivity, personality, survival probability; and divergent validity with time perspective, life satisfaction, age and gender. The new measure is considerably shorter than standard questionnaires, includes a range of time delays, can be applied to multiple reward magnitudes, shows excellent concurrent, convergent, divergent, and discriminant validity—by showing more sensitivity to effects of smoking behavior on discounting.

The current paper describes new opportunities for patient-centred assessment methods which have come about by the increased adoption of affordable smart technologies in biopsychosocial research and medical care. In this paper, we review modern assessment methods including item response theory (IRT), computer adaptive testing (CAT), and ecological momentary assessment (EMA) and explain how these methods may be combined to improve psychological assessment. We demonstrate both how a ‘naive’ selection of a small group of items in an EMA can lead to unacceptably unreliable assessments and how IRT can provide detailed information on the individual information that each item gives thus allowing short form assessments to be selected with acceptable reliability. The combination of CAT and IRT can ensures assessments are precise, efficient, and well targeted to the individual; allowing EMAs to be both brief and accurate.

This paper addresses the problem of items exposure rate in computer adaptive testing and its relation with the structure of an item bank. An item is a structure defined by real and/or virtual components possibly containing text, image, audio and/or video elements, which are useful to build a context where a question is made about, and of diverse elements or mechanisms for information acquisition to provide an answer to this question. Every item has an associated difficulty that depends on how easy is to answer the question about the defined context. An item bank is a deposit of this kind of structures and, in this paper, the item bank structure is defined in terms of statistical indexes arising from the onedimensional Order Statistics Theory, namely, nearest neighbor index and the standard variate of normal curve; and another one from the concept of compactness of intervals of real numbers. In this sense, the work talks about items difficulty exposure rate assuming that the item bank is, in fact, defined by a finite discrete set of items difficulties. Therefore, the emphasis is given on the items difficulty and it is assumed that the number of items per difficulty in the item bank is unlimited. The experimental results are obtained through a simulation environment that takes into account the definition of the structure of an item bank, the definition of a testing subject and the definition of an item administration context. Therefore, the results are mainly experimental rather than theoretical, although the validation of the simulation environment is based on theoretical results of other authors in the field.

ObjectiveChronic obstructive pulmonary disease (COPD) is a progressive disease with functional decline leading to disability. Dyspnea, the prominent symptom, can be measured using existing measures, but a lack of consensus about standardization of dyspnea measurement remains. We examined the psychometric performance of two item-response theory–based (IRT) measures of dyspnea and related functional limitations (FLs) in patients with COPD and simulated computerized adaptive testing (CAT) of the banks to determine the number of questions required to achieve high precision.MethodsA total of 102 patients completed banks measuring dyspnea and FLs (33 items), from which the 10-item dyspnea and FL short forms were scored as well as other self-report measures of respiratory and physical function and emotional distress. A subset of patients completed the banks 7 to 10 days later. Pulmonary function test results were obtained from medical charts.ResultsThe 33-item banks and 10-item short forms had excellent internal consistency (alphas >0.9) and test-retest reliability (intraclass correlation coefficients >0.89). Patients sorted by severity level on the Medical Research Council scale were differentiated by item banks (P < 0.001) and the short forms (P < 0.01). The banks and short forms were also associated with related measures of dyspnea (e.g., Baseline Dyspnea Index, r = 0.47–0.53), physical function (e.g., 36-Item Short Form Health Survey, r = −0.83 to −0.86) and forced expiratory volume in 1 second (r = −0.32 to −0.35). On average, CAT required 4 and 5 items for accurate measurement of dyspnea and FLs, respectively.ConclusionThe Functional Assessment of Chronic Illness Therapy–Dyspnea short forms and banks provide options for brief, psychometrically sound measures of dyspnea and/or FLs in COPD.

Objectives Chronic obstructive pulmonary disease is a major global health problem. Although several patient-reported outcome (PRO) measures of chronic obstructive pulmonary disease exist, none were developed using patient-driven concept development. We developed an item bank for dyspnea severity and related functional limitations on the basis of a PRO conceptual framework derived from patient input. Methods We identified a large pool of existing items based on a conceptual framework and literature review. Using patient and expert review panels and an item refinement/modification process, we developed an item bank aligned with the conceptual framework, which subsequently underwent psychometric testing via an online Internet panel of dyspnea patients (N = 608). Results Exploratory factor analysis suggested a dominant first factor accounting for about 78% of the total variance. Confirmatory factor analysis supported a unidimensional model. Item response theory analysis demonstrated good model fit, and differential item functioning analyses indicated that the 33-item scale showed potential for measurement equivalence across sex. A 10-item short form produced comparable scores ( r = 0.98) and a computerized adaptive-testing simulation indicated efficient measurement with fewer items (mean 4.65 items). Conclusions An efficient patient-reported measure of dyspnea severity and related functional limitations, based on a patient-driven PRO conceptual framework, is now available for further validation and use.

Purpose:This pilot study evaluated the outcomes of tendon Achilles lengthening in 12 children (mean age: 11.2 years) with spastic hemiplegia.Methods:Cerebral Palsy Computer Adaptive Tests, the timed up-and-go, the Gross Motor Function Measure, the Gillette Functional Assessment Questionnaire, and the Pediatric Outcomes Data Collection Instrument were administered at baseline and at 6, 12, and 24 months postsurgery.Results:Significant improvement at the latest follow-up (12-24 months following surgery) was seen in all domains of the Cerebral Palsy Computer Adaptive Test: activity ( P = .017), lower extremity ( P = .005), global ( P = .005), pain ( P = .005), and fatigue ( P = .028), as well as in the Gross Motor Function Measure-standing domain ( P = .02) and the mobility domain of the Pediatric Outcomes Data Collection Instrument ( P = .04).Conclusion:These findings indicate that the tendon Achilles lengthening improved functional outcome in these children as measured by tests of physical function, walking speed, and activity performance.

Context/Objective The Spinal Cord Injury – Quality of Life (SCI-QOL) measurement system was developed to address the shortage of relevant and psychometrically sound patient reported outcome (PRO) measures available for clinical care and research in spinal cord injury (SCI) rehabilitation. Using a computer adaptive testing (CAT) approach, the SCI-QOL builds on the Patient Reported Outcomes Measurement Information System (PROMIS) and the Quality of Life in Neurological Disorders (Neuro-QOL) initiative. This initial manuscript introduces the background and development of the SCI-QOL measurement system. Greater detail is presented in the additional manuscripts of this special issue. Design Classical and contemporary test development methodologies were employed. Qualitative input was obtained from individuals with SCI and clinicians through interviews, focus groups, and cognitive debriefing. Item pools were field tested in a multi-site sample (n = 877) and calibrated using item response theory methods. Initial reliability and validity testing was performed in a new sample of individuals with traumatic SCI (n = 245). Setting Five Model SCI System centers and one Department of Veterans Affairs Medical Center across the United States. Participants Adults with traumatic SCI. Interventions n/a Outcome Measures n/a Results The SCI-QOL consists of 19 item banks, including the SCI-Functional Index banks, and 3 fixed-length scales measuring physical, emotional, and social aspects of health-related QOL (HRQOL). Conclusion The SCI-QOL measurement system consists of psychometrically sound measures for individuals with SCI. The manuscripts in this special issue provide evidence of the reliability and initial validity of this measurement system. The SCI-QOL also links to other measures designed for a general medical population.

Background: The Patient-Reported Outcomes Measurement Information System (PROMIS) consists of question banks for health domains through computer adaptive testing (CAT). Hypothesis: For patients with glenohumeral arthritis, (1) there would be high correlation between traditional patient-reported outcome (PRO) measures and the PROMIS upper extremity item bank (PROMIS UE) and PROMIS physical function CAT (PROMIS PF CAT), and (2) PROMIS PF CAT would not demonstrate ceiling effects. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: Sixty-one patients with glenohumeral osteoarthritis were included. Each patient completed the American Shoulder and Elbow Surgeons (ASES) assessment form, Marx Shoulder Activity Scale, Short Form–36 physical function scale (SF-36 PF), EuroQol 5 Dimensions (EQ-5D) questionnaire, Western Ontario Osteoarthritis Shoulder (WOOS) index, PROMIS PF CAT, and the PROMIS UE. Correlation was defined as high (>0.7), moderate (0.4-0.6), or weak (0.2-0.3). Significant floor and ceiling effects were present if more than 15% of individuals scored the lowest or highest possible total score on any PRO. Results: The PROMIS PF demonstrated excellent correlation with the SF-36 PF (r = 0.81, P < .0001) and good correlation with the ASES (r = 0.62, P < .0001), EQ-5D (r = 0.64, P < .001), and WOOS index (r = 0.51, P < .01). The PROMIS PF demonstrated low correlation with the Marx scale (r = 0.29, P = .02). The PROMIS UE demonstrated good correlation with the ASES (r = 0.55, P < .0001), SF-36 (r = 0.53, P < .01), EQ-5D (r = 0.48, P < .01), and WOOS (r = 0.34, P

Computer adaptive testing (CAT) is a kind of tailored testing, in that it is a form of computer-based testing that is adaptive to each test-taker’s ability level. In this review, the impacts of CAT are discussed from different perspectives in order to illustrate crucial points to keep in mind during the development and implementation of CAT. Test developers and psychometricians often emphasize the efficiency and accuracy of CAT in comparison to traditional linear tests. However, many test-takers report feeling discouraged after taking CATs, and this feeling can reduce learning self-efficacy and motivation. A trade-off must be made between the psychological experiences of test-takers and measurement efficiency. From the perspective of educators and subject matter experts, nonstatistical specifications, such as content coverage, content balance, and form length are major concerns. Thus, accreditation bodies may be faced with a discrepancy between the perspectives of psychometricians and those of subject matter experts. In order to improve test-takers’ impressions of CAT, the author proposes increasing the target probability of answering correctly in the item selection algorithm even if doing so consequently decreases measurement efficiency. Two different methods, CAT with a shadow test approach and computerized multistage testing, have been developed in order to ensure the satisfaction of subject matter experts. In the shadow test approach, a full-length test is assembled that meets the constraints and provides maximum information at the current ability estimate, while computerized multistage testing gives subject matter experts an opportunity to review all test forms prior to administration.

Background Providers and patients have called for improved understanding of the health care requirements of adults with sickle cell disease (SCD) and have identified the need for a systematic, reliable and valid method to document the patient-reported outcomes (PRO) of adult SCD care. To address this need, the Adult Sickle Cell Quality of Life Measurement System (ASCQ-Me) was designed to complement the Patient Reported Outcome Measurement Information System (PROMIS®). Here we describe methods and results of the psychometric evaluation of ASCQ-Me item banks (IBs). Methods At seven geographically-disbursed clinics within the US, 556 patients responded to questions generated to assess cognitive, emotional, physical and social impacts of SCD. We evaluated the construct validity of the hypothesized domains using exploratory factor analysis (EFA), parallel analysis (PA), and bi-factor analysis (Item Response Theory Graded Response Model, IRT-GRM). We used IRT-GRM and the Wald method to identify bias in responses across gender and age. We used IRT and Cronbach’s alpha coefficient to evaluate the reliability of the IBs and then tested the ability of summary scores based on IRT calibrations to discriminate among tertiles of respondents defined by SCD severity. Results Of the original 140 questions tested, we eliminated 48 that either did not form clean factors or provided biased measurement across subgroups defined by age and gender. Via EFA and PA, we identified three subfactors within physical impact: sleep, pain and stiffness impacts. Analysis of the resulting six item sets (sleep, pain, stiffness, cognitive, emotional and social impacts of SCD) supported their essential unidimensionality. With the exception of the cognitive impact IB, these item sets also were highly reliable across a broad range of values and highly significantly related to SCD disease severity. Conclusion ASCQ-Me pain, sleep, stiffness, emotional and social SCD impact IBs demonstrated exceptional measurement properties using modern and classical psychometric methods of evaluation. Further development of the cognitive impact IB is required to improve its sensitivity to differences in SCD disease severity. Future research will evaluate the sensitivity of the ASCQ-Me IBs to change in SCD disease severity over time due to health interventions.

Although the genuine interest in measuring qualitative aspects of life has increased in the medical field together with our capability to transform patients’ subjective reports, opinions and ratings in standardized pieces of information, the debate about the true objective to measure, the focus and the terminology is still lively. Many instruments, both generic and disease–tailored, have been developed, tested and used in headache and migraine patients. Advances in the field of health outcome assessment have made available a new generation of approaches and measures, both specific and generic, that are based on an approach called dynamic assessment. According to the developers, it is now possible to produce valid and reliable estimates of a person’s perception of health by asking only those questions relevant to the individual respondent’s state. Despite the large body of evidence about the intrinsic value of such new methodology, its “incremental” value when applied in research projects or in the context of programs of disease or outcome management is yet not clear. Thus, before these new methods are experimentally compared with more traditional approaches, in the general population and in headache and migraine patients, caution should be recommended and their use should be avoided outside formal research projects.

The aim of this study is to measure the effect of different termination rules on measurement precision and test length. The research was implemented as a simulation study. Skill parametric values that take a value between +3 and -3 and that are uniformly distributed have been formed for 1000 people. For the item pool, item parameter values have been formed by using the 3 parameter logistic model of Item Response Theory. While forming the Item Pool, the intervals for the parameters are defined as such: a parameter [0.50;2.00]; b parameter [-3.00;+3.00] and c parameter [0.05;0.20]. 5 different termination rules have been used for the study which are: fixed length, standard error, standard error-least item, theta convergence and theta convergence-least item. Different conditions are in place in each termination rule and a total of 12 conditions are compared. Bu çalışmanın amacı bireyselleştirilmiş bilgisayarlı test (BBT)uygulamalarında farklı sonlandırma kurallarının kullanılmasının ölçme kesinliğineve test uzunluğuna etkisini incelemek ve birbirleri ile karşılaştırmaktır.Araştırma simülasyon çalışması olarak yürütülmüştür.1000 kişiye ait yetenekparametresi değerleri -3 ve +3 değerleri arasında değişecek ve tek biçimlidağılacak sekilde oluşturulmuştur. Madde havuzu için; Madde Tepki Kuramındayer alan 3 parametreli lojistik model kullanılarak madde parametre değerlerioluşturulmuştur. Madde havuzu oluşturulurken a parametresi [0,50;2,00]; bparametresi [-3,00;+3,00] ve c parametresi ise [0,05;0,20] aralığında belirlenmiştirAraştırma kapsamında sabit uzunluk, standart hata, standart hata-en az madde,theta yakınsama ve theta yakınsama-en az madde olmak üzere 5 farklısonlandırma kuralı kullanılmıştır. Her bir sonlandırma kuralında farklı koşullar sözkonusu olup toplam 12 koşul birbiriyle karşılaştırılmıştır.

Objective - Evaluation of known-group validity, ecological validity, and test–retest reliability of 4 domain instruments from the Patient-Reported Outcomes Measurement Information System (PROMIS) in osteoarthritis (OA) patients. Methods - We recruited an OA sample and a comparison general population (GP) sample through an internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Testing (CAT) instruments that use a 7-day recall. Known-group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CAT instruments), and test–retest reliability were evaluated. Results - The recruited samples matched the demographic characteristics (age, sex, race, and ethnicity) of the US sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent at >95%. Known-group validity for CATs was demonstrated with large effect sizes (pain intensity 1.42, pain interference 1.25, and fatigue 0.85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥0.86). Test–retest validity (7-day) was very good (≥0.80). Conclusion - PROMIS CAT instruments demonstrated known-group and ecological validity in a comparison of OA patients with a GP sample. Adequate test–retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in OA patients.

Background: Response burden is a major detriment to questionnaire completion rates. Computer adaptive testing may offer advantages over non-adaptive testing, including reduction of numbers of items required for precise measurement. Objective: Our aim was to compare the efficiency of non-adaptive (NAT) and computer adaptive testing (CAT) facilitated by Partial Credit Model (PCM)-derived calibration to estimate skin cancer risk. Methods: We used a random sample from a population-based Australian cohort study of skin cancer risk (N=43,794). All 30 items of the skin cancer risk scale were calibrated with the Rasch PCM. A total of 1000 cases generated following a normal distribution (mean [SD] 0 [1]) were simulated using three Rasch models with three fixed-item (dichotomous, rating scale, and partial credit) scenarios, respectively. We calculated the comparative efficiency and precision of CAT and NAT (shortening of questionnaire length and the count difference number ratio less than 5% using independent t tests). Results: We found that use of CAT led to smaller person standard error of the estimated measure than NAT, with substantially higher efficiency but no loss of precision, reducing response burden by 48%, 66%, and 66% for dichotomous, Rating Scale Model, and PCM models, respectively. Conclusions: CAT-based administrations of the skin cancer risk scale could substantially reduce participant burden without compromising measurement precision. A mobile computer adaptive test was developed to help people efficiently assess their skin cancer risk. [J Med Internet Res 2016;18(1):e22]

Wireless, unattended sensor networks offer a superior monitoring capability with unparalleled flexibility. Traditional systems are typically restrictive in the rigidity of their positioning and topological design requirements. Ongoing research continues to expand the potential for the use of these un-tethered and autonomous systems ranging from the mundane, monitoring soil conditions for agricultural crops, to the extreme of military operations, providing valuable intelligence to commanders in a variety of battlespace conditions. This thesis investigated the use of this type of system in what may be the most hostile of environmental conditions from a wireless networking and communications point of view, the water. The network will be required to organize, establish and maintain itself in a variety of dynamic conditions in or on the water. Commercial off-the-shelf products developed by Crossbow Technologies were used in developing the wireless, unattended sensor network consisting of single and multiple nodes. Nodes were tested on a solid ground surface, on the surface of the water, below the surface of the water (not submerged), and fully submerged. The most significant findings were attained with regard to range. Other findings with regard to link quality, network formation, and network stability support results attained in previous research. http://archive.org/details/performanceofwir109453497 US Navy (USN) author. Approved for public release; distribution is unlimited.

The Armed Services Vocational Aptitude Battery (ASVAB) is a test that approximately 700,000 students in 12,000 high schools take each year to determine military occupation placement. Form Assembly for the ASVAB refers to the selection of 20-35 questions, known as items, from an item pool of approximately 300 items to create a paper and pencil test in one of its ten topics. Previous research formulates form assembly as an Integer Linear Program (ILP). The current ASVAB mostly uses a Computer Adaptive Test (CAT), which estimates an examinee's ability after the examinee answers each item and selects the next item based on prior performance. The current CAT-ASVAB implementation does not control the number of items selected from each subject (taxonomy group) for a test. This thesis introduces ILPs, previously used for form assembly, that impose taxonomy restrictions and applies them to the CAT-ASVAB. We create four ILP variations and test them against the current method of item selection, by simulating 3,500 examinees (500 examinees each for seven given ability levels). The results show that all of the ILPs have acceptable solution times for CAT use, and taxonomy restrictions can be imposed while also having more even exposure rates (the number of times an item is administered divided by the number of examinees) than the current implementation of the CAT-ASVAB. A variation that relaxes most of the binary variables and constrains the difficulty of each item to be within a predetermined magnitude of the current ability estimate, performs the best in terms of item exposure (for both under and over-utilized items) and error between an examinee's estimated ability level and actual ability level. http://archive.org/details/optimizingcatasv109452777 Defense Manpower Data Center author (civilian). Approved for public release; distribution is unlimited.

Throughout the social sciences, tests have been used for two primary - and different - purposes: a) to estimate where an examinee is located on an ability/trait continuum (e.g., intelligence tests), or b) to classify an examinee as either above or below a particular point on the ability continuum (e.g., criterion-referenced tests). From a psychometric perspective, the scoring procedure of the test should reflect the purpose for which the test is being used. From a practical perspective, the administration procedure should be as efficient as possible. The Myers-Briggs Type Indicator (MBTI; Briggs & Myers, 1976) is a personality inventory designed to classify examinees according to four bipolar dimensions. Although the MBTI is quite popular within corporate America, critics have threatened the validity of the MBTI with two seemingly contradictory faults: the test is too unreliable and too long. The purpose of this study was to examine the degree to which using an item response theory (IRT) Ph. D.

In Chapter 14, Joanna Bull and James Daziel provide a comprehensive treatment of the issues surrounding the use of Question Banks and Computer Assisted Assessment, and provide a number of excellent examples of implementations. In their review of the technologies employed in Computer Assisted Assessment the authors include Computer Adaptive Testing and data generation. The authors reveal significant issues involving the impact of Intellectual Property rights and computer assisted assessment and make important suggestions for strategies to overcome these obstacles. Editors: Allison Littlejohn and Simon Buckingham Shum.