The Use of Tailored Testing with Instructional Programs. Final Report.

A computerized testing system was implemented in conjunction with the Radar Technician Training Course at the Naval Training Center, Great Lakes, Illinois. The feasibility of the system and students' attitudes toward it were examined. The system, a multilevel, microprocessor-based computer network, administered tests in a sequential, fixed length format for the purpose of comparing the effect of mode of administration of test items (computerized versus paper-and-pencil). Since the one-parameter and three-parameter logistic models were both determined to be acceptable, the less expensive one-parameter model was used. The results indicated that, in spite of hardware problems, the system design was viable and that microcomputers could be used to administer achievement tests in an instructional program environment. Some items were found to operate differently when administered on a computer screen as compared to a paper-and-pencil administration. Further research was suggested to determine the cause of the differences in item performance. A 23-item attitude survey, which is appended, was administered to a sample of 136 trainees. The trainees generally had no difficulty taking the test on the computer, and 62 percent indicated that they enjoyed it. (Author/GDC)