Development of Cognitive Tests for Repeated Performance Assessment.

Two cognitive performance tests, Computer Interaction (CI) and Tower of Hanoi (HT), were generated as paper and pencil tests with alternate forms. The CI Test evaluates a person's transactions with a computer system (Radio Shack desk-top calculator EC-2004). The HT Test, a popular puzzle and test of logical reasoning, was adapted for discrete, forced-choice responses. In testing situations subjects are instructed and practiced extensively before independent variables are manipulated. Both tests are always timed. Our studies indicate these tests have high task definitions and stabilities. Repeated assessment produced stability (reliability) coefficients of > 0.70 and 0.80 for CI and HT, respectively. Stability was achieved on CI and HT (decision of POSSIBLE after 30 - 60 min of practice, i.e., 5-10 administrations. The decision of OPTIMAL on Ht required 60 - 90 min (10 - 15 administrations). The HT Test was also programmed on a briefcase computer (NEC PC-8201A) but this version has not been evaluated systematically. These methods produce tests with functional properties that may be useful to military or civilian psychometricians. Keywords: Test Development, Cognitive Tests, Test Stability (reliability), Tower Hanoi, Computer Interaction, Equivalent Test Forms.