This study investigated the effects of extinction on response variabilities in transition states among university students playing MIDI drums. Each of the 4 × 4 tiles on a screen were turned by hitting a drum pad on a variable interval reinforcement schedule （VI 3s）. None of the hits caused the tiles to turn when after 17-32 reinforcement （Extinction）. Subsequently, changes in response frequency, inter-response time, response strength in terms of velocity, response location, and variabilities in these response dimensions were simultaneously measured and monitored for the next experimental phase. For each participant, the response dimension with the highest increase in variability due to extinction was chosen for differential reinforcement. Reinforcement criteria for each participant were determined by visual inspection of ongoing data and reversed to examine the effects of reinforcement contingencies. The results of eight participants who completed the experiment were then reported. Temporal increases in response strength and/or its variability were observed in four participants, and those in response location and/or its variability were observed in two participants. None of the participants showed clear temporal increases in response frequency, which is often described as “extinction burst.” In the differential reinforcement phase, the responses of six participants changed according to the reinforcement conditions without the participants’ awareness. Conceptual issues about the temporal effects of extinction were discussed and future research is proposed.