Programming by Voice: Efficiency in using ChatGPT and Speech Optimization

Programming by voice can be a viable option for programmers who suffer from physical disabilities such as Repetitive Stress Injury (RSI), but study shows there are still challenges and limitations in the area, from the requirement of syntax-specific language to inaccuracy of speech recognition. We aim to address the potential benefit and performance of gradually integrating ChatGPT with its versions 3.5/4.0 and how to best communicate (speech optimization) to see if the area of programming by voice can be improved in terms of reduced vocal and cognitive load. We present a tool named ChatGPT VCG which contains two approaches, a traditional keyword interpretation approach using the Serenade tool as a code generator and a direct code generation approach using ChatGPT to generate code directly. Using test tasks written in Java, and the Serenade tool as a base measurement, the two approaches are compared and measurements such as the number of words and code characters generated are collected and analyzed. The result indicates that integrating ChatGPT allows the user to circumvent the required syntax-specific language. The direct code generation using ChatGPT 4.0 performed the best with a 4.2 times reduction in the required number of words compared to standard Serenade, while the keyword-based approach at worst shows a 14% increase. Speech optimization shows performance can be further increased by reducing or removing superfluous grammar and instead only providing the relevant information in commands. The study concludes that integration of ChatGPT can improve performance, and the speech can be optimized to reduce the number of words, but often at the cost of a conversational speech pattern.