Sensor system for development of perception systems for ATO

Abstract Developing AI systems for automatic train operation (ATO) requires developers to have a deep understanding of the human tasks they are trying to replace. This paper fills this gap and translates the regulatory requirements from the context of German railways for the AI developer community. As a result, tasks such as train’s path monitoring for collision prediction, signal detection, door operation, etc. are identified. Based on this analysis, a functionally justified sensor setup with detailed configuration requirements is presented. This setup was also evaluated by a survey within the railway industry. The evaluated sensors include RGB/IR cameras, LIDARs, radars and ultrasonic sensors. Calculations and estimates for the evaluated sensors are presented graphically and included in this paper. However, the ultimate sensor setup is still a subject of research. The results of this paper also address the lack of training and test datasets for railway AI systems. It is proposed to acquire research datasets that will allow the training of domain adaptation algorithms to transform other datasets, thus increasing the number of available datasets. The sensor setup is also recommended for such research datasets.