Research on Data Fusion of Pilot's LOS and Target Information

Aiming at the problem that the precision of gaze information data extraction is not high in the process of pilot's; flight, this paper puts forward the research on the fusion of the data of the landing point of sight and the target information, and feeds back the information through human-computer interaction to obtain the accurate target information. First, the non wearable eye tracker is used to track the line of sight, estimate the fixation point, obtain the fixation point coordinates, and match with the position coordinates of the instrument panel to get the dial where the fixation point is. Then, data fusion is carried out between the instrument panel where the fixation point is located and the flight parameters to obtain the information displayed on the instrument panel. Finally, the fixation information of the instrument panel is used as the input data to support the identification of the pilot's intention. Secondly, data fusion is carried out between the pilot's attention information and reaction time information, and a large amount of data is used as the input data. Machine learning is adopted Methods after information fusion, the decision- making of pilots was predicted.