Holographic voice-interactive system with Taylor Rayleigh-Sommerfeld based point cloud gridding.

• Build a system that integrates salient object detection, voice interaction, holographic computation, and reconstruction modules, ultimately creating a holographic voice-interactive system. • The proposed U-blocks and U-net based reverse attention residual algorithm are used to generate more effective and accurate point cloud datasets during the acquisition phase. • In our holographic voice-interactive system, the ChatGLM model serves as the core module for voice interaction, used within our holographic display system. It converts user speech input into text information and executes corresponding operations or provides feedback based on the text content, enabling further system processing or response. • In a comparison between the wavefront-recording plane (WRP) and point cloud gridding (PCG) methods, the computation speeds of the proposed Taylor Rayleigh-Sommerfeld diffraction point cloud gridding algorithm (TRS-PCG) are faster. In recent years, intelligent voice interaction technology and holographic display technology have garnered significant attention. We propose a holographic voice-interactive system. The holographic voice interaction system can provide users with a virtual assistant proficient in accurately handling user voice queries, facilitating smoother interactions. Additionally, users can interact with virtual objects via holographic projection, enhancing realism and engagement. In this research, we introduce the U-blocks and U-net based reverse attention residual algorithm to generate more effective and accurate point cloud datasets during the acquisition phase. Furthermore, we integrate the ChatGLM pre-trained language model as the core module for voice interaction in the holographic display system, covering aspects such as text interaction and output control. Additionally, we propose a Taylor Rayleigh-Sommerfeld point cloud gridding method aimed at improving the computational speed of hologram generation. We validate the feasibility of our proposed methods through numerical simulations and optical experiments. [ABSTRACT FROM AUTHOR]