This study proposes a polychromatic interferometric illumination and polarimetric sensor-based imaging method for spectrum, polarization, and 3D shape, which are significant physical parameters of feature analysis for target detection. 5D-fusion sensing refers to the joint detection and fusion of the above 5D information, which is currently a great challenge. The method generates a polychromatic interference pattern using a Sagnac lateral shearing interferometer and projects it to the target. Then, interferograms modulated by the target are acquired during scanning. Fast Fourier transform (FFT) is performed on the interferograms to obtain their frequency spectra. The spectral and polarization information is extracted from the moduli of the frequency spectra. The 3D shape is recovered from the phase of the frequency spectra using the calibration data. The theory of 5D-fusion sensing is investigated, and verification experiments are then performed. The experiments indicate that the proposed method can fulfill 5D-fusion sensing in one scanning and with FFT using only one device compared with other separate methods. Consequently, the proposed method can improve the sensing and recognition ability of optical imaging technology, which provides great application potential in biomedicine, food safety, material analysis, criminal investigation, archeology, and other fields.