Search

Gesture Recognition which is an inevitable part of human computer interaction is an ever evolving active research area. This has been in use under varied applications like smart home systems, sign language recognition, augment reality and in device controls. The acquisition of hand gestures are usually through optical sensors, in this work a radar based hand gesture data set is used for classifying the gestures. Micro doppler signatures were used as the input to the model. Radar dataset has fewer data samples compared to optical based data sets. The proposed work uses separable convolutional neural networks model which does depth wise convolution followed by point wise convolution to reduce overfitting effect of the training data. The proposed model was built in such a way that the model is capable of classifying any unseen data without exactly mimicking the training samples. The proposed model has achieved 94.56% as the testing accuracy which is certainly better than the previous work on this Dop Net data set. Moreover the model has also minimized the computational hours of the model using separable convolutions.

Stealth aircraft use Stealth Technology in order to evade recognition by utilizing mix of highlights with the goal that Aircraft can invade with RADAR and furthermore decrease the deceivability in “radio frequency (RF) range”, sound and infrared visual. During the most recent decades, stealth technology has demonstrated to be one of the best methodologies to the extent the undertaking to escape radar systems is concerned. Stealth intends to evade the recognition or attempt to cover up, for planes, avoiding radar implied stealth. The idea utilized in the stealth innovation isn’t so difficult. It utilizes the guideline to retain and mirror the radar waves. Airplane redirects the radar waves in different ways and limits the radar waves which return back to radar. Another marvel which permits the air ship maintain completely the incoming radar wavelengths to inhabit the electromagnetic reincorporated energy in various way. The structure and material used to manufacture air ship choose the degree of stealth accomplish via air ship. The thought for the radar radio wire to release Radio energy that is then returned through any item that occurs to recognize. The time taken for the reflection to come is measure by the radar radio wire and it can tell how far off an object is.

The world is entering a new era with ubiquitous connectivity among billions of humans and machines, i.e., the 6G massive Internet of Things (IoT). Radar and communication need to be integrated into this system to achieve target detection and massive connectivity. In this work, we first develop a shape-adaptive antenna array composed of multiple sub-arrays spaced at regular intervals. The shape-adaptive antenna array uses flexible material that enables changes in the physical structure to achieve adaptive gain. Subsequently, we investigate the micro-movement of IoT targets, such as the micro-motion characteristics and micro-Doppler effects of rotary-wing drones. The simulation results demonstrate the effectiveness and efficiency of the proposed schemes for detecting UAVs in an IoT scenario.

As an increasingly recognized optical interferometric technique for nondestructive testing and evaluation, shearography has attracted extensive interest in various industrial applications. However, it suffers from the ignorance of the whole process of dynamic surface deformation and the difficulty in determining the depth-resolved information of inhomogeneities. In this regard, a novel speckle pattern interferometric modality named photothermal radar shearography is proposed. Unlike the differential mode of conventional shearography, the present work focuses on the dynamic surface displacement field channel technique with more comprehensive understanding of the subsurface structural information. With the utilization of frequency modulated photothermal excitation, the depth-distributed information of subsurface structures and inhomogeneities is encoded into the induced dynamic surface deformation. Using Hilbert transform and least-square method solved by discrete cosine transform, the time-domain interference signal of each pixel from the recorded speckle patterns sequence is demodulated and unwrapped to obtain the transient full-field shearographic phase distribution which indicates the dynamic surface deformation. In the meanwhile, incrementally delayed cross-correlation matched filtering allows for the localization of axial energy distribution to generate depth-selective structural display for tomography. This proposed transient-based interferometric methodology thus enables depth-tomographic profiles and three-dimensional visualization of subsurface anomalies for the first time, which significantly improves the superiority and attractiveness of shearography in providing insight into the status, performance and reliability of industry.

Pedestrians represent acutely complex and agile targets whose accident prevention has the highest priority concerning highly automated vehicles in urban traffic. Consequently, detection and tracking methods are necessary to determine motion behavior quickly and with high precision. With advancing microelectronics, powerful radar sensors and novel antenna structures are available for pedestrian detection systems, which can utilize unique features such as micro-Doppler signatures in several dimensions and high resolution. This paper presents a micro-Doppler based leg tracking framework that enables behavioral indications in a few sensor cycles. An adaptive motion model representing the kinematic locomotion of a human is derived to propagate the foot motion. Joint probabilistic data association assigns the detections to the respective leg and allows its temporal filtering of the position, micro-Doppler velocity, and kinematic parameters using an extended Kalman filter yielding real-time implementation capability. The presented approach provides the entire signal chain from raw radar data processing to extended multi-object state estimation based on highly relevant safety-critical motion maneuvers measured with radar parameterization corresponding to current serial short-range sensors.

Radar and camera information fusion sensing methods are used to solve the inherent shortcomings of the single sensor in severe weather. Our fusion scheme uses radar as the main hardware and camera as the auxiliary hardware framework. At the same time, the Mahalanobis distance is used to match the observed values of the target sequence. Data fusion based on the joint probability function method. Moreover, the algorithm was tested using actual sensor data collected from a vehicle, performing real-time environment perception. The test results show that radar and camera fusion algorithms perform better than single sensor environmental perception in severe weather, which can effectively reduce the missed detection rate of autonomous vehicle environment perception in severe weather. The fusion algorithm improves the robustness of the environment perception system and provides accurate environment perception information for the decision-making system and control system of autonomous vehicles.

In this article, we propose a framework for contactless human-computer interaction (HCI) using novel tracking techniques based on deep learning-based super-resolution and tracking algorithms. Our system offers unprecedented high-resolution tracking of hand position and motion characteristics by leveraging spatial and temporal features embedded in the reflected radar waveform. Rather than classifying samples from a predefined set of hand gestures, as common in existing work on deep learning with mmWave radar, our proposed imager employs a regressive full convolutional neural network (FCNN) approach to improve localization accuracy by spatial super-resolution. While the proposed techniques are suitable for a host of tracking applications, this article focuses on their application as a musical interface to demonstrate the robustness of the gesture sensing pipeline and deep learning signal processing chain. The user can control the instrument by varying the position and velocity of their hand above the vertically-facing sensor. By employing a commercially available multiple-input-multiple-output (MIMO) radar rather than a traditional optical sensor, our framework demonstrates the efficacy of the mmWave sensing modality for fine motion tracking and offers an elegant solution to a host of HCI tasks. Additionally, we provide a freely available software package and user interface for controlling the device, streaming the data to MATLAB in real-time, and increasing accessibility to the signal processing and device interface functionality utilized in this article., Accepted to IEEE Transactions on Multimedia

So far, numerous learned models have been pressed to use in microwave imaging problems. These models however, are oblivious to the imaging geometry. It has always been hard to bake the physical setup of the imaging array into the structure of the network, resulting in a data-intensive models that are not practical. This work put forward a graph formulation of the microwave imaging array. The architectures proposed is made cognizant of the physical setup, allowing it to incorporate the symmetries, resulting in a less data requirements. Graph convolution and attention mechanism is deployed to handle the cases of fully-connected graphs corresponding to multi-static arrays. The model works with a modular fashion at node level to strike a trade-off between flexibility and efficient capture of mutual information present in measured signals. Additionally, the modular working fashion endows the model with immunity to overfitting. The graph-treatment of the problem is evaluated on experimental setup in context of anomaly localization with imaging array and has shown higher performance as compared to the popular radar technique. The thin model was realized with a feasibly procured reasonably-sized dataset in the order of few hundreds, thus eliminating the need to resort to simulations for augmentation.

In-band full-duplex (IBFD) technology has the potential to not only double the communication throughput but also enable additional capabilities. The fusion of radar and communication subsystems is an excellent example of how IBFD facilitates integration of radar functionality into a communication system. Developing and analysis of a joint IBFD radar-communication (RadCom) system is at the core of this article. This system derives the range-Doppler image from the state of an adaptive filter, which already exists in a typical IBFD transceiver. Our approach is waveform-independent and reuses the radio frequency (RF) front-end while it requires little additional digital logic. The proposed system is prototyped to assess the modem-radar coexistence in a real-world IBFD communication link budget. Employing the prototyped system, we quantify the additional required logic resources and investigate whether such a RadCom approach dictates a tradeoff between the two intended functionalities. The experimental results show that the proposed solution enables a communication system to detect targets within 20 m while maintaining an IBFD link with another communication node, info:eu-repo/semantics/published

Miniature radar has demonstrated its great potential in smart homes to understand the wellness of the residents and provide ubiquitous interactions. While it has many promising applications, it also results in congested RF (radio frequency) environments as there is an unprecedented amount of traffic in a smart home. To ease the strain on the limited spectrum, we ask the question that, can we reuse the sensing signals for data communication With such a capability, we can improve the spectrum utilization by sharing the spectrum between sensing and communication systems. However, radar signals are customized for the sensing purpose and are incompatible with legacy communication standards. To address this challenge, we have an observation that, non-linearity effect in RF circuits can convert wideband radar signals into a LoRa signal. Based on this observation, in this paper, we present LoRadar, which enables an FMCW (Frequency-Modulated Continuous Wave) radar to carry LoRa signals in sensing waves. We present both the downlink and uplink design, enabling a LoRadar device to communicate with LoRa nodes in a bi-directional way. We implement LoRadar and evaluation results show that LoRadar can achieve home-level coverage with 3:4kbps data rate while it preserves the sensing resolution of the radar.

As an essential part of the emerging Internet of Things, connected and autonomous vehicles (CAVs) have the potential to reshape future transportation systems and change the commute style in people's everyday life. Among many vehicular on-board devices, radar system and vehicle-to-vehicle (V2V) communication system are two important pillars for the realization of CAVs. In this paper, the concept of coordinated CRC (C-CRC) is proposed to serve as a cognitive mediator for bridging vehicular radar and communication systems. By establishing a mutual-assistance relationship, C-CRC provides a new safety mechanism that allows one system to learn from and react to the risks that the other system has encountered. Simulation results have shown that the proposed method has desirable performance in face of motion perturbation and/or jamming attack under various scenarios.

With the continuous use of various new radar systems and complex radar systems, the electromagnetic environment is extremely deteriorated. The traditional emitter recognition methods have been difficult to meet the requirements of recognition performance in the rapidly changing battlefield environment. To solve this problem, a radar electronic signal recognition algorithm based on wavelet transform and deep learning is proposed in this paper. Starting from the radar reconnaissance system, the causes of signal preprocessing are analyzed, and the methods of signal denoising, signal normalization, signal intra pulse modulation recognition, multipath signal detection and suppression are deeply studied. In particular, the denoising algorithm based on threshold wavelet transform is proposed, which significantly improves the reliability of the algorithm. Aiming at the individual feature extraction of emitter signal, the extraction methods of emitter signal time domain feature, frequency domain feature, fuzzy function slice feature and cyclic spectrum feature based on wavelet transform are studied and analyzed, which provides stable and reliable classification features for emitter signal recognition. According to the characteristics of radar emitter signal, an optimized convolution neural network is designed, and the feature fusion processing is carried out at the decision-making level, which greatly improves the recognition effect and enhances the robustness of the recognition system. Experiments on radar data show that the fusion recognition rate is higher than any single feature and has strong robustness. In addition, compared with the traditional SVM and elm networks, the CNN network proposed in this paper can extract detailed features more effectively and improve the recognition rate of electronic radar.

In order to improve the speed of passenger screening while preserving the effective capability to detect more sophisticated threats, airport security imaging systems must be able to accurately characterize concealed body-worn objects. In addition to improving the passenger experience, this system capability will enhance airport security for the traveling public. This paper presents a real-time, fully-automatic algorithm for the wideband millimeter-wave (mm-wave) radar reconstruction of the nominal human body contours, even in the presence of an affixed weak dielectric object or when a portion of the body cross-section is not captured by the imaging scanner. The algorithm extracts the main contours from a noisy collection of 3D reconstructed reflectivity and approximates the nominal human body cross-section via fitting a low order angular Fourier series. This important step is essential for precise characterization of concealed body-worn explosives. A ranking algorithm is developed as a metric for the nominal body reconstruction accuracy. We verify the developed algorithm by applying it to the actual images of the High Definition-Advanced Imaging Technology (HD-AIT) system, a laboratory prototype mm-wave scanning system developed recently by the US Department of Homeland Security (DHS). The reconstructed body contours may be used to estimate the electric permittivity of the concealed person-worn objects.

The sharing waveform based integrated radar and communication (IRC) has great potential to apply in Internet of Things (IoT) devices due to its equipment miniaturizing and high efficiency of spectrum and energy, etc. However, the sharing waveform scheme demands a trade-off between radar and communication performances. In this paper, we focus on the design of multiple phase shift keying (MPSK) based linear frequency modulation (LFM) sharing waveform by exploring the trade-off among energy leakage, peak-to-side lobe ratio (PSLR) and symbol rate. First, we derive the energy leakage and PSLR with respect to the symbol rate. Next, a novel LFM-MPSK waveform design is carried out by formulating a communication frame based optimization, where the symbol rate is maximized with the constraints of the energy leakage and PSLR. Then, a branch and reduce algorithm is proposed to solve the optimization. Compared with the conventional one, the proposed LFM-MPSK waveform has a higher symbol rate with the same energy leakage and PSLR. Besides, the proposed waveform design alleviates the difficulty of the trade-off among the energy leakage, PSLR and symbol rate due to more Pareto solutions. Finally, all the analytical results are validated by simulations.

This study investigates the different aspects of multimedia computing in Video Synthetic Aperture Radar (Video-SAR) as a new mode of radar imaging for real-time remote sensing and surveillance. This research also considers new suggestions in the systematic design, research taxonomy, and future trends of radar data processing. Despite the conventional modes of SAR imaging, Video-SAR can generate video sequences to obtain online monitoring and green surveillance throughout the day and night (regardless of light sources) in all weathers. First, an introduction to Video-SAR is presented. Then, some specific properties of this imaging mode are reviewed. Particularly, this research covers one of the most important aspects of the Video-SAR systems, namely, the systematic design requirements, and also some new types of visual distortions which are different from the distortions, artifacts and noises observed in the conventional imaging radar. In addition, some topics on the general features and high-performance computing of Video-SAR towards radar communications through Unmanned Aerial Vehicle (UAV) platforms, Internet of Multimedia Things (IoMT), Video-SAR data processing issues, and real-world applications are investigated.

For autonomous driving, radar sensors provide superior reliability regardless of weather conditions as well as a significantly high detection range. State-of-the-art algorithms for environment perception based on radar scans build up on deep neural network architectures that can be costly in terms of memory and computation. By processing radar scans as point clouds, however, an increase in efficiency can be achieved in this respect. While Convolutional Neural Networks show superior performance on pattern recognition of regular data formats like images, the concept of convolutions is not yet fully established in the domain of radar detections represented as point clouds. The main challenge in convolving point clouds lies in their irregular and unordered data format and the associated permutation variance. Therefore, we apply a deep-learning based method introduced by PointCNN that weights and permutes grouped radar detections allowing the resulting permutation invariant cluster to be convolved. In addition, we further adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Finally, we show that our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds., Comment: 5th International Conference on Artificial Intelligence, Automation and Control Technologies (AIACT 2021), 26-28 March 2021, Shanghai, China

In low signal-to-noise ratio (SNR) environments, the traditional radar emitter recognition (RER) method struggles to recognize multiple radar emitter signals in parallel. This paper proposes a multi-label classification and recognition method for multiple radar-emitter modulation types based on a residual network. This method can quickly perform parallel classification and recognition of multi-modulation radar time-domain aliasing signals under low SNRs. First, we perform time-frequency analysis on the received signal to extract the normalized time-frequency image through the short-time Fourier transform (STFT). The time-frequency distribution image is then denoised using a deep normalized convolutional neural network (DNCNN). Secondly, the multi-label classification and recognition model for multi-modulation radar emitter time-domain aliasing signals is established, and learning the characteristics of radar signal time-frequency distribution image dataset to achieve the purpose of training model. Finally, time-frequency image is recognized and classified through the model, thus completing the automatic classification and recognition of the time-domain aliasing signal. Simulation results show that the proposed method can classify and recognize radar emitter signals of different modulation types in parallel under low SNRs.

Millimeter wave (mmWave) sensing promises to enable contactless and high-precision “in air" gesture-based human-computer interaction (HCI). While previous works have demonstrated its feasibility, they require tedious gesture collecting for person-independent recognition and they operate in an off-line mode without considering practical issues like segmenting gesture and recognition latency. In this work, we propose , a person-independent real-time mmWave gesture recognition solution. We first build a compact gesture model with a custom-designed neural network to distill the unique features underlying each gesture, while suppressing personalized discrepancy across different users without extra collection and re-training. Furthermore, we design a system status transition to decide when a gesture begins and ends, which enables automatic gesture segmentation and hence real-time recognition. We prototype on a commodity mmWave sensor and demonstrate its advantages using two practical applications: a contactless music player and camera. Extensive experiments and user studies show that has an accuracy of 99% and a short response latency within 25ms. Moreover, we also collect and release a comprehensive mmWave gesture dataset consisting of 54,620 instances from 144 persons, which may have an independent value of facilitating future research.

The main‐lobe jamming causes serious degradation of radar system performance in practical applications. In recent years, the Blind Source Separation (BSS) method has been applied to suppress the main‐lobe jamming. However, the received echoes of target and jamming cannot be effectively identified while the robustness of the conventional BSS method is poor due to the influence of system noise. To tackle these problems, a radar main‐lobe jamming suppression and identification method is proposed based on robust whitening BSS and Convolutional Neural Networks methods. First, the target echoes and jamming are separated by the proposed robust whitening BSS method. An iterative optimisation method is proposed to obtain the robust whitening matrix, and sufficient conditions are provided for solvability. Then, a Target echo and Jamming Identification Network (TJINet) is proposed to identify the signals after the robust whitening BSS. The proposed TJINet method uses residual blocks and branch structures to improve classification performance and utilises asymmetric convolution blocks to extract subtle features between the target echo and deceptive jamming. Simulation and experimental results show that the proposed method has better jamming suppression performance than the traditional methods under low signal‐to‐noise ratio (SNR) conditions, the algorithm converges faster, and also can stably identify the target echo and jamming signals.

Autonomous mobile systems such as vehicles or robots are equipped with multiple sensor modalities including Lidar, RGB, and Radar. The fusion of multi-modal information can enhance task accuracy but indiscriminate sensing and fusion in all modality increases demand on available system resources. This paper presents a task-driven approach to input fusion that minimizes utilization of resource-heavy sensors and demonstrates its application to Visual-Lidar fusion for object tracking and path planning. Proposed spatiotemporal sampling algorithm activates Lidar only at regions-of-interest identified by analyzing visual input and reduces the Lidar ‘base frame rate’ according to kinematic state of the system. This significantly reduces Lidar usage, in terms of data sensed/transferred and potentially power consumed, without severe reduction in performance compared to both a baseline decision-level fusion and state-of-the-art deep multi-modal fusion.

Recently, the long coherent accumulation of radar signals becomes relevant in the analysis of Doppler portraits of targets. This interest is related to the desire of researchers to obtain more information about radar purposes. Detailed spectral analysis provides additional information on the parameters of the target and its maneuvers. Some studies published in special articles are being discussed. They analyzed the methods of high resolution for the spectrums of refl ected signals. It is possible to obtain detailed Doppler portraits. The development of the elemental base of the construction of radar devices contributes to the improvement of the processing processes of refl ected signals. The possibilities of highlighting useful signals of small objects against the background of refl ections from the sea surface are considered. The article provides the results of processing signals recorded by radars made by the technology of digital antenna array. The experimental results of the Doppler portraits used a long-term coherent accumulation of signals in the L and X bands. Doppler portraits of ISS signals, Boeing-type passenger aircraft, MiG-29 fi ghter, helicopter are analyzed. The possibility of compensating for changes in the signal phase, which occurs during the radial acceleration of the ISS is shown. This allowed to increase the of signal-to-noise ratio to 6 dВ. Experimental results allow you to observe the maneuver of the target, to measure the acceleration of individual elements of the structure and their evolution. It is proposed to use the method of assessing Doppler portraits in the «radial speed - radial acceleration» coordinate system. The method is useful to use in radar surveillance systems of space objects, in the development of methods for recognizing classes of radar targets and in determining the number of objects in the target group. The development of this method of analysis of signals in prospective RADAR with the digital antenna array will help to solve problems of optimal signal processing, identify the number of targets in the group and maneuver the target, recognize classes of targets by the number of brilliant points and cross-Size targets.

Traditional clustering algorithms can be applied for the pre-sorting step of radar signal sorting. It can effectively dilute the pulse stream and prevent the dense pulse stream from interfering pulse repetition interval (PRI) extraction. However, the pre-sorting deviation will cause interference and missing pulses during the main sorting process. To solve this problem, we deploy the unmanned aerial vehicle (UAV) swarm to monitor reconnaissance areas and put forward a novel deep transfer learning based signal sorting method. The UAV swarm can collect the pulses from different time and spatial domains, and interference and missing pulses in main sorting processing can be relieved dramatically. In our model, we pre-train our model with the data collected from multiple source areas, which corresponds to different areas detected by different parts of UAV swarms. Then we fine-tune our model with the data of the target area. The experimental results prove that the signal sorting accuracy of methods based on deep transfer learning, i.e., YOLO-MobileNet, F-RCNN and cascade RCNN, are higher than that of the baseline methods. In addition, the signal sorting accuracy of traditional methods based on deep learning can be greatly improved with the help of transfer learning.

We demonstrate the efficacy of periodic corrugations, fabricated as part of the radar cover to serve the dual purpose of protecting the radar circuitry and maximizing transmission in millimeter-wave automotive radars. A 2-dimensional array of square-base pyramids engraved on the plastic radar cover was optimized to achieve minimum reflection for a wide range of incident angles, ± 40° and across the operating frequency band of 76 to 81 GHz. More importantly, we present an alternative radome texture, namely the inverse-pyramid corrugations that results in improved structural integrity as compared to the pyramidal corrugations. This novel inverse-pyramid radome structure is also much easier to manufacture and achieves similar performance as the more conventional pyramid structure. Both designs are shown to significantly reduce radar cover reflections, which is perhaps the most significant bottleneck in modern millimeter-wave automotive radar sensor performance.

Compared to visual sensors that have light dependence and privacy intrusion issues, non-intrusion millimeter-wave (mmw) radars are more suitable for the daily person identification. In a realistic home scenario, there are new challenges that are not taken into account in existing research. This paper attempts to address these issues such as multipath interference, complex walking process and recognition robustness in smart home scenarios, and designs a lightweight multi-branch convolutional neural network with an Inception-Pool module and a Residual-Pool module to learn and classify gait Doppler features. The experimental results in a home living room scenario indicate that the designed mmw radar person identification system can achieve accurate and robust real-time identification performance.

Ship detection using polarimetric synthetic radar (PolSAR) imagery attracts a lot of attention in recent years. Most notably, the detector polarimetric notch filter (PNF) has been demonstrated to be effective for ship detection in PolSAR imagery, which gives excellent performances. In this work, a mathematical form of one new PNF (NPNF) based on physical mechanisms of targets and clutter is further developed for partial targets. The different mechanisms have been revealed based on the projection matrix. The experimental results including simulated and measured data demonstrate that the NPNF exhibits a better performance than the original PNF.

Feature selection plays a key role in target recognition especially for multiple combined sensors’ applications. This study presents an improved relief feature selection (Relief‐F) model to rank features for multi‐target recognition. Besides, the evaluation of the effectiveness of the method is conducted based on the following three measuring indices: feature redundancy, class separability and overall accuracy. The simulated data acquired by radar infrared combined sensors are used to verify the metrics of the proposed method. The experimental results demonstrate that the Relief‐F method reveals the best results compared to other feature selection methods, including principal component analysis and Fisher linear discriminant analysis. It indicates that Relief‐F can be an effective option for feature selection with high‐class separability and a low feature redundancy rate. Furthermore, high overall accuracy can be obtained using a relatively small amount of features selected by the Relief‐F method.

Synthetic aperture radar raw data simulation (SAR-RDS) is beneficial to the SAR system design, signal processing method verification, and radar parameter optimization. Most SAR-RDS methods are based on the flat terrain assumption. However, the fluctuant terrain in real scene will induce severe SAR beam occlusion effect and produce radar shadow, leading to incorrect RDS results. Thus, a dynamic elevation angle interpolation (DEAI) algorithm is proposed for SAR shadow judgment by considering the actual SAR working process. The key of the proposed DEAI algorithm is the 1-D EAI and shadow visualization update, which avoids the problem that the existing methods cannot judge the shadow of partial areas due to the insufficiently refined mesh grid or the mismatch of the judgment model. Moreover, an evaluation framework named as joint image and signal criteria (JISC) is proposed from the perspectives of SAR imaging and signal processing results to objectively evaluate the SAR-RDS results and solve the problem that the existing evaluation methods cannot be compatible with fluctuant terrain. Finally, the numerical experiment verified our theoretical analyses.

In this paper, an ultra-wideband (UWB) radar is firstly employed to probe through the opaque wall media to detect behind-the-wall human motions. By employing such a radar, a high-resolution time-range map with different body parts’ reflections highly discriminable in range direction can be obtained. Secondly, a high-pass filter is applied to remove the wall effects in the raw time-range map. Then, with the aim of exploiting the rich range information so as to enhance their corresponding micro-Doppler features, a novel range-max enhancement strategy is proposed to extract the most significant micro-Doppler feature of each time-frequency cell along range direction for a specific motion. Lastly, the effectiveness of the proposed motion feature enhancement strategy is investigated by means of onsite experiments. Comparative classifications using different convolutional neural network structures (CNNs) show that the proposed approach outperforms other state-of-art micro-Doppler feature extraction methods. The comparison with narrowband detection case also proves its superiority in feature enhancement in narrowband detection scene.

Human motion recognition based on ultra-wideband through-the-wall radar (UWB TWR) (a radar whose fractional bandwidth of the radar transmitted signal is bigger than 0.25) is faced with the problems of too few samples and the limitation of perspective. In this letter, we propose a multiradar cooperative human motion recognition model based on transfer learning and ensemble learning. Specifically, a ResNeXt network model based on transfer learning is first proposed to deal with the problem of too few samples. The model is pretrained on the public ImageNet database, and then it is transferred to the task of human motion recognition based on multiradar. Compared with a typical convolutional neural network from scratch, the ResNeXt network model based on transfer learning requires shorter epochs and achieves higher accuracy. Then, to solve the problem of model accuracy decline caused by the limitation of perspective, a multiradar human motion recognition model based on ensemble learning is proposed. Experimental results show that compared with the fusion model based on single-view radar, the recognition accuracy of network based on ensemble learning can be higher.

Protective measures against small unmanned aerial vehicles (UAVs) are vital from a national security perspective. As a result, the importance of surveillance systems that automatically identify and classify low radar cross section (RCS) aerial targets increases. In this work, an indigenously developed continuous wave (CW) (X-band: 10 GHz) radar is used to build a diversified ``DIAT-μSAT'' dataset comprising 4849 micro-Doppler signature images of five different small aerial targets. We also proposed a transfer learning-based deep convolutional neural network (DCNN) approach for classifying low RCS aerial targets. We demonstrated the classification accuracy of 95% and 97%, with VGG16 and VGG19 as feature extractors, respectively, with minimal false-negative and -positive results. The open-field experimental classes covered in this work are: 1) a two-blade rotor; 2) a three-short-blade rotor; 3) a three-long-blade rotor; 4) a quadcopter; 5) a bionic bird; and 6) a two-blade-rotor and bionic bird. We also observed a good classification accuracy (>97%) when more than one target is operated simultaneously.

The clutter encountered in ground-penetrating radar (GPR) systems seriously affects the performance of the subsurface target detection methods. A new clutter removal method based on convolutional autoencoders (CAEs) is introduced. The raw GPR image is encoded via successive convolution and pooling layers and then decoded to provide the clutter-free GPR image. The loss function is defined in terms of the reference clutter-free target image and the decoder output is optimized to learn the weight coefficients from the raw data. The method is compared to the conventional subspace methods, recently proposed nonnegative matrix factorization, as well as low-rank and sparse decomposition (LRSD) methods and dictionary separation-based morphological component analysis. CAE and its deeper version deep CAE (DCAE) are trained by several scenarios generated by the electromagnetic simulation tool gprMax. Simulation results demonstrate the effectiveness of the proposed method for challenging scenarios. While for real GPR image, the simulated data trained networks remain slightly behind the LRSD methods for the dry case, nonetheless, they outperform the aforementioned processing techniques for the more challenging wet case.

Existing works on radar high-resolution range profile (HRRP) recognition commonly focus on utilizing data and various deep learning models in achieving high classification accuracy. However, in practical applications, it is often difficult to obtain HRRP signals, especially for noncooperative targets. Such lack of data dramatically decreases the recognition performance, so this letter applies data augmentation to address small-sample problems. A recognition-aware HRRP generation framework based on a generative adversarial network is proposed for data augmentation, which generates discriminative samples by decomposing and reorganizing signal's characteristics. The proposed model increases the generated signals' discriminative power, thus meeting the application requirements. Experiments show that the generated HRRP signals can not only accurately expand the data set but also improve the recognition system's performance. Besides, the developed model outperforms traditional data augmentation methods and other generative methods. To the best of our knowledge, this is the first work on HRRP signal generation in radar automatic target recognition systems.

A cascaded regional people counting approach based on two-dimensional (2-D) spatial attribute features using multi-input multi-output (MIMO) radar is presented in this letter. The main task is to detect whether there is a target, and to classify the number of people in a closed metal ramp. The difficulty to accurately detect the number of people lies in the presence of strong static clutter and the strong multipath effects in the environment. In this letter, range-angle spectrum is first computed and exploited to extract the 2-D spatial attribute features, namely the effective peaks of range-angle spectrum, the spacing features and the energy block features. These features reflect the relative position relationships between the people and the environment as well as the physical structure of a certain environment. Then, a maximum likelihood classifier and a random forest classifier are cascaded and applied to detect the target presence and classify the number of people. The experiment results show that the average classification accuracy of 0 person, 1 person, and multiple persons is above 92.55%, which outperforms the existing people counting approaches.

Insufficient data of a noncooperative target seriously affect the performance of radar automatic target recognition (RATR) using the high-resolution range profile (HRRP), especially when the noncooperative target has only one sample. To this end, we propose an unsupervised data generation method to generate noncooperative HRRP signals. We utilize the pretrained generative adversarial networks (GANs) model to learn the HRRP general probability distribution. To emphasize the representative and discriminative power of generated HRRP signals, a joint optimization method is proposed to preserve category information. Moreover, a feature diversification method is proposed to make the generated samples have sufficient aspect characteristics to further fit the probability distribution of the noncooperative target. Thus, the generated HRRP signals can effectively improve the recognition performance of noncooperative target. Extensive experiments on HRRP data sets demonstrate the superior performance of our method over other state-of-the-art methods.

The holographic subsurface radar (HSR) is recognized as an effective remote sensing modality for the detection of shallowly buried objects with a high-resolution image in plain view. However, subsurface detection with HSR is prone to be impaired by clutter contamination, which often obscures the target response. In this letter, a novel clutter mitigation method combining singular value decomposition (SVD) and response cross correlation analysis is presented. The proposed method first applies SVD to decompose the radar data matrix to a number of singular components. Furthermore, the signal cross correlation characteristics are analyzed to demonstrate that the variance of left singular vectors is directly proportional to the target proportion in radar data. Then, target and clutter subspaces can be identified by maximizing the defined weighted target-to-clutter ratio (WTCR). Results of numerical simulation and laboratory experiments corroborate the effectiveness of the proposed method in reducing clutter while preserving the target image.

Classification of nonprecipitation echoes of radar is an inevitable step in radar-based precipitation estimation. Among nonprecipitation echoes, clear air echoes are specifically difficult to distinguish for their similarity to precipitation echoes. This letter aims to conduct a pixelwise classification of clear air echoes for image sequences of the radar reflectivity. We propose the Static and Motion streams Network (SMNet) to simultaneously utilize the static and motion features. SMNet realizes capturing the spatiotemporal characteristics while maintaining the details of the current frame via a fusion structure and a novel training method. For feature fusion, the static and motion streams are concatenated. Then, for model training, we adopt a dynamic weight assignment strategy to further extract rich information. Finally, we validate our method on an S-band single-polarization radar in Beijing, China, from May to September 2018. The results demonstrate that the overall performance of SMNet is superior to other competitors.

Convolutional neural network (CNN)-based methods have become the mainstream in radar ship recognition. However, these methods suffer from two common problems. First, the training samples consist largely of common ship types, giving them an overwhelming numerical advantage over rare ship types. As a result, CNN-based recognition algorithms fail to classify rare ship types correctly. Second, huge high-resolution slices result in heavy computational burdens. To solve the first problem, namely, the class imbalance problem, this letter proposes a CNN training method that combines deep metric learning (DML) with gradually balanced sampling. DML obtains the center of each class in the feature space and performs clustering equally. Gradually balanced sampling adopts a smooth transition from instance-aware resampling to class-aware resampling to improve the recognition rate drop caused by traditional resampling methods. As for the second problem, to reduce the computational complexity of high-resolution synthetic aperture radar (SAR) images, a lightweight CNN is also proposed.

With the popularity of unmanned aerial vehicles (UAVs), how to conduct automatic and effective detection to prevent unauthorized flying has become an important issue. The conventional constant false alarm rate (CFAR) detector based on radar signal has shown advantages in moving target detection. However, the CFAR-based detectors are strongly dependent on some manual experience, such as the ambient noise distribution estimation and the detection windows' size selection, and usually suffered poor performance on small UAV detection due to the weak signal. Inspired by the success of deep learning (DL) on natural scene object detection, this article tries to explore a DL-based method for UAV detection in pulse-Doppler radar. Concretely, we propose a convolutional neural network (CNN) with two heads: one for the classification of the input range-Doppler map patch into target present or target absent and the other for the regression of offset between the target and the patch center. Then, based on the output of the network, a nonmaximum suppression (NMS) mechanism composed of probability-based initial recognition, distribution density-based recognition, and voting-based regression is developed to reduce false alarms as well as control the false alarms. Finally, experiments on both simulated data and real data are carried out, and it is shown that the proposed method can locate the target more accurately and achieve a much lower false alarm rate at a comparable detection rate than CFAR.

Non-stationary moving target detection in spiky sea clutter is a challenging task due to the high-power, time-varying, and target-like properties of sea spikes. In this paper, we propose a time-frequency correlation (TFC)-based constant false alarm rate (TFC-CFAR) detection method on the Time-frequency manifold, and apply to the non-stationary moving target detection in spiky sea clutter. The data samples in each range cell are modeled as a TFC matrix that captures the correlation between two frequency components of the time frequency distribution. The clutter covariance matrix is estimated by the geometric mean of a set of TFC matrices in reference cells. Three geometric metrics are employed to measure the dissimilarity between the clutter and target signals. Based on these geometric measures, three TFC-CFAR detectors are compared. Experiments performed on real IPIX radar dataset confirm that the TFC can be used for identifying and eliminating sea spikes, while the TFC-CFAR detector achieves better detection performance than the conventional detectors.

High-frequency surface wave radar (HFSWR) can be effectively used to detect ships in the exclusive economic zone. However, the ship signal is concealed and interfered with various clutter and background noise in the Doppler spectrum. In this letter, a range-Doppler (RD) image-based novel ship detection algorithm is proposed by exploiting spatial-frequency information and a unique feature fusion based on the analysis of variance. The algorithm subsumes three successive stages: Stage I--the plausible region of interest is captured, Stage II--the features from different sources are fused into one generalized feature space, and Stage III--an extreme learning machine-based classifier is utilized to localize the ships. Experimental results on challenging HFSWR-RD datasets demonstrate that the proposed algorithm has a competitive performance over other ship detection algorithms.

Integrating compressed sensing (CS) with millimeter-wave (mmW) holography has shown great potential to achieve lightweight onboard hardware, low sampling ratio, and high-speed sensing. However, conventional CS-driven algorithms are always limited by nontrivial adjusting of parameters and excessive computational cost caused by plenty of iterations. To address this problem, we propose a lightweight model-based deep learning framework (LFIST-Net) for mmW 3-D holography, by combining the interpretability of fast iterative shrinkage-thresholding algorithm (FISTA) and tuning-free merit of data-driven deep neural network. First, the single-frequency (SF) holographic imaging technique is integrated into FISTA, which serves as the sensing kernels, to avoid large-scale matrix multiplications. Subsequently, the kernel-based FISTA (KFISTA) is mapped into layer-fixed and parameter-learnable LFIST-Net, whose weights are relaxed to be layer-varied. The updating of key parameters in LFIST-Net, including step sizes, thresholds, and momentum coefficients, are regularized by soft-plus function to ensure the non-negativity and monotonicity. As for 3-D holography implementation, the ``1-D + 2-D'' scheme is adopted, where the matched filtering (MF) and well-trained LFIST-Net are used for range focusing and reconstructions of azimuth slices. Without losing efficiency, the range-focused subechoes are processed parallelly in 3-D cube form. Experiments, including both simulated and measured tests based on a commercial mmW radar, prove that LFIST-Net is capable of reconstructing the imaging scene precisely. In particular, in near-field mmW 3-D holography tests, both numerical and visual results demonstrate LFIST-Net yields compelling reconstruction performance while maintaining high computational speed compared with MF-based, conventional CS-driven, and network-based methods.

With the development of the radar sensing technology, hand gesture sensing and recognition has attracted much attention. This letter adopts a frequency-modulated continuous wave (FMCW) radar to achieve short-range hand gesture sensing and recognition. Specifically, the range, Doppler, and angle parameters of hand gestures are measured by fast Fourier transformation (FFT) and multiple signal classification (MUSIC) algorithm, respectively. The mixup (MP) algorithm combined with augmentation (AU) algorithm using a weight factor is applied to expand the hand gesture data. Then, a complementary multidimensional feature fusion network-based hand gesture recognition (CMFF-HGR) is designed to extract the features and achieve HGR. Finally, a series of experiments are carried out to verify the effectiveness of the proposed approach, and the results show that the recognition accuracy is higher than the existing alternatives with low computational complexity.

Target detection is studied for a cloud multiple-input multiple-output (MIMO) radar using quantized measurements. According to the local sensor quantization strategies and fusion strategies, this paper discusses three methods: quantize local test statistics which are linearly fused (QTLF), quantize local test statistics which are optimally fused (QTOF), and quantize local received signals which are optimally fused (QROF). We first directly analyze the detection performance of each method when the quantizer output is represented as a discrete random variable, where it is difficult to obtain a closed-form expression for the detection probability. Then, an approximate description for the quantization is analyzed for the case of a Gaussian signal and a closed-form expression of the detection probability is obtained. We prove that the QTOF method outperforms the QTLF method in general, and for small SCNR the QROF method has the best detection performance among the three methods, while for large SCNR the QROF method performs the worst. The correctness of theoretical analysis is verified by simulations.

The higher bandwidth inverse synthetic aperture radar (ISAR) can obtain the higher resolution radar images, which can provide more target information and help improve radar target detection and recognition. It is essential to study how to achieve a precise high-resolution (HR) ISAR image utilizing limited measurement echoes. The existing neural-network-based ISAR imaging methods extract features only from limited measurement echoes, and the common features in HR ISAR images are not utilized sufficiently, which limits the imaging performance improvement. Moreover, in their loss functions, there are no explicit constraints on the correct recovery of strong scattering points, which are important in reflecting the target characteristics. In this letter, we propose a conditional probabilistic generative model to achieve the HR ISAR imaging. By optimizing the well-designed Kullback-Leibler (KL) divergence between conditional prior and approximate posterior probability distribution in the loss function, the common features contained in training HR radar images can be learned, and a suitable prior probability distribution for the latent variable can be obtained. To accurately recover the positions and relative amplitudes of strong scattering points, we blend a similarity measurement that is sensitive to the large values' locations in a vector with the adversarial loss. Both visual and numerical results of extensive experiments prove that the proposed model can obtain enhanced effectiveness and efficiency compared with some counterparts.

Radar emitter classification (REC) plays an increasingly significant role in the electronic reconnaissance system. Due to there are many unreliable factors in traditional feature-based methods, this article focuses on improving the accuracy and stability of REC based on multipaths of original radar signals. A novel aggregated multipath extreme gradient boosting (AMP-XGBoost) is therefore put forward. Multi-path, including multi-scale, multi-domain transformations and their concatenations, is developed to exploit more information of the original signal, which contributes to providing more distinguishable features. XGBoost is used to automatically extract the features contained in these paths and complete recognition. Finally, multiple paths are sifted and aggregated according to certain weights to obtain a higher accuracy. Experiments are carried out based on signals from 6 different intra-pulse modulation mode radars with the same radio frequency (RF) range. It is demonstrated that the proposed method has higher REC accuracy than the methods only based on a single scale or domain. In the meantime, experimental results under different low SNRs show that the proposed method has higher stability. Finally, experiments based on the measured aviation radar data proves the superiority of the proposed method.