Search

Automotive perception involves understanding the external driving environment as well as the internal state of the vehicle cabin and occupants using sensor data. It is critical to achieving high levels of safety and autonomy in driving. This paper provides an overview of different sensor modalities like cameras, radars, and LiDARs used commonly for perception, along with the associated data processing techniques. Critical aspects in perception are considered, like architectures for processing data from single or multiple sensor modalities, sensor data processing algorithms and the role of machine learning techniques, methodologies for validating the performance of perception systems, and safety. The technical challenges for each aspect are analyzed, emphasizing machine learning approaches given their potential impact on improving perception. Finally, future research opportunities in automotive perception for their wider deployment are outlined.

Vibration measurement is a crucial task in industrial systems, where vibration characteristics reflect health conditions and indicate anomalies of the devices. Previous approaches either work in an intrusive manner or fail to capture the micrometer-level vibrations. In this work, we propose mmVib, a practical approach to measure micrometer-level vibrations with mmWave radar. First, we derive a metric called Vibration Signal-to-Noise Ratio (VSNR) that highlights the directions of reducing measurement errors of tiny vibrations. Then, we introduce the design of mmVib based on the concept of Multi-Signal Consolidation (MSC) for the error reduction and multi-object measurement. We implement a prototype of mmVib, and the experiments show that it achieves 3.946% relative amplitude error and 0.02487% relative frequency error in median. Typically, the average amplitude error is only 3.174um when measuring the 100um-amplitude vibration at around 5 meters. Compared to two existing mmWave-based approaches, mmVib reduces the 80th-percentile amplitude error by 69.21% and 97.99% respectively.

Gesture Recognition which is an inevitable part of human computer interaction is an ever evolving active research area. This has been in use under varied applications like smart home systems, sign language recognition, augment reality and in device controls. The acquisition of hand gestures are usually through optical sensors, in this work a radar based hand gesture data set is used for classifying the gestures. Micro doppler signatures were used as the input to the model. Radar dataset has fewer data samples compared to optical based data sets. The proposed work uses separable convolutional neural networks model which does depth wise convolution followed by point wise convolution to reduce overfitting effect of the training data. The proposed model was built in such a way that the model is capable of classifying any unseen data without exactly mimicking the training samples. The proposed model has achieved 94.56% as the testing accuracy which is certainly better than the previous work on this Dop Net data set. Moreover the model has also minimized the computational hours of the model using separable convolutions.

Nyquist Folding Receiver (NYFR) is a perceptron structure that realizes a low probability of intercept (LPI) signal analog to information. Aiming at the problem of LPI radar signal receiving, the time domain, frequency domain, and time-frequency domain problems of signals intercepted by NYFR structure are studied. Combined with the time-frequency analysis (TFA) method, a radar recognition scheme based on deep learning (DL) is introduced, which can reliably classify common LPI radar signals. First, the structure of NYFR and its characteristics in the time domain, frequency domain, and time and frequency domain are analyzed. Then, the received signal is then converted into a time-frequency image (TFI). Finally, four kinds of DL algorithms are used to classify LPI radar signals. Simulation results demonstrate the correctness of the NYFR structure, and the effectiveness of the proposed recognition method is verified by comparison experiments.

International audience; In this paper, a novel method to improve the readability of chipless tags is presented. When the EM wave falls upon the tag's surface at normal incidence or with a known incidence, the proposed approach permits to obtain a higher signal-to-noise ratio (SNR) of resonators whose orientation with respect to the normal to the plane in which the tag is positioned is unknown and thus, to increase the reading distance of the tag. It introduces a technique based on the detection of this tag orientation in relation to the antennas; a projection of the signals will allow to correct this misalignment in order to always be able to decode the tag identifier on a signal that corresponds to an ideal alignment between the tag and the antennas. With this principle, it is also possible to separate the resonance mode of the resonator that is connected to the identifier from other parasitic resonance modes that may appear due to a possible misalignment between the tag and the antenna. This principle is applied to loop resonators commonly used in chipless RFID which can present strong parasitic modes of resonance. Also, this method makes the reading orientation invariant, allowing to read the resonator whatever its orientation with respect to the normal to the plane in which the tag is positioned. Likewise, the proposed method can be also used to sense this resonator orientation. This method requires a dual-polarization antenna and a 2-ports vector network analyzer (VNA). Results are validated in simulation and with real-environment measurements for a single resonator as well as for multiple resonators, as it is classically used in the chipless RFID technology. Measurements in a harsh environment, as well as comparisons with classical techniques such as time gating, are presented. A study on the improvment of the read range is achieved to highligth the potential of the proposed technique. A reading distance of more than 80cm was thus obtained, which represents 20cm more than with the classic use of a post-processor based on time gatting. Finally, the principle of the measurement is generalized by applying it to a tag with a ground plane and considering that the antenna is not necessarily placed in normal incidence with respect to the plane of the tag.

The autonomous navigation of UAS requires, among others, detect-and-avoid capability as a prerequisite for enabling wide-ranging applications, including the transportation of goods and people. This article presents the design, implementation, and experimental results of a UAS-borne radar system detecting drones. The applications of the proposed system include not only detect-and-avoid systems for safe and autonomous navigation of unmanned aircraft systems but also airborne surveillance of malicious drones in controlled or restricted airspace for mitigating security and privacy threats. The system performance in terms of maximum detection range is evaluated through field tests. The experimental results show that the proposed UAS-borne radar can detect a DJI Phantom 4 and a DJI Matrice 600 Pro at a maximum distance of 440 and 500 meters, respectively. The article also provides insights into the system implementation and integration aspects, discusses future research direction, and stresses the need for standardization efforts to benchmark the required performance levels for UAS-borne radars.

Stealth aircraft use Stealth Technology in order to evade recognition by utilizing mix of highlights with the goal that Aircraft can invade with RADAR and furthermore decrease the deceivability in “radio frequency (RF) range”, sound and infrared visual. During the most recent decades, stealth technology has demonstrated to be one of the best methodologies to the extent the undertaking to escape radar systems is concerned. Stealth intends to evade the recognition or attempt to cover up, for planes, avoiding radar implied stealth. The idea utilized in the stealth innovation isn’t so difficult. It utilizes the guideline to retain and mirror the radar waves. Airplane redirects the radar waves in different ways and limits the radar waves which return back to radar. Another marvel which permits the air ship maintain completely the incoming radar wavelengths to inhabit the electromagnetic reincorporated energy in various way. The structure and material used to manufacture air ship choose the degree of stealth accomplish via air ship. The thought for the radar radio wire to release Radio energy that is then returned through any item that occurs to recognize. The time taken for the reflection to come is measure by the radar radio wire and it can tell how far off an object is.

The network extended not just internationally but also throughout a broad variety of application areas in this age, with healthcare being one of the most well-known and vital industries. Improvements in healthcare are possible if we start using the popular internet of things (IoT) technology as a key instead of focusing on other disciplines. Wireless body area network (WBAN) is a field in which we communicate with a network of human people and medical equipment that may be used in conjunction with internet of things technology to perform any function. Additional features for software defined networks will be added in the future. In the event of a critical crisis, the suggested suggestions will be to take care of the patient's life. Because the fitted equipment keeps a lot better eye on the patient than previously advised methods. This study combines WBAN, IoT, and software defined network (SDN) to make sense in the healthcare field.

The integration of wireless sensors into the automotive industry is making vehicles increasingly safe and autonomous. At present, vehicles are equipped with external sensors that facilitate maneuverability and braking and internal sensors that detect presence, seat belt state, and occupant vital signs. Early detection of dysfunctional breathing patterns can reduce the risk of accidents caused by drowsiness or fatigue. In this regard, this work presents an MIMO FMCW Radar System able to distinguish dysfunctional breathing patterns from human torso motion. The torso has been divided into six regions, and the amplitude of the elongation and the frequency of motion of each region have been measured during breathing. An elongation map is then constructed in order to graphically show the dysfunctional breathing patterns. The signal processing includes a peak search algorithm to detect elongation amplitude and a bandpass frequency filter to minimize dc components, random driver motion, and vehicle vibration. A torso elongation emulator phantom has been assembled with materials of skin-like relative permittivity and dc motors for calibration and validation of basic breathing patterns. Finally, the signal of the system is compared with that of a commercial respiration belt, and then the system is tested by performing measurements on people. The MIMO radar system is able to measure, differentiate, and classify patterns associated with dysfunctional breathing such as hyperventilation syndrome and thoracic dominant breathing. This work was supported in part by the Spanish “Comision Interministerial de Ciencia y Tecnologia” (CICYT) under Project PID2019-107885GB-C31 and Project MDM2016- 0600, in part by the Catalan Research Group under Grant 2017 SGR 219, and in part by the “Secretaría Nacional de Educación Superior, Ciencia, Tecnología e Innovación” (SENESCYT) from the Ecuadorian Government

The ambiguity problem of targets in Doppler beam sharpening (DBS) with forward-looking radar is considered. While DBS is proposed earlier to improve the angular resolution of the radar while keeping the antenna aperture size limited, such a solution suffers from ambiguities in the case of targets positioned symmetrically with respect to the platform movement. To address this problem, an approach named unambiguous Doppler-based forward-looking multiple-input multiple-output (MIMO) radar beam sharpening scan (UDFMBSC) is proposed, based on the combination of MIMO processing and DBS. The performance of the proposed method is compared to existing approaches using simulated data with point-like and extended targets. The method is successfully verified using experimental data.

Linked to the increasing availability of datasets for radar-based human activity recognition (HAR), in this Student Highlights contribution, we report on a classification project that a group of 23 graduate students performed at TU Delft. The students were asked to work in groups of 2-3 members and to use the publicly available University of Glasgow dataset to develop the best classification pipeline as possible. This involved development and justification of both choices for the preprocessing techniques on the radar data (e.g., time-frequency distributions and cleaning of the signatures), and for the classification algorithms (e.g., the type of the algorithm, the hyperparameters' selection, the training-validation-testing split). While this student activity was performed at a small scale and with educational rather than research aims, we are happy to report it to the AESS readership, as we believe that such initiatives with open datasets sharing and classification algorithm benchmarking are beneficial for the wider radar research community. Furthermore, a list of publicly available datasets for radar-based HAR that can be used for similar initiatives is also reported in this article.

Radar-based gesture recognition can play a vital role in autonomous vehicles’ interaction with vulnerable road users (VRUs). However, in automotive scenarios the same gesture produces strongly differing radar responses owed to the wide range of variations such as position, orientation, or ego-motion. Since including all kinds of modifications in a measured dataset is laborious, gesture simulations alleviate the measurement effort and increase the robustness against edge and corner cases. Hence, this paper presents a flexible geometric human target model allowing the direct introduction of a wide range of modifications, while it facilitates the handling of shadowing effects and multiradar constellations. Using the proposed simulation model, a dataset recorded with a radar sensor network consisting of three chirp sequence (CS) radars is resimulated based on motion data simultaneously captured with a stereo video system. Completely substituting the measured by simulated data for training, a convolutional neural network (CNN) classifier still achieves 80.4% cross-validation accuracy on a challenging gesture set, compared to 89.4% for training on measured data. Moreover, using simulated data the classifier is shown to successfully generalize to new scenarios not observed in measurements., acceptedVersion

Roadside sensors, such as camera and millimeter-wave (MMW) radar, provide traffic information beyond the visual range of intelligent vehicles in cooperative vehicle-infrastructure systems. Unlike onboard equipment, roadside sensors are affiliated with different systems and lack synchronization in both space and time. In this paper, we propose a novel spatio-temporal synchronization method of asynchronous roadside MMW radar-camera for sensor fusion, which utilizes features of the scenario to extract lane line corner points to pre-calibrate the camera. Based on the consistent time flow rate of the separate sensors, multiple virtual detection lines are set up to match the time headway of successive vehicles and conduct objective matching to track data. Finally, a synchronization optimization model is formulated and a constrained nonlinear minimization solver is applied to tune the parameters. Measure data from Donghai Bridge in Shanghai is applied to verify the feasibility and effectiveness of the method. The results determine that there are 33 frames (33*40 ms) of temporal deviation between the camera and the radar in this case. After the synchronization, the average spatial deviation is reduced from 2.47 m to 0.42 m in the X-direction and 64.06 m to 2.34 m in the Y-direction, respectively. This study provides an economical and effective way to solve the problem of spatio-temporal synchronization of roadside sensors.

This article considers the detection and tracking of weak targets in multiple pulse repetition frequency (multi-PRF) radars using the track-before-detect (TBD) technique. By exploring the measurement independence among different PRFs, we decompose the joint multi-PRF and multiframe optimization problem into several lower dimensional maximizations, each of which corresponds to an intra-PRF multiframe processing. An efficient two-stage TBD procedure with a parallel structure is proposed for the multi-PRF radars. Specifically, in the first stage, a constraint inequality is derived analytically and used to decouple the measurement ambiguities from the nonlinear conversion relationship between polar and Cartesian coordinates. The intra-PRF multiframe integration can then be carried out concurrently using the ambiguous measurements and the target-like measurement plot sequences with different ambiguities are extracted for different PRFs. In the second stage, a covariance combination fusion-based inter-PRF joint disambiguation and estimation algorithm is proposed to solve the ambiguities of the plot sequences and output high-Accuracy target tracks. Simulation experiments show that the proposed algorithm can provide a good detection performance and higher tracking accuracy with much lower complexity. This work was supported in part by the National Natural Science Foundation of China under Grant 61771110, Grant U19B2017, and Grant 61871103, in part by the Fundamental Research Funds of Central Universities under Grant ZYGX2020ZB029, in part by Chang Jiang Scholars Program and the 111 Project under Grant B17008, and in part by the China Scholarship Council.

This article presents and experimentally evaluates a frequency error elimination technique suitable for unsynchronized bistatic Multiple-Input Multiple-Output (MIMO) radar for human-body detection. First, a mathematical expression of human-body localization using bistatic MIMO radar is presented. Then the direct path is used to eliminate the phase error created by the frequency difference between the transmitter and receiver. A new Doppler-shifted component of the MIMO channel without phase error is derived, and the locations of the multiple targets are calculated by the 2-dimensional MUltiple SIgnal Classification (MUSIC) method. Next, the results of simulations that examine frequency error versus power ratios are discussed to illustrate the effectiveness of the proposed method. An experiment is carried out in an indoor multipath-rich environment. To emulate the unsynchronized condition, the transmitter and receiver use independent Signal Generators (SGs). One to six targets are tested. The experiments demonstrate that our unsynchronized radar system can identify the locations of multiple targets with high accuracy.

BACKGROUD: Recently, monitoring the vital-sign with the noncontact method is a popular technology. OBJECTIVE: In this work, we present a fully pulse radar system including front-end sensing and back-end data processing. A series of ultra-wide band sensing pulses is generated and radiated to detect the subject’s chest vibration which in turn obtains the required vital-sign signals. METHODS: An artificial plywood with 3 centimeter thickness is placed between a transmitting/receiving antenna of the radar and subject to demonstrate the characteristic of noncontact sensing. The firmware and digital signal processing are also presented in this paper to optimize physiological data quality. RESULTS: The experimental results show that the continuous heart rate and breathing rate can be monitored by this customized system radar module. CONCLUSION: A fully customized ultra-wide band radar for vital-sign application is presented. The radar system plan with wall parameter is also incorporated into the design consideration to meet the FCC requirement and SNR.

Multiple-input multiple-output (MIMO) radar design for extended targets in a spectrally crowded environment is a challenge owing to the high sensitivity of the target impulse response (TIR) and the increasing requests for spectrum. Assuming unknown TIR, this paper proposes a joint design method to optimize the transmit waveforms and receive filter bank in MIMO structure ensuring spectral compatibility with the overlayed radiators. A priori information is used to impose a spectral constraint on the waveforms, which is the result of a non-convex optimization problem aimed at enhancing the average signal-to-interference-plus-noise-ratio (SINR) over a finite uncertainty set for the TIR. The new method realizes an improved spectral cohabitation with the surrounding radiators through an appropriate modulation of the transmitted energy. In addition, we develop an iterative optimization algorithm which successively enhances the average SINR. Each iteration of the algorithm involves a hidden convex problem, which can be solved resorting to the rank-one decomposition procedure. Finally, the performance is assessed by studying the trade-off among the achieved SINR and spectral shape. The reported results are presented to analyze the performance of the devised method against several counterparts in terms of the SINR value and robustness.

Recently, radar frequency bands have attracted attention as candidates for cognitive radio owing to their wide bandwidth but low utilization. When spectrum sensing is performed in radar bands, sliding-window-based detection can be used to exploit the sparsity of the radar pulse signal in the time domain and obtain a sufficient number of samples. The detection performance and sensing time depend on the configuration of the windows. The detection performance was optimized when the window size was equal to the pulsewidth. However, the pulsewidth is generally unknown. Another way to increase the detection performance is to obtain more samples of the window. However, this causes large computation overhead owing to the sparsity of radar signals. Therefore, we propose an adaptive-sliding-window-based detection scheme to address these problems. First, the window is adaptively applied. Second, a pulsewidth estimation algorithm is proposed to approximate the window size to the pulsewidth for each detection. Additionally, we demonstrate the performance improvement of the proposed scheme and evaluate the estimation error of the proposed algorithm via simulations.

Microwave imaging has been investigated for medical applications such as stroke and breast imaging. Current systems typically rely on bench-top equipment to scan at a variety of antenna positions. For dynamic imaging of moving structures, such as the cardiovascular system, much higher imaging speeds are required than what has thus far been reported. Recent innovations in radar-on-chip technology allow for simultaneous high speed data collection at multiple antenna positions at a fraction of the cost of conventional microwave equipment, in a small and potentially portable system. The objective of the current work is to provide proof of concept of dynamic microwave imaging in the body, using radar-on-chip technology.Arrays of body-coupled antennas were used with nine simultaneously operated coherent ultra-wideband radar chips. Data were collected from the chest and thigh of a volunteer, with the objective of imaging the femoral artery and beating heart. In addition, data were collected from a phantom to validate system performance. Video data were constructed using beamforming.The location of the femoral artery could successfully be resolved, and a distinct arterial pulse wave was discernable. Cardiac activity was imaged at locations corresponding to the heart, but image quality was insufficient to identify individual anatomical structures. Static and differential imaging of the femur bone proved unsuccessful.Using radar chip technology and an imaging approach, cardiovascular activity was detected in the body, demonstrating first steps towards biomedical dynamic microwave imaging. The current portable and modular system design was found unsuitable for static in-body imaging.This first proof of concept demonstrates that radar-on-chip could enable cardiovascular imaging in a low-cost, small and portable system. Such a system could make medical imaging more accessible, particularly in ambulatory or long-term monitoring settings.

Reasonable route planning and resource allocation strategy in the airborne radar systems (ARS), can sufficiently utilize the limited resources and promote the multitarget tracking (MTT) performance. However, using separately the route planning and resource optimization method cannot take full advantage of the airborne platform. Considering this issue, we propose a joint online route planning and resource optimization strategy in the ARS to improve the system capability for MTT. First, a kinematic model of the ARS, including the mathematical expression between the radar states and the system control parameters, is introduced, which integrates the route planning to the radar scheduling scheme. Next, the posterior Cramer–Rao lower bound about route planning and resource optimization variables for the tracking targets is derived. Then, a scaled-based utility function is established to quantify the MTT performance. Hereafter, a nonconvex problem is formulated by minimizing the utility function with route and resource constraints, and then a efficient three-stage partition-based solution is proposed. Finally, simulation experiments demonstrate the effectiveness of the proposed algorithm. Furthermore, over the traditional benchmark algorithm, the tracking performance of the proposed approach improves 30.44%.

The world is entering a new era with ubiquitous connectivity among billions of humans and machines, i.e., the 6G massive Internet of Things (IoT). Radar and communication need to be integrated into this system to achieve target detection and massive connectivity. In this work, we first develop a shape-adaptive antenna array composed of multiple sub-arrays spaced at regular intervals. The shape-adaptive antenna array uses flexible material that enables changes in the physical structure to achieve adaptive gain. Subsequently, we investigate the micro-movement of IoT targets, such as the micro-motion characteristics and micro-Doppler effects of rotary-wing drones. The simulation results demonstrate the effectiveness and efficiency of the proposed schemes for detecting UAVs in an IoT scenario.

Background: Microwave imaging is one of the emerging non-invasive portable imaging techniques, which uses nonionized radiations to take a detailed view of biological tissues in the microwave frequency range. Brain stroke is an emergency caused by the interruption of the blood supply into parts of the brain, leading to the loss of millions of brain cells. Imaging plays a major role in stroke diagnosis for prompt treatment. Objective: This work proposes a computationally efficient algorithm called the GPR algorithm to locate the blood clot with a size of 10 mm in microwave images. Methods: The electromagnetic waves are radiated, and backscattered reflections are received by Antipodal Vivaldi antenna with the parasitic patch (48 mm*21 mm). The received signals are converted to a planar 2D image, and the depth of the blood clot is identified from the B-scan image. The novelty of this work lies in applying the GPR algorithm for the accurate positioning of a blood clot in a multilayered head tissue. Results: The proposed system is effectively demonstrated using a 3D M.E.M. simulator, and simulated results are verified in a Vector network analyzer (E8363B) with an experimental setup. Conclusion: This is an alternative safe imaging modality compared to present imaging systems (T.C.T. and MRI)

A respiratory disorder that attacks COVID-19 patients requires intensive supervision of medical practitioners during the isolation period. A non-contact monitoring device will be a suitable solution for reducing the spread risk of the virus while monitoring the COVID-19 patient. This study uses Frequency-Modulated Continuous Wave (FMCW) radar and Machine Learning (ML) to obtain respiratory information and analyze respiratory signals, respectively. Multiple subjects in a room can be detected simultaneously by calculating the Angle of Arrival (AoA) of the received signal and utilizing the Multiple Input Multiple Output (MIMO) of FMCW radar. Fast Fourier Transform (FFT) and some signal processing are implemented to obtain a breathing waveform. ML helps the system to analyze the respiratory signals automatically. This paper also compares the performance of several ML algorithms such as Multinomial Logistic Regression (MLR), Decision Tree (DT), Random Forest (RF), Support Vector Machine (SVM), eXtreme Gradient Boosting (XGB), Light Gradient Boosting Machine (LGBM), CatBoosting (CB) Classifier, Multilayer Perceptron (MLP), and three proposed stacked ensemble models, namely Stacked Ensemble Classifier (SEC), Boosting Tree-based Stacked Classifier (BTSC), and Neural Stacked Ensemble Model (NSEM) to obtain the best ML model. The results show that the NSEM algorithm achieves the best performance with 97.1% accuracy. In the real-time implementation, the system could simultaneously detect several objects with different breathing characteristics and classify the respiratory signals into five different classes.

Speeding is one of the biggest threatens to road safety. However, facilities like radar detector and speed camera are not deployed everywhere, as roads in some areas like campus and residential areas often lack these facilities. Several solutions either depend on pre-deployed infrastructures, or require additional devices, which motivate us to explore the practicability of using smartphones' acoustic sensors to detect vehicle speed. In this paper, we propose a Hybrid Detection system for vehicle Speed (HDSpeed). We first investigate the relationship between acoustic pattern and vehicle speed. According to our findings on typical patterns of both Electric Vehicles (EVs) and Gasoline Vehicles (GVs), we separately extract different features from the acoustic signals of EVs and GVs. A CNN and an LSTMN are designed for training EV and GV models, respectively. Considering that applying neural networks obtains coarse-grained information like a speed section, we propose a detection method based on active acoustic sensing, in which method HDSpeed calculates the fine-grained speed by detecting the distance change between the smartphone and the passing vehicle. In addition, the previously detected speed section can eliminate interferences of surrounding moving objects. Through extensive experiments in real driving environments, HDSpeed achieves an average error of 2.17km/h.

Autonomous Vehicles (AVs) rely on a set of radar sensors operated on frequency modulated waveforms. Due to the large bandwidth requirement of frequency modulated radars, only a limited number of proximate vehicles can be allowed for a concurrent transmission within the available spectrum. However, with the explosive growth of AVs, the available spectrum may soon reach its capacity. As a results, the coexistence of multiple AVs working on same resource, may lead to the problem of Radar-to-Radar (R2R) interference, also known as radar blindness. In this paper, we propose the notion of coded waveforms to minimize the R2R interference among the vehicles operating on the same resource. Specifically, the spread spectrum codes have been used as another degree of freedom (i.e., along with time-frequency resources) to spread the inter-vehicular radar interference over the wider spectrum, which enable to orthogonalize more number of AVs over the available range of spectrum. In addition, we have formulated a Spread Spectrum-based Radar Transmission Scheme (SS-RTS), and described the transmission and reception through SS-RTS. Also, the SS-RTS has been compared with the existing Graph-based Resource Allocation (GRA) scheme. Further, simulation results verified that SS-RTS significantly reduces the inter-vehicular R2R interference and outperforms GRA in terms of blind probability.

A recent paper (Mhaskar (2020)) introduces a straightforward and simple kernel based approximation for manifold learning that does not require the knowledge of anything about the manifold, except for its dimension. In this paper, we examine how the pointwise error in approximation using least squares optimization based on similarly localized kernels depends upon the data characteristics and deteriorates as one goes away from the training data. The theory is presented with an abstract localized kernel, which can utilize any prior knowledge about the data being located on an unknown sub-manifold of a known manifold. We demonstrate the performance of our approach using a publicly available micro-Doppler data set, and investigate the use of different preprocessing measures, kernels, and manifold dimensions. Specifically, it is shown that the localized kernel introduced in the above mentioned paper when used with PCA components leads to a near-competitive performance to deep neural networks, and offers significant improvements in training speed and memory requirements. To demonstrate the fact that our methods are agnostic to the domain knowledge, we examine the classification problem in a simple video data set.

Intelligent vehicle testing and validation technology is a hotspot in the field of intelligent vehicles. Millimeter-wave radar has been widely used in intelligent vehicles and advanced driving assistant systems (ADASs). Owing to low efficiency, high maintenance cost and limited scenario types, the traditional real-vehicle-testing can make it difficult to meet the requirements of intelligent vehicle testing. Also, the degree of reality of millimeter-wave radar sensor models in the virtual test platform is not convincing enough. To solve the mentioned problems, the millimeter-wave radar in-the-loop (mmRil) testing for intelligent vehicles is proposed in this study. First, the radar echo simulation method is developed. Next, based on the millimeter-wave flight time, Doppler frequency shift and the radar power attenuation equation, the mmRil test system is built. A geometric model of a radar target detection and a power attenuation model under bad weather conditions are established. Then, the accuracy of the testbench is verified. Finally, a typical intelligent vehicle control strategy is used for testing under various working conditions and bad weather using the mmRil testbench. The test results show that the mmRil testing has higher authenticity and accuracy than the simulation testing and can be used to test the intelligent vehicle algorithms under severe weather conditions. Compared with the real vehicle testing, the mmRil testing has higher efficiency, repeatability and safety. Therefore, the mmRil testing represents an indispensable testing method in the field of intelligent vehicle testing.

Soil moisture estimates at high spatial and temporal resolution are of great value for optimizing water and agricultural management. To fill the gap between local ground observations and coarse spatial resolution remote sensing products, we use Soil Moisture Active Passive (SMAP) and Sentinel-1 data together with a unique data set of ground-based soil moisture estimates by cosmic ray neutron sensors (CRNS) and capacitance probes to test the possibility of downscaling soil moisture to the sub-kilometre resolution. For a high-latitude study area within a highly heterogeneous landscape and diverse land use in Denmark, we first show that SMAP soil moisture and Sentinel-1 backscatter time series correlate well with in situ CRNS observations. Sentinel-1 backscatter in both VV and VH polarizations shows a strong correlation with CRNS soil moisture at higher spatial resolutions (20–400 m) and exhibits distinct and meaningful signals at different land cover types. Satisfactory statistical correlations with CRNS soil moisture time series and capacitance probes are obtained using the SMAP Sentinel-1 downscaling algorithm. Accounting for different land use in the downscaling algorithm additionally improved the spatial distribution. However, the downscaling algorithm investigated here does not fully account for the vegetation dependency at sub-kilometre resolution. The study suggests that future research focussing on further modifying the downscaling algorithm could improve representative soil moisture patterns at a fine scale since backscatter signals are clearly informative. Highlights. Backscatter produces informative signals even at high resolutions. At the 100 m scale, the Sentinel-1 VV and VH polarizations are soil moisture dependent. The downscaling algorithm is improved by introducing land-cover-dependent clusters. The downscaled satellite and CRNS soil moisture agree best at the agricultural site.

We demonstrate detection of ice formations on a road surface using a polarimetric radar operating at 87.5-92.5 GHz. The radar measures the scattering parameters of the surface at horizontal and vertical polarizations and their cross-polarization components. We demonstrate detection of ice for radar beam directed at up to 45⁰ angle of incidence with respect to the surface which allows for road surface characterization in front of a vehicle. The method used is based on a statistical approach where the 2-port scattering parameters are measured multiple times and used to calculate an average scatter coherence matrix representing the surface. The coherence matrix is then decomposed to eigenvalues/vectors, which are used to estimate polarimetric attributes such as target entropy(degree of randomness) and polarimetric pedestal (degree of depolarization). Through measurements of dry, ice-covered and wet road surfaces, we show that both entropy and depolarization are increased with respect to dry surface when a thin ice layer is formed, while their value decrease for the case of wet surface. It is also shown that these polarimetric attributes are not sensitive to surface roughness in dry conditions, minimizing the probability of false alarm due to road surface wear.

As an increasingly recognized optical interferometric technique for nondestructive testing and evaluation, shearography has attracted extensive interest in various industrial applications. However, it suffers from the ignorance of the whole process of dynamic surface deformation and the difficulty in determining the depth-resolved information of inhomogeneities. In this regard, a novel speckle pattern interferometric modality named photothermal radar shearography is proposed. Unlike the differential mode of conventional shearography, the present work focuses on the dynamic surface displacement field channel technique with more comprehensive understanding of the subsurface structural information. With the utilization of frequency modulated photothermal excitation, the depth-distributed information of subsurface structures and inhomogeneities is encoded into the induced dynamic surface deformation. Using Hilbert transform and least-square method solved by discrete cosine transform, the time-domain interference signal of each pixel from the recorded speckle patterns sequence is demodulated and unwrapped to obtain the transient full-field shearographic phase distribution which indicates the dynamic surface deformation. In the meanwhile, incrementally delayed cross-correlation matched filtering allows for the localization of axial energy distribution to generate depth-selective structural display for tomography. This proposed transient-based interferometric methodology thus enables depth-tomographic profiles and three-dimensional visualization of subsurface anomalies for the first time, which significantly improves the superiority and attractiveness of shearography in providing insight into the status, performance and reliability of industry.

Pedestrians represent acutely complex and agile targets whose accident prevention has the highest priority concerning highly automated vehicles in urban traffic. Consequently, detection and tracking methods are necessary to determine motion behavior quickly and with high precision. With advancing microelectronics, powerful radar sensors and novel antenna structures are available for pedestrian detection systems, which can utilize unique features such as micro-Doppler signatures in several dimensions and high resolution. This paper presents a micro-Doppler based leg tracking framework that enables behavioral indications in a few sensor cycles. An adaptive motion model representing the kinematic locomotion of a human is derived to propagate the foot motion. Joint probabilistic data association assigns the detections to the respective leg and allows its temporal filtering of the position, micro-Doppler velocity, and kinematic parameters using an extended Kalman filter yielding real-time implementation capability. The presented approach provides the entire signal chain from raw radar data processing to extended multi-object state estimation based on highly relevant safety-critical motion maneuvers measured with radar parameterization corresponding to current serial short-range sensors.

Radar and camera information fusion sensing methods are used to solve the inherent shortcomings of the single sensor in severe weather. Our fusion scheme uses radar as the main hardware and camera as the auxiliary hardware framework. At the same time, the Mahalanobis distance is used to match the observed values of the target sequence. Data fusion based on the joint probability function method. Moreover, the algorithm was tested using actual sensor data collected from a vehicle, performing real-time environment perception. The test results show that radar and camera fusion algorithms perform better than single sensor environmental perception in severe weather, which can effectively reduce the missed detection rate of autonomous vehicle environment perception in severe weather. The fusion algorithm improves the robustness of the environment perception system and provides accurate environment perception information for the decision-making system and control system of autonomous vehicles.

The future contributions of the Antarctic Ice Sheet to sea level rise will depend on the evolution of its surface mass balance (SMB), which could amplify/dampen mass losses increasingly observed at the ice sheet's edge. In situ constraints of SMB over annual-to-decadal timescales consist mostly of firn/ice cores that have a surface footprint $\sim$cm$^{2}$. SMB constraints also come from climate models, which have a higher temporal resolution but a larger surface footprint of several km$^{2}$. We use ice-penetrating radar data to obtain an intermediate spatial and temporal resolution SMB record over three ice rises along the Princess Ragnhild Coast. The co-located ice cores allow us to obtain absolute radar-derived SMB rates at a multi-annual-to-decadal temporal resolution. By comparing the ice core SMB measurements and the radar-derived SMB records, we determine that pointwise measurements of SMB are representative of a small surface area, $\sim 200-500$ m radius extending from the ice core drill site for the ice rises studied here, and that the pointwise measurements are systematically 7–15 cm w.e. a$^{-1}$ lower than the mean SMB value calculated for the whole ice rises. However, ice core records are representative of an entire ice rise's temporal variability at the temporal resolution examined.

Flow cytometry is widely used for B-ALL minimal residual disease (MRD) analysis given its speed, availability, and sensitivity; however, distinguishing B-lymphoblasts from regenerative B-cells is not always straightforward. Radar plots, which project multiple markers onto a single plot, have been applied to other MRD analyses. Here we aimed to develop optimized radar plots for B-ALL MRD analysis.We compiled Children's Oncology Group (COG) flow data from 20 MRD-positive and 9 MRD-negative B-ALL cases (enriched for hematogones) to create labeled training and test data sets with equal numbers of B-lymphoblasts, hematogones, and mature B-cells. We used an automated approach to create hundreds of radar plots and ranked them based on the ability of support vector machine (SVM) models to separate blasts from normal B-cells in the training data set. Top-performing radar plots were compared with PCA, t-SNE, and UMAP plots, evaluated with the test data set, and integrated into clinical workflows.SVM area under the ROC curve (AUC) for COG tube 1/2 radar plots improved from 0.949/0.921 to 0.989/0.968 after optimization. Performance was superior to PCA plots and comparable to UMAP, but with better generalizability to new data. When integrated into an MRD workflow, optimized radar plots distinguished B-lymphoblasts from other CD19-positive populations. MRD quantified by radar plots and serial gating were strongly correlated.Radar plots were successfully optimized to discriminate between diverse B-lymphoblast populations and non-malignant CD19-positive populations in B-ALL MRD analysis. Our novel radar plot optimization strategy could be adapted to other MRD panels and clinical scenarios.

Large-scale deployment of connected vehicles with cooperative sensing technologies increases the demand on the vehicular communication spectrum in 5.9 GHz allocated for the exchange of safety messages. To support the high data rates needed by such applications, the millimeter-wave (mmWave) automotive radar spectrum at 76-81 GHz can be utilized for wideband communication as well. For this purpose, various joint automotive radar-communication (JARC) systems have been proposed in the literature to perform both functions using the same wideband waveform. However, the wideband joint waveforms encounter frequency-selectivity in both radar and communication channels due to multi-path propagation. In this paper, we address the optimal joint waveform design problem to exploit the frequency-selectivity for wideband JARC operations via orthogonal frequency-division multiplexing (OFDM) wherein subcarrier coefficients are designed for optimal power allocation and phase coding. We show that the problem is a non-convex quadratically constrained quadratic programming (QCQP) problem which is known to be NP-hard. Existing approaches to solve QCQP include semidefinite relaxation (SDR) which incurs high time complexity. Instead, we propose approximation methods to solve QCQP more efficiently by leveraging structured matrices and using convex approximations. Finally, we demonstrate the efficacy of the proposed approaches through numerical simulations.

So far, numerous learned models have been pressed to use in microwave imaging problems. These models however, are oblivious to the imaging geometry. It has always been hard to bake the physical setup of the imaging array into the structure of the network, resulting in a data-intensive models that are not practical. This work put forward a graph formulation of the microwave imaging array. The architectures proposed is made cognizant of the physical setup, allowing it to incorporate the symmetries, resulting in a less data requirements. Graph convolution and attention mechanism is deployed to handle the cases of fully-connected graphs corresponding to multi-static arrays. The model works with a modular fashion at node level to strike a trade-off between flexibility and efficient capture of mutual information present in measured signals. Additionally, the modular working fashion endows the model with immunity to overfitting. The graph-treatment of the problem is evaluated on experimental setup in context of anomaly localization with imaging array and has shown higher performance as compared to the popular radar technique. The thin model was realized with a feasibly procured reasonably-sized dataset in the order of few hundreds, thus eliminating the need to resort to simulations for augmentation.

In-band full-duplex (IBFD) technology has the potential to not only double the communication throughput but also enable additional capabilities. The fusion of radar and communication subsystems is an excellent example of how IBFD facilitates integration of radar functionality into a communication system. Developing and analysis of a joint IBFD radar-communication (RadCom) system is at the core of this article. This system derives the range-Doppler image from the state of an adaptive filter, which already exists in a typical IBFD transceiver. Our approach is waveform-independent and reuses the radio frequency (RF) front-end while it requires little additional digital logic. The proposed system is prototyped to assess the modem-radar coexistence in a real-world IBFD communication link budget. Employing the prototyped system, we quantify the additional required logic resources and investigate whether such a RadCom approach dictates a tradeoff between the two intended functionalities. The experimental results show that the proposed solution enables a communication system to detect targets within 20 m while maintaining an IBFD link with another communication node, info:eu-repo/semantics/published

This paper proposes a joint uplink massive multiple-input-multiple-output (MIMO) communication and orthogonal frequency-division multiplexing (OFDM) radar sensing architecture. Specifically, uplink communication and short-range radar sensing are considered, where the user equipments (UEs) transmit data to the base-station (BS), which simultaneously receives radar returns from the targets over the same subcarriers. Hence, the signals received at each BS antenna include radar returns and communication signals to be processed for extracting the sensing and communication data. The separation and detection of such signals are achieved by utilizing the channel diversity between the UEs and the targets. To this end, the UEs’ signals are first detected and demodulated, and then subtracted from the received signal to acquire the radar returns. Symbol-based radar processing is then employed, as it provides substantial processing gains, and its detection performance is independent of the transmitted radar waveform. Furthermore, self-interference—due to the simultaneous operation of transmit and receive antennas—is taken into account. The communication rate and normalized error of the radar-target channel estimation are mathematically analyzed, and the trade-off between the achievable rate and radar detection performance is demonstrated in terms of the power output of the communication and radar sub-systems and the signal-to-noise ratio.

Miniature radar has demonstrated its great potential in smart homes to understand the wellness of the residents and provide ubiquitous interactions. While it has many promising applications, it also results in congested RF (radio frequency) environments as there is an unprecedented amount of traffic in a smart home. To ease the strain on the limited spectrum, we ask the question that, can we reuse the sensing signals for data communication With such a capability, we can improve the spectrum utilization by sharing the spectrum between sensing and communication systems. However, radar signals are customized for the sensing purpose and are incompatible with legacy communication standards. To address this challenge, we have an observation that, non-linearity effect in RF circuits can convert wideband radar signals into a LoRa signal. Based on this observation, in this paper, we present LoRadar, which enables an FMCW (Frequency-Modulated Continuous Wave) radar to carry LoRa signals in sensing waves. We present both the downlink and uplink design, enabling a LoRadar device to communicate with LoRa nodes in a bi-directional way. We implement LoRadar and evaluation results show that LoRadar can achieve home-level coverage with 3:4kbps data rate while it preserves the sensing resolution of the radar.

Model uncertainty is a serious challenge for robustness of tracking algorithms in radar systems. The smooth variable structure filter (SVSF) achieves error-bounded estimations for target state by scaling the magnitude of kinematic modeling error and accordingly performing a flexible switching strategy for the correction gain. However, the SVSF, without any smoothing functions, suffers from undesired chattering phenomenon since the measurement noise causes random disturbance to the identification of actual level of uncertainties, leading to obvious deterioration of tracking accuracy. In this paper, we present a new switching function for SVSF, i.e. the hyperbolic tangent function, for effective chattering suppression. Then we propose a new algorithm named as the Tanh-SVSF, which reformulates the correction gain with the new switching function, to improve the estimation accuracy for target state. A mathematical definition of SVSF chattering is proposed to quantify the chattering amplitude. It is demonstrated that the new switching function exerts a nonlinear compressing effect on the likelihood of measurement innovation and substantially reduces the disturbance of measurement noise, leading to elimination of the chattering problem. The stability of the Tanh-SVSF is analyzed, based on a proposed stability theorem and the numerical exhaustion strategy. Finally, the proposed method is tested on a simulated vehicle tracking scenario and real-world radar data from the Oxford Radar RobotCar Dataset, and shows superior performance over existing SVSF formulations and the Kalman filter, in view of tracking accuracy, track continuity and the proposed chattering indicator.

Deinterleaving mixtures of radar pulse sequences is the first and the most vital step for modern electronic reconnaissance systems to intercept and analyze the intentions of non-cooperative radars. Currently, these systems are facing great challenges due to the emerging complexity of radar modulations. This paper proposes a novel method for deinterleaving mixtures of radar pulse sequences based on the time series characteristics of each source (component pulse sequences). Firstly, the mathematical representations are established to describe the structural characteristics of each source. Then, the deinterleaving problem is formulated as a minimization of a maximum-likelihood cost function that can be solved efficiently through a supervised neural machine translation (NMT) network, i.e. to translate each received pulse in the interleaved pulse sequence to the corresponding source label. A sequence-to-sequence NMT model is proposed to capture the structural relationships among the non-adjacent pulses originated from the same source in the mixtures and assign the corresponding label to each pulse. The proposed method does not require the exact knowledge of each component pulse sequence. The experimental results based on the time of arrival sequence of mixed pulse sequences show that the proposed method outperforms the state-of-the-art deinterleaving methods and achieves satisfactory performance under highly non-ideal situations with measuring noise and lost pulse conditions. The proposed method can be directly applied to other fields involving deinterleaving problems and multi-variate input conditions.

This contribution presents an electronic travel aid for blind and visually-impaired people based on a millimeter wave radar and a traditional white-cane. It not only represents an advanced system able to warn the user of potential obstacles, but also discerns between human and nonhuman targets. Since real scenarios would likely have moving targets, a new range alignment technique has been proposed with the aim of detecting the tiny chest displacement due to the physiological activity as the key sign of the human presence. The proposed system is able to properly recognize humans in complex environments with multiple moving targets, thus providing to the user a complete set of information, namely presence, position and nature of the available targets. The operating principle and the effectiveness of the system are shown both by simulated case studies and by employing a 122 GHz radar board for carrying out suitable measurements.

Among all the road accidents, speeding is the most deadly factor. To reduce speeding, it is essential to devise efficient schemes for ubiquitous speed monitoring. Traditional approaches either suffers from using special equipment or special deployment. In this paper, we propose SpeedTalker, a mobile phone-based approach to perform speed detection on automobiles. SpeedTalker estimates the automobile speed by passively sensing the acoustic and image signals. Specifically, we use the time difference of arrivals (TDOA) model based on acoustic signals to figure out the candidate trajectories of automobile, and use the pin-hole model based on image frames to figure out the vertical distance between the user's position and the automobile's trajectory, thus to estimate the unique trajectory. Besides, we propose a method to effectively mitigate the influence of the movement jitters of mobile phone. We implemented a system prototype for SpeedTalker and estimated the automobile speed with high accuracy. Experiment results show that in the scenario of single automobile, SpeedTalker can achieve an average estimation error of 6.1% compared to radar speed guns. In the scenario of multiple automobiles, SpeedTalker can achieve an average estimation error of 9.8%, which is acceptable for usage.