Search

This paper proposes FAST-LIVO2: a fast, direct LiDAR-inertial-visual odometry framework to achieve accurate and robust state estimation in SLAM tasks and provide great potential in real-time, onboard robotic applications. FAST-LIVO2 fuses the IMU, LiDAR and image measurements efficiently through an ESIKF. To address the dimension mismatch between the heterogeneous LiDAR and image measurements, we use a sequential update strategy in the Kalman filter. To enhance the efficiency, we use direct methods for both the visual and LiDAR fusion, where the LiDAR module registers raw points without extracting edge or plane features and the visual module minimizes direct photometric errors without extracting ORB or FAST corner features. The fusion of both visual and LiDAR measurements is based on a single unified voxel map where the LiDAR module constructs the geometric structure for registering new LiDAR scans and the visual module attaches image patches to the LiDAR points. To enhance the accuracy of image alignment, we use plane priors from the LiDAR points in the voxel map (and even refine the plane prior) and update the reference patch dynamically after new images are aligned. Furthermore, to enhance the robustness of image alignment, FAST-LIVO2 employs an on-demanding raycast operation and estimates the image exposure time in real time. Lastly, we detail three applications of FAST-LIVO2: UAV onboard navigation demonstrating the system's computation efficiency for real-time onboard navigation, airborne mapping showcasing the system's mapping accuracy, and 3D model rendering (mesh-based and NeRF-based) underscoring the suitability of our reconstructed dense map for subsequent rendering tasks. We open source our code, dataset and application on GitHub to benefit the robotics community., Comment: 30 pages, 31 figures, due to the limitation that 'The abstract field cannot exceed 1,920 characters', the abstract presented here is shorter than the one in the PDF file

Temporal misalignment (time offset) between sensors is common in low cost visual-inertial odometry (VIO) systems. Such temporal misalignment introduces inconsistent constraints for state estimation, leading to a significant positioning drift especially in high dynamic motion scenarios. In this article, we focus on online temporal calibration to reduce the positioning drift caused by the time offset for high dynamic motion VIO. For the time offset observation model, most existing methods rely on accurate state estimation or stable visual tracking. For the prediction model, current methods oversimplify the time offset as a constant value with white Gaussian noise. However, these ideal conditions are seldom satisfied in real high dynamic scenarios, resulting in the poor performance. In this paper, we introduce online time offset modeling networks (TON) to enhance real-time temporal calibration. TON improves the accuracy of time offset observation and prediction modeling. Specifically, for observation modeling, we propose feature velocity observation networks to enhance velocity computation for features in unstable visual tracking conditions. For prediction modeling, we present time offset prediction networks to learn its evolution pattern. To highlight the effectiveness of our method, we integrate the proposed TON into both optimization-based and filter-based VIO systems. Simulation and real-world experiments are conducted to demonstrate the enhanced performance of our approach. Additionally, to contribute to the VIO community, we will open-source the code of our method on: https://github.com/Franky-X/FVON-TPN.

In this paper, we propose an Invariant Extended Kalman Filter (IEKF) based Visual-Inertial Odometry (VIO) using multiple features in man-made environments. Conventional EKF-based VIO usually suffers from system inconsistency and angular drift that naturally occurs in feature-based methods. However, in man-made environments, notable structural regularities, such as lines and vanishing points, offer valuable cues for localization. To exploit these structural features effectively and maintain system consistency, we design a right invariant filter-based VIO scheme incorporating point, line, and vanishing point features. We demonstrate that the conventional additive error definition for point features can also preserve system consistency like the invariant error definition by proving a mathematically equivalent measurement model. And a similar conclusion is established for line features. Additionally, we conduct an invariant filter-based observability analysis proving that vanishing point measurement maintains unobservable directions naturally. Both simulation and real-world tests are conducted to validate our methods' pose accuracy and consistency. The experimental results validate the competitive performance of our method, highlighting its ability to deliver accurate and consistent pose estimation in man-made environments., Comment: ROBIO 2023

Invariant Extended Kalman Filter (IEKF) has been successfully applied in Visual-inertial Odometry (VIO) as an advanced achievement of Kalman filter, showing great potential in sensor fusion. In this paper, we propose partial IEKF (PIEKF), which only incorporates rotation-velocity state into the Lie group structure and apply it for Visual-Inertial-Wheel Odometry (VIWO) to improve positioning accuracy and consistency. Specifically, we derive the rotation-velocity measurement model, which combines wheel measurements with kinematic constraints. The model circumvents the wheel odometer's 3D integration and covariance propagation, which is essential for filter consistency. And a plane constraint is also introduced to enhance the position accuracy. A dynamic outlier detection method is adopted, leveraging the velocity state output. Through the simulation and real-world test, we validate the effectiveness of our approach, which outperforms the standard Multi-State Constraint Kalman Filter (MSCKF) based VIWO in consistency and accuracy.

We take a one-dimensional tight binding chain with periodic boundary condition and put a particle in an arbitrary Bloch state, then quench it by suddenly changing the potential of an arbitrary site. In the ensuing time evolution, the probability density of the wave function at an arbitrary site \emph{jumps indefinitely between plateaus}. This phenomenon adds to a former one in which the survival probability of the particle in the initial Bloch state shows \emph{cusps} periodically, which was found in the same scenario [Zhang J. M. and Yang H.-T., EPL, \textbf{114} (2016) 60001]. The plateaus support the scattering wave picture of the quench dynamics of the Bloch state. Underlying the cusps and jumps is the exactly solvable, nonanalytic dynamics of a Luttinger-like model, based on which, the locations of the jumps and the heights of the plateaus are accurately predicted., Comment: final version

We report some nonsmooth dynamics of a Bloch state in a one-dimensional tight binding model with the periodic boundary condition. After a sudden change of the potential of an arbitrary site, quantities like the survival probability of the particle in the initial Bloch state show cusps periodically, with the period being the Heisenberg time associated with the energy spectrum. This phenomenon is a \emph{nonperturbative} counterpart of the nonsmooth dynamics observed previously (Zhang and Haque, arXiv:1404.4280) in a periodically driven tight binding model. Underlying the cusps is an exactly solvable model, which consists of equally spaced levels extending from $-\infty$ to $+\infty $, between which two arbitrary levels are coupled to each other by the same strength., Comment: Some notes are added in retrospect

It is well known that an eddy current will be induced in a conductor subject to a varying magnetic field. Here we propose another mechanism of generating nano-scale eddy current in rippled graphene nanoribbons(GNRs), which is only driven by an electric potential. In particular, it is found that under appropriate gate voltages, a local deformation may induce some unexpected global eddy currents, which form vortices in both rippled and entire flat areas of the GNR. We will explain that these vortices in flat areas is a manifestation of the nonlocality of quantum interference., Comment: 6 pages, 5 figues

We propose that the strain induced effective pseudo-magnetic field in graphene can also be explained by a curl movement of the Dirac points, if the Dirac points can be regarded as a slowly varying function of position. We also prove that the Dirac points must be confined within two triangles, each one has 1/8 the area of the Brillouin zone., Comment: 4 pages, 5 figures

Some exact identities connecting the one- and two-particle Green's functions in the presence of spin-orbit coupling have been derived. These identities is similar to the usual Ward identity in the particle or charge transport theory and a satisfying spin transport theory in spin-orbit coupling system should also preserve these identities., Comment: 6 pages

In this paper, using the database of the university of Michigan Radio Astronomy Observatory (UMRAO) at three (4.8 GHz, 8 GHZ, and 14.5 GHz) radio frequencies, we studied the polarization properties for 47 BL Lacertae objects(38 radio selected BL Lacertae objects, 7 X-ray selected BL Lacertae, and two inter-middle objects (Mkn 421 and Mkn 501), and found that (1) The polarizations at higher radio frequency is higher than those at lower frequency, (2) The variability of polarization at higher radio frequency is higher than those at lower frequency, (3) The polarization is correlated with the radio spectral index, and (4) The polarization is correlated with core-dominance parameter for those objects with known core-dominance parameters suggesting that the relativistic beaming could explain the polarization characteristic of BL Lacs., Comment: 5 pages, 3 figures, 1 table. PASJ, in press

By generalizing the usual current density to a matrix with respect to spin variables, a general equation of continuity satisfied by the density matrix and current density matrix has been derived. This equation holds in arbitrary spin-orbit coupling systems as long as its Hamiltonian can be expressed in terms of a power series in momentum. Thereby, the expressions of the current density matrix and a torque density matrix are obtained. The current density matrix completely describes both the usual current and spin current as well; while the torque density matrix describes the spin precession caused by a total effective magnetic field, which may include a realistic and an effective one due to the spin-orbit coupling. In contrast to the conventional definition of spin current, this expression contains an additional term if the Hamiltonian includes nonlinear spin-orbit couplings. Moreover, if the degree of the full Hamiltonian $\geq3$, then the particle current must also be modified in order to satisfy the local conservation law of number., Comment: 9 pages