Search

As a novel data source for earth observation, satellite video can provide large-scale temporal information for dynamic monitoring. However, the cloud occlusion prevents satellite video from continuous and seamless observation of the earth's surface. We propose the first satellite video cloud removal model RFE-VCR to approach this problem. In RFE-VCR, an efficient strategy of taking distant frames into training period is applied. A reference enhance block based on gated aggregation layers is proposed to explore the complementary information hidden in distant frames. A bidirectional local enhance block using deformable convolution is improved for feature refinement. Moreover, a decoupled temporal-spatial transformer is utilized for long-distance dependence modeling. Simulative and real experiments on Jilin-1 satellite videos demonstrate that our proposed network can achieve remarkable performance in video cloud removal task, as well as sensitive object hiding and high-reflection removal. More dynamic results of our experiments can be found at https://xyjin99.github.io/RFE-VCR/. [ABSTRACT FROM AUTHOR]

Video satellites can stare at target areas on the Earth's surface to obtain high-temporal-resolution remote sensing videos, which make it possible to track objects in satellite videos. However, it should be noted that the object size in satellite videos is usually small and has less textural property, and the moving objects in satellite videos are easily occluded, which puts forward higher requirements for the tracker. In order to solve the above problems, consider that the remote sensing image contains rich road information, which can be used to constrain the trajectory of the object in a satellite video, this paper proposes an improved Kernel Correlation Filter (KCF) assisted by road information to track small objects, especially when the object is occluded. Specifically, the contributions of this paper are as follows: First, the tracking confidence module is reconstructed, which integrates the peak response and the average peak correlation energy of the response map to more accurately judge whether the object is occluded. Then, an adaptive Kalman filter is designed to adaptively adjust the parameters of the Kalman filter according to the motion state of the object, which improves the robustness of tracking and reduces the tracking drift after the object is occluded. Last but not least, an object tracking strategy assisted by road information is recommended, which searches for objects with road information as constraints, to locate objects more accurately. After the above improvements, compared with the KCF tracker, our method improves the tracking precision by 35.9% and the tracking success rate by 18.1% with the tracking rate at a speed of 300 frames per second, which meets the real-time requirements. [ABSTRACT FROM AUTHOR]

As a new method of Earth observation, video satellite is capable of monitoring specific events on the Earth’s surface continuously by providing high-temporal resolution remote sensing images. The video observations enable a variety of new satellite applications such as object tracking and road traffic monitoring. In this article, we address the problem of fast object tracking in satellite videos, by developing a novel tracking algorithm based on correlation filters embedded with motion estimations. Based on the kernelized correlation filter (KCF), the proposed algorithm provides the following improvements: 1) proposing a novel motion estimation (ME) algorithm by combining the Kalman filter and motion trajectory averaging and mitigating the boundary effects of KCF by using this ME algorithm and 2) solving the problem of tracking failure when a moving object is partially or completely occluded. The experimental results demonstrate that our algorithm can track the moving object in satellite videos with 95% accuracy. [ABSTRACT FROM AUTHOR]

As a new type of earth observation satellite approach, video satellites can continuously monitor an area of the Earth and acquire dynamic and abundant information by utilizing video imaging. Hence, video satellites can afford to track various objects of interest on the Earth's surface. Inspired by the capabilities of video satellites, this paper presents a novel method to track fast-moving objects in satellite videos based on the kernelized correlation filter (KCF) embedded with multi-feature fusion and motion trajectory compensation. The contributions of the suggested algorithm are multifold. First, a multi-feature fusion strategy is proposed to describe an object comprehensively, which is challenging for the single-feature approach. Second, a subpixel positioning method is developed to calculate the object's position and overcome the poor tracking accuracy difficulties caused by inaccurate object localization. Third, introducing an adaptive Kalman filter (AKF) enables compensation and correction of the KCF tracker results and reduces the object's bounding box drift, solving the moving object occlusion problem. Based on the correlation filtering tracking framework, combined with the above improvement strategies, our algorithm improves the tracking accuracy by at least 17% on average and the success rate by at least 18% on average compared to the KCF algorithm. Hence, our method effectively solves poor object tracking accuracy caused by complex backgrounds and object occlusion. The experimental results utilize satellite videos from the Jilin-1 satellite constellation and highlight the proposed algorithm's appealing tracking results against current state-of-the-art trackers regarding success rate, precision, and robustness metrics. [ABSTRACT FROM AUTHOR]