Search

The paper presents a study of existing Block Matching Optical Flow algorithms, which estimate the motion from an image sequence. The seven algorithms selected for our performance and comparative study (ES, TSS, SETSS, NTSS, FSS, DS and ARPS) are finding a minimum cost match between the current image reference block and one of the considered blocks in the next image. The benchmark used for the performance testing was the Middlebury Dataset, with the conclusions leading to a parameters and algorithm selection criteria. [ABSTRACT FROM AUTHOR]

In this paper, we present a frame rate upconversion method using optical flow motion estimation and a patch-based reconstruction scheme. First, forward and backward motion vectors (MVs) are obtained using an optical flow algorithm, and reconstructed versions of the current and previous frames are generated by our patch-based reconstruction scheme. Using the original and reconstructed versions of the current and previous frames, two mismatch masks are obtained. Then, two versions of the middle frame are generated using a patch-based scheme, with estimated MVs and the current and previous frames. Finally, a middle mask, which identifies the mismatch areas of the two middle frames, is reconstructed. Using these three masks, the best candidates for interpolation are selected and fused to obtain the final middle frame. Due to the patch-based nature of our reconstruction scheme, most of the holes and cracks will be filled. Although there is always a probability of having holes, the size and number of such holes are much smaller than those that would be generated using pixel-based mapping. The rare holes are filled using existing hole-filling algorithms. The experimental results and a comparison of our method with existing algorithms show that our method performs better in terms of both objective and subjective quality of the final interpolated frames. The average peak signal-to-noise ratio (PSNR) improvement of our method is 1–2 dB. [ABSTRACT FROM AUTHOR]

Lots of optical flow methods are based on coarse-to-fine strategy. However, most of coarse-to-fine optical flow techniques face two important problems: namely (1) large displacements of small structures are usually estimated in an incorrect manner and (2) large affine motions of non-rigid objects cannot be computed accurately. In this paper, we present an optical flow computation methodology that integrates robust point matching into a variational optical flow model to deal with the above-mentioned difficulties. Experimental results are demonstrated for a variety of image sequences to validate the effectiveness. [ABSTRACT FROM AUTHOR]

We present an algorithm that simultaneously computes optical flow and estimates illumination change from an image sequence in a unified framework. We propose an energy functional consisting of conventional optical flow energy based on Horn-Schunck method and an additional constraint that is designed to compensate for illumination changes. Any undesirable illumination change that occurs in the imaging procedure in a sequence while the optical flow is being computed is considered a nuisance factor. In contrast to the conventional optical flow algorithm based on Horn-Schunck functional, which assumes the brightness constancy constraint, our algorithm is shown to be robust with respect to temporal illumination changes in the computation of optical flows. An efficient conjugate gradient descent technique is used in the optimization procedure as a numerical scheme. The experimental results obtained from the Middlebury benchmark dataset demonstrate the robustness and the effectiveness of our algorithm. In addition, comparative analysis of our algorithm and Horn-Schunck algorithm is performed on the additional test dataset that is constructed by applying a variety of synthetic bias fields to the original image sequences in the Middlebury benchmark dataset in order to demonstrate that our algorithm outperforms the Horn-Schunck algorithm. The superior performance of the proposed method is observed in terms of both qualitative visualizations and quantitative accuracy errors when compared to Horn-Schunck optical flow algorithm that easily yields poor results in the presence of small illumination changes leading to violation of the brightness constancy constraint. [ABSTRACT FROM AUTHOR]

Fluid motion estimation from time-sequenced images is a significant image analysis task. Its application is widespread in experimental fluidics research and many related areas like biomedical engineering and atmospheric sciences. In this paper, we present a novel flow computation framework to estimate the flow velocity vectors from two consecutive image frames. In an energy minimization-based flow computation, we propose a novel data fidelity term, which: 1) can accommodate various measures, such as cross-correlation or sum of absolute or squared differences of pixel intensities between image patches; 2) has a global mechanism to control the adverse effect of outliers arising out of motion discontinuities, proximity of image borders; and 3) can go hand-in-hand with various spatial smoothness terms. Further, the proposed data term and related regularization schemes are both applicable to dense and sparse flow vector estimations. We validate these claims by numerical experiments on benchmark flow data sets. [ABSTRACT FROM AUTHOR]

Abstract: This work presents a new method for motion estimation of tagged cardiac magnetic resonance sequences based on variational techniques. The variational method has been improved by adding a new term in the optical flow equation that incorporates tracking points with high stability of phase. Results were obtained through simulated and real data, and were validated by manual tracking and with respect to a reference state-of-the-art method: harmonic phase imaging (HARP). The error, measured in pixels per frame, obtained with the proposed variational method is one order of magnitude smaller than the one achieved by the reference method, and it requires a lower computational cost. [Copyright &y& Elsevier]

We propose a temporal modeling approach for determining image motion from a sequence of images wherein the inherent motion is periodic over time. To exploit the periodic nature of the motion, we use a Fourier harmonic representation model the temporal evolution of the motion field for the entire sequence. We then determine the motion field simultaneously for the different image frames by estimating the parameters of this representation model, where the model order in the Fourier representation serves as a regularization parameter on the temporal coherence of the motion field. This approach can take advantage of the statistics of all the available data in the image sequence. In our experiments, we tested the proposed approach on several motion types at different noise levels, including translational motion, convergent/ divergent motion, and cardiac motion. Our results demonstrate that this approach could lead to more robust estimation the motion field in the presence of strong imaging noise compared to a frame-by-frame estimation approach. [ABSTRACT FROM AUTHOR]

Optical flow can be reliably estimated between areas visible in two images, but not in occlusion areas. If optical flow is needed in the whole image domain, one approach is to use additional views of the same scene. If such views are unavailable, an often-used alternative is to extrapolate optical flow in occlusion areas. Since the location of such areas is usually unknown prior to optical flow estimation, this is usually performed in three steps. First, occlusion-ignorant optical flow is estimated, then occlusion areas are identified using the estimated (unreliable) optical flow, and, finally, the optical flow is corrected using the computed occlusion areas. This approach, however, does not permit interaction between optical flow and occlusion estimates. In this paper, we permit such interaction by proposing a variational formulation that jointly computes optical flow, implicitly detects occlusions and extrapolates optical flow in occlusion areas. The extrapolation mechanism is based on anisotropic diffusion and uses the underlying image gradient to preserve structure, such as optical flow discontinuities. Our results show significant improvements in the computed optical flow fields over other approaches, both qualitatively and quantitatively. [ABSTRACT FROM AUTHOR]

A fast method for accurate measurement of displacement field that combines template matching and differential techniques is proposed. This method, which is able to deal with the problems of non-rigid object movement as well as large inter frame displacements, operates in three steps. First, a sparse displacement field is obtained by a classic template matching technique. Then, this information is propagated through the overall image to obtain a dense displacement field. Finally, this field is considered as approximate solution before the use of classical differential technique for optical flow estimation. To illustrate the efficiency of the proposed procedure, a number of experimental results using both synthetic and real images are presented and discussed. The results show significant improvement over those obtained using standard multigrid approaches, especially in the cases of textured, very structured images or large inter frame displacements. [Copyright &y& Elsevier]