Search

Pose estimation is a particularly important link in the task of robotic bin-picking. Its purpose is to obtain the 6D pose (3D position and 3D posture) of the target object. In real bin-picking scenarios, noise, overlap, and occlusion affect accuracy of pose estimation and lead to failure in robot grasping. In this paper, a new point-pair feature (PPF) descriptor is proposed, in which curvature information of point-pairs is introduced to strengthen feature description, and improves the point cloud matching rate. The proposed method also introduces an effective point cloud preprocessing, which extracts candidate targets in complex scenarios, and, thus, improves the overall computational efficiency. By combining with the curvature distribution, a weighted voting scheme is presented to further improve the accuracy of pose estimation. The experimental results performed on public data set and real scenarios show that the accuracy of the proposed method is much higher than that of the existing PPF method, and it is more efficient than the PPF method. The proposed method can be used for robotic bin-picking in real industrial scenarios. [ABSTRACT FROM AUTHOR]

Feature point detection is the basis of computer vision, and the detection methods with geometric invariance and illumination invariance are the key and difficult problem in the field of feature detection. This paper proposes an illumination-invariant feature point detection method based on neighborhood information. The method can be summarized into two steps. Firstly, the feature points are divided into eight types according to the number of connected neighbors. Secondly, each type of feature points is classified again according to the position distribution of neighboring pixels. The theoretical deduction proves that the proposed method has lower computational complexity than other methods. The experimental results indicate that, when the photometric variation of the two images is very large, the feature-based detection methods are usually inferior, while the learning-based detection methods performs better. However, our method performs better than the learning-based detection method in terms of the number of feature points, the number of matching points, and the repeatability rate stability. The experimental results demonstrate that the proposed method has the best illumination robustness among state-of-the-art feature detection methods. [ABSTRACT FROM AUTHOR]

Capturing high-quality images via mobile devices in low-light or backlighting conditions is very challenging. In this paper, a new, single image brightening algorithm is proposed to enhance an image captured in low-light conditions. Two virtual images with larger exposure times are generated to increase brightness and enhance fine details of the underexposed regions. In order to reduce the brightness change, the virtual images are generated via intensity mapping functions (IMFs) which are computed using available camera response functions (CRFs). To avoid possible color distortion in the virtual image due to one-to-many mapping, a least square minimization problem is formulated to determine brightening factors for all pixels in the underexposed regions. In addition, an edge-preserving smoothing technique is adopted to avoid noise in the underexposed regions from being amplified in the virtual images. The final brightened image is obtained by fusing the original image and two virtual images via a gradient domain guided image filtering (GGIF) based multiscale exposure fusion (MEF) with properly defined weights for all the images. Experimental results show that the relative brightness and color are preserved better by the proposed algorithm. The details in bright regions are also preserved well in the final image. The proposed algorithm is expected to be useful for computational photography on smart phones. [ABSTRACT FROM AUTHOR]

Geometric model fitting is a fundamental issue in computer vision, and the fitting accuracy is affected by outliers. In order to eliminate the impact of the outliers, the inlier threshold or scale estimator is usually adopted. However, a single inlier threshold cannot satisfy multiple models in the data, and scale estimators with a certain noise distribution model work poorly in geometric model fitting. It can be observed that the residuals of outliers are big for all true models in the data, which makes the consensus of the outliers. Based on this observation, we propose a preference analysis method based on residual histograms to study the outlier consensus for outlier detection in this paper. We have found that the outlier consensus makes the outliers gather away from the inliers on the designed residual histogram preference space, which is quite convenient to separate outliers from inliers through linkage clustering. After the outliers are detected and removed, a linkage clustering with permutation preference is introduced to segment the inliers. In addition, in order to make the linkage clustering process stable and robust, an alternative sampling and clustering framework is proposed in both the outlier detection and inlier segmentation processes. The experimental results also show that the outlier detection scheme based on residual histogram preference can detect most of the outliers in the data sets, and the fitting results are better than most of the state-of-the-art methods in geometric multi-model fitting. [ABSTRACT FROM AUTHOR]

Calibration is a critical step for the phase measuring deflectometry system. Existing calibration methods are mainly optimizing the calibration parameters with respect to the 2D re-projection error criterion. However, such a procedure cannot reduce metric errors in the practical application. Therefore, an accurate and practical calibration method is proposed. In which, conventional calibration means is first applied for the primary calibration. Then, a precise square planar mirror is used for the optimization of system calibration parameters. All the intrinsic and extrinsic parameters are considered as a global multi-objective optimization problem. Three metric error criteria are introduced to evaluate the 3D reconstruction accuracy of the reference mirror. Compared with classical calibration means, which apply the parameter optimization in 2D image space to minimize the re-projection errors, the proposed optimization approach is executed in 3D space directly. An experiment and comparison are conducted to verify that the proposed optimal calibration approach can effectively reduce the system deviation and to improve the system measurement accuracy. [ABSTRACT FROM AUTHOR]

Estimating the Direction of Arrival (DOA) is a basic and crucial problem in array signal processing. The existing DOA methods fail to obtain reliable and accurate results when noise and reverberation occur in real applications. In this paper, an accurate and robust estimation method for estimating the DOA of sources signal is proposed. Incorporating the Estimating Signal Parameters via Rotational Invariance Techniques (ESPRIT) algorithm with the RANdom SAmple Consensus (RANSAC) algorithm gives rise to the RAN-ESPRIT method, which removes outliers automatically in noise-corrupted environments. In this work, a uniform circular array (UCA) is converted into a virtual uniform linear array (ULA) to begin with. Then, the covariance matrix of the received signals of the virtual linear array is reconstructed, and the ESPRIT algorithm is deployed to estimate initial DOA of the source signal. Finally, the modified RANSAC method with automatically selected thresholds is used to fit the source signal to obtain accurate DOA. The proposed method can remove the unreliable DOA feature data and leads to more accuracy of DOA estimation of source signals in reverberation environments. Experimental results demonstrate that the proposed method is more robust and efficient compared to the traditional methods (i.e., ESPRIT, TLS-ESPRIT). [ABSTRACT FROM AUTHOR]