Search

In this paper, we present a noise-robust approach for the 3D pose estimation of multiple people using appearance similarity. The common methods identify the cross-view correspondences between the detected keypoints and determine their association with a specific person by measuring the distances between the epipolar lines and the joint locations of the 2D keypoints across all the views. Although existing methods achieve remarkable accuracy, they are still sensitive to camera calibration, making them unsuitable for noisy environments where any of the cameras slightly change angle or position. To address these limitations and fix camera calibration error in real-time, we propose a framework for 3D pose estimation which uses appearance similarity. In the proposed framework, we detect the 2D keypoints and extract the appearance feature and transfer it to the central server. The central server uses geometrical affinity and appearance similarity to match the detected 2D human poses to each person. Then, it compares these two groups to identify calibration errors. If a camera with the wrong calibration is identified, the central server fixes the calibration error, ensuring accuracy in the 3D reconstruction of skeletons. In the experimental environment, we verified that the proposed algorithm is robust against false geometrical errors. It achieves around 11.5% and 8% improvement in the accuracy of 3D pose estimation on the Campus and Shelf datasets, respectively. [ABSTRACT FROM AUTHOR]

The StarDICE experiment strives to establish an instrumental metrology chain with a targeted accuracy of 1 mmag in griz bandpasses to meet the calibration requirements of next-generation cosmological surveys. Atmospheric transmission is a significant source of systematic uncertainty. We propose a solution relying on an uncooled infrared thermal camera to evaluate gray extinction variations. However, achieving accurate measurements with thermal imaging systems necessitates prior calibration due to temperature-induced effects, compromising their spatial and temporal precision. Moreover, these systems cannot provide scene radiance in physical units by default. This study introduces a new calibration process utilizing a tailored forward modeling approach. The method incorporates sensor, housing, flat-field support, and ambient temperatures, along with raw digital response, as input data. Experimental measurements were conducted inside a climatic chamber, with a FLIR Tau2 camera imaging a thermoregulated blackbody source. The results demonstrate the calibration effectiveness, achieving precise radiance measurements with a temporal pixel dispersion of 0.09 W   m − 2   sr − 1 and residual spatial noise of 0.03 W   m − 2   sr − 1 . We emphasize that the accuracy of scene radiance retrieval can be systematically affected by the camera's close thermal environment, especially when the ambient temperature exceeds that of the scene. [ABSTRACT FROM AUTHOR]

This work focuses on investigating the accuracy of 3D reconstructions from fixed stereo-photogrammetric monitoring systems through different camera calibration procedures. New reliable and effective calibration methodologies that require minimal effort and resources are presented. A full-format camera equipped with fixed 50 and 85 mm focal length optics is considered, but the methodologies are general and can be applied to other systems. Four different calibration strategies are considered: (i) full-field calibration (FF); (ii) multi-image on-the-job calibration (MI); (iii) point cloud-based calibration (PC); and (iv) self (on-the-job) calibration (SC). To evaluate the calibration strategies and assess their actual performance and practicality, two test sites are used. The full-field calibration, while very reliable, demands significant effort if it needs to be repeated. The multi-image strategy emerges as a favourable compromise, offering good results with minimal effort for its realisation. The point cloud-based method stands out as the optimal choice, balancing ease of implementation with quality results; however, it requires a reference 3D point cloud model. On-the-job calibration with monitoring images is the simplest but least reliable option, prone to uncertainty and potential inaccuracies, and should hence be avoided. Ultimately, prioritising result reliability over absolute accuracy is paramount in continuous monitoring systems. [ABSTRACT FROM AUTHOR]

For mobile robots, the high-precision integrated calibration and structural robustness of multi-sensor systems are important prerequisites for ensuring healthy operations in the later stage. Currently, there is no well-established validation method for the calibration accuracy and structural robustness of multi-sensor systems, especially for dynamic traveling situations. This paper presents a novel validation method for the calibration accuracy and structural robustness of a multi-sensor mobile robot. The method employs a ground–object–air cooperation mechanism, termed the "ground surface simulation field (GSSF)—mobile robot -photoelectric transmitter station (PTS)". Firstly, a static high-precision GSSF is established with the true north datum as a unified reference. Secondly, a rotatable synchronous tracking system (PTS) is assembled to conduct real-time pose measurements for a mobile vehicle. The relationship between each sensor and the vehicle body is utilized to measure the dynamic pose of each sensor. Finally, the calibration accuracy and structural robustness of the sensors are dynamically evaluated. In this context, epipolar line alignment is employed to assess the accuracy of the evaluation of relative orientation calibration of binocular cameras. Point cloud projection and superposition are utilized to realize the evaluation of absolute calibration accuracy and structural robustness of individual sensors, including the navigation camera (Navcam), hazard avoidance camera (Hazcam), multispectral camera, time-of-flight depth camera (TOF), and light detection and ranging (LiDAR), with respect to the vehicle body. The experimental results demonstrate that the proposed method offers a reliable means of dynamic validation for the testing phase of a mobile robot. [ABSTRACT FROM AUTHOR]

As on-orbit space cameras evolve toward larger apertures, wider fields of view, and deeper cryogenic environments, achieving absolute radiometric calibration using an all-optical path blackbody reference source in orbit becomes increasingly challenging. Consequently, stars have emerged as a novel in-orbit standard source. However, due to differences in camera bands, directly obtaining the stellar radiance flux corresponding to specific camera bands is not feasible. In order to address this challenge, we propose a method for estimating radiance flux based on the MSX star catalog, which integrates a dual-band thermometry method with an improved grey wolf optimization (I-GWO) algorithm. In an experiment, we analyzed 351 stars with temperatures ranging from 4000 to 7000 K. The results indicate that our method achieved a temperature estimation accuracy of less than 10% for 83.5% of the stars, with an average estimation error of 5.82%. Compared with previous methods based on star catalogs, our approach significantly enhanced the estimation accuracy by 75.4%, improved algorithm stability by 91.3%, and reduced the computation time to only 3% of that required by other methods. Moreover, the on-orbit star calibration error using our stellar radiance flux estimation method remained within 5%. This study effectively leveraged the extensive data available in star catalogs, providing substantial support for the development of an infrared star calibration network, which holds significant value for the in-orbit calibration of large-aperture cameras. Future research will explore the potential applicability of this method across different spectral bands. [ABSTRACT FROM AUTHOR]

The precise calibration of a LiDAR-camera system is a crucial prerequisite for multimodal 3D information fusion in perception systems. The accuracy and robustness of existing traditional offline calibration methods are inferior to methods based on deep learning. Meanwhile, most parameter regression-based online calibration methods directly project LiDAR data onto a specific plane, leading to information loss and perceptual limitations. A novel network, DPCalib, a dual perspective view network that mitigates the aforementioned issue, is proposed in this paper. This paper proposes a novel neural network architecture to achieve the fusion and reuse of input information. We design a feature encoder that effectively extracts features from two orthogonal views using attention mechanisms. Furthermore, we propose an effective decoder that aggregates features from two views, thereby obtaining accurate extrinsic parameter estimation outputs. The experimental results demonstrate that our approach outperforms existing SOTA methods, and the ablation experiments validate the rationality and effectiveness of our work. [ABSTRACT FROM AUTHOR]

The precision requirements for aeroengine blade machining are exceedingly stringent. This study aims to improve the accuracy of existing aeroengine blade measurement methods while achieving comprehensive measurement. Therefore, this study proposes a new concentric ring calibration method and designs a multi-layer concentric ring calibration plate. The effectiveness of this calibration method was verified through actual testing of standard ball gauges. Compared with the checkerboard-grid calibration method, the average deviation of the multilayer concentric ring calibration method for measuring the center distance of the standard sphere is 0.02352, which improves the measurement accuracy by 3–4 times. On the basis of multi-layer concentric ring calibration, this study builds a fringe projection profiler based on the three-frequency twelve-step phase shift method. Compared with the CMM, the average deviation of the blade chord length measured by this solution is 0.064, which meets the measurement index requirements of aeroengine fan blades. [ABSTRACT FROM AUTHOR]

Currently, 3D reconstruction methods in structured light are generally implemented in a pre-calibrated area. To realize a full-field reconstruction, the calibration plate can be moved to multiple positions in a time-consuming manner, or the whole field can be calibrated with the help of a large calibration plate, which is more costly. In this paper, we address this problem by proposing a method for obtaining a global phase-angle model under a locally calibrated region, and based on this relationship, we investigate and analyze the reconstruction inside and outside of the calibrated zone. The results show that the method can reconstruct the object outside of the calibration zone completely, and can keep the planarity error around 0.1 mm and the sphericity error below 0.06 mm. The method only requires local calibration of the projected fringes at the two calibration positions to realize the 3D reconstruction of the full-field, which makes the method more advantageous. [ABSTRACT FROM AUTHOR]

Pedestrian Dead Reckoning (PDR) is a promising algorithm for indoor positioning. However, the accuracy of PDR degrades due to the accumulated error, especially in multi-floor buildings. This paper introduces a three-dimensional (3D) positioning method based on terrain feature matching to reduce the influence of accumulated errors in multi-floor scenes. The proposed calibration method involves two steps: motion pattern recognition and position matching-based calibration. The motion pattern recognition aims to detect different motion patterns, i.e., taking the stairs or horizontal walking, from the streaming data. Then, stair entrances and corridor corners are matched with transition points of motion patterns and pedestrian turning points, respectively. After matching, calibration is performed to eliminate the accumulated errors. By carrying out experiments on a two-floor closed-loop path with a walking distance about 145 m, it is shown that this method can effectively reduce the accumulated error of PDR, achieving accurate 3D positioning. The average error is reduced from 6.60 m to 1.37 m. [ABSTRACT FROM AUTHOR]

Optical 3D scanning applications are increasingly used in various medical fields. Setups involving multiple adjustable systems require repeated extrinsic calibration between patients. Existing calibration solutions are either not applicable to the medical field or require a time-consuming process with multiple captures and target poses. Here, we present an application with a 3D checkerboard (3Dcb) for extrinsic calibration with a single capture. The 3Dcb application can register captures with a reference to validate measurement quality. Furthermore, it can register captures from camera pairs for point-cloud stitching of static and dynamic scenes. Registering static captures from TIDA-00254 to its reference from a Photoneo MotionCam-3D resulted in an error (root mean square error ± standard deviation) of 0.02 mm ± 2.9 mm. Registering a pair of Photoneo MotionCam-3D cameras for dynamic captures resulted in an error of 2.2 mm ± 1.4 mm. These results show that our 3Dcb implementation provides registration for static and dynamic captures that is sufficiently accurate for clinical use. The implementation is also robust and can be used with cameras with comparatively low accuracy. In addition, we provide an extended overview of extrinsic calibration approaches and the application's code for completeness and service to fellow researchers. [ABSTRACT FROM AUTHOR]

A concentric circle target is commonly used in the vision measurement system for its detection accuracy and robustness. To enhance the camera calibration accuracy, this paper proposes an improved calibration method that utilizes concentric circle grids as the calibration target. The method involves accurately locating the imaged center and optimizing camera parameters. The imaged concentric circle center obtained by cross-ratio invariance is not affected by perspective projection, which ensures the location accuracy of the feature point. Subsequently, the impact of lens distortion on camera calibration is comprehensively investigated. The sub-pixel coordinates of imaged centers are taken into the iterative calibration method, and camera parameters are updated. Through simulations and real experiments, the proposed method effectively reduces the residual error and improves the accuracy of camera parameters. [ABSTRACT FROM AUTHOR]

Previous camera self-calibration methods have exhibited certain notable shortcomings. On the one hand, they either exclusively emphasized scene cues or solely focused on vehicle-related cues, resulting in a lack of adaptability to diverse scenarios and a limited number of effective features. Furthermore, these methods either solely utilized geometric features within traffic scenes or exclusively extracted semantic information, failing to comprehensively consider both aspects. This limited the comprehensive feature extraction from scenes, ultimately leading to a decrease in calibration accuracy. Additionally, conventional vanishing point-based self-calibration methods often required the design of additional edge-background models and manual parameter tuning, thereby increasing operational complexity and the potential for errors. Given these observed limitations, and in order to address these challenges, we propose an innovative roadside camera self-calibration model based on the Transformer architecture. This model possesses a unique capability to simultaneously learn scene features and vehicle features within traffic scenarios while considering both geometric and semantic information. Through this approach, our model can overcome the constraints of prior methods, enhancing calibration accuracy and robustness while reducing operational complexity and the potential for errors. Our method outperforms existing approaches on both real-world dataset scenarios and publicly available datasets, demonstrating the effectiveness of our approach. [ABSTRACT FROM AUTHOR]

Traditional non-coplanar calibration methods, represented by Tsai's method, are difficult to apply in multi-camera-based stereo vision measurements because of insufficient calibration accuracy, inconvenient operation, etc. Based on projective theory and matrix transformation theory, a novel mathematical model is established to characterize the transformation from targets' 3D affine coordinates to cameras' image coordinates. Then, novel non-coplanar calibration methods for both monocular and binocular camera systems are proposed in this paper. To further improve the stability and accuracy of calibration methods, a novel circular feature points extraction method based on region Otsu algorithm and radial section scanning method is proposed to precisely extract the circular feature points. Experiments verify that our novel calibration methods are easy to operate, and have better accuracy than several classical methods, including Tsai's and Zhang's methods. Intrinsic and extrinsic parameters of multi-camera-systems can be calibrated simultaneously by our methods. Our novel circular feature points extraction algorithm is stable, and with high precision can effectively improve calibration accuracy for coplanar and non-coplanar methods. Real stereo measurement experiments demonstrate that the proposed calibration method and feature extraction method have high accuracy and stability, and can further serve for complicated shape and deformation measurements, for instance, stereo-DIC measurements, etc. [ABSTRACT FROM AUTHOR]

Spatial frequency domain imaging (SFDI) is well established in biology and medicine for non-contact, wide-field imaging of optical properties and 3D topography. Especially for turbid media with displaced, tilted or irregularly shaped surfaces, the reliable quantitative measurement of diffuse reflectance requires efficient calibration and correction methods. In this work, we present the implementation of a generic and hardware independent calibration routine for SFDI setups based on the so-called pinhole camera model for both projection and detection. Using a two-step geometric and intensity calibration, we obtain an imaging model that efficiently and accurately determines 3D topography and diffuse reflectance for subsequently measured samples, taking into account their relative distance and orientation to the camera and projector, as well as the distortions of the optical system. Derived correction procedures for position- and orientation-dependent changes in spatial frequency and intensity allow the determination of the effective scattering coefficient μ s ′ and the absorption coefficient μ a when measuring a spherical optical phantom at three different measurement positions and at nine wavelengths with an average error of 5% and 12%, respectively. Model-based calibration allows the characterization of the imaging properties of the entire SFDI system without prior knowledge, enabling the future development of a digital twin for synthetic data generation or more robust evaluation methods. [ABSTRACT FROM AUTHOR]

Combining the drilling method with the digital image correlation (DIC) method is becoming more common to speed up the measurement and evaluate the strains relieved at several locations. However, to obtain the most accurate results, it is necessary to be aware of the influence of possible aspects that could adversely affect the results of the strain/stress analysis carried out using DIC. The paper describes several analyses to assess the influence of the 3D DIC system's calibration procedure for strain/stress analysis of the specimen with a hole loaded with four different levels of tensile force. In addition, the paper also deals with the analysis of the influence of the image brightness, which was modified by changing the exposure time of the cameras. Based on the results of strain/stress analyses performed on small areas (approx. 25 × 25 mm) of a specimen with a hole by a stereo-camera DIC system, it can be concluded that both analysed factors can negatively influence the results. The most accurate results are ensured using the calibration target of very high manufacturing precision sized similarly to the field of view observed in correlation mode. The optimal image brightness is adjusted when the mean grey value of the image is from the range of 56 up to 171 with as evenly distributed image point intensities as possible. [ABSTRACT FROM AUTHOR]

Assistance systems utilize a broad range of technologies to provide information and guidance to workers in manufacturing. The use of light projectors, as of today, has seldom been catalogued in the relevant literature, and the implementation of such is yet to be found in production environments. However, light projectors may offer a cost effective enhancement for production processes, especially within the context of large-scale workpieces. Of the pertaining literature, only one calibration algorithm is currently considered applicable, thus acting as a framework of motivation for this paper. A novel calibration algorithm based on Newton's method is presented and validated in conjunction with a proof-of-concept demonstration of the resulting accuracy, as well as the integration of such into an interface based on Node-RED, with MQTT as the main protocol. [ABSTRACT FROM AUTHOR]

Multi-camera systems are an effective solution for perceiving large areas or complex scenarios with many occlusions. In such a setup, an accurate camera network calibration is crucial in order to localize scene elements with respect to a single reference frame shared by all the viewpoints of the network. This is particularly important in applications such as object detection and people tracking. Multi-camera calibration is a critical requirement also in several robotics scenarios, particularly those involving a robotic workcell equipped with a manipulator surrounded by multiple sensors. Within this scenario, the robot-world hand-eye calibration is an additional crucial element for determining the exact position of each camera with respect to the robot, in order to provide information about the surrounding workspace directly to the manipulator. Despite the importance of the calibration process in the two scenarios outlined above, namely (i) a camera network, and (ii) a camera network with a robot, there is a lack of standard datasets available in the literature to evaluate and compare calibration methods. Moreover they are usually treated separately and tested on dedicated setups. In this paper, we propose a general standard dataset acquired in a robotic workcell where calibration methods can be evaluated in two use cases: camera network calibration and robot-world hand-eye calibration. The Multi-Eye To Robot Indoor Calibration (METRIC) dataset consists of over 10,000 synthetic and real images of ChAruCo and checkerboard patterns, each one rigidly attached to the robot end-effector, which was moved in front of four cameras surrounding the manipulator from different viewpoints during the image acquisition. The real images in the dataset includes several multi-view image sets captured by three different types of sensor networks: Microsoft Kinect V2, Intel RealSense Depth D455 and Intel RealSense Lidar L515, to evaluate their advantages and disadvantages for calibration. Furthermore, in order to accurately analyze the effect of camera-robot distance on calibration, we acquired a comprehensive synthetic dataset, with related ground truth, with three different camera network setups corresponding to three levels of calibration difficulty depending on the cell size. An additional contribution of this work is to provide a comprehensive evaluation of state-of-the-art calibration methods using our dataset, highlighting their strengths and weaknesses, in order to outline two benchmarks for the two aforementioned use cases. [ABSTRACT FROM AUTHOR]

In the vision-based inspection of specular or shiny surfaces, we often compute the camera pose with respect to a reference plane by analyzing images of calibration grids, reflected in such a surface. To obtain high precision in camera calibration, the calibration target should be large enough to cover the whole field of view (FOV). For a camera with a large FOV, using a small target can only obtain a locally optimal solution. However, using a large target causes many difficulties in making, carrying, and employing the large target. To solve this problem, an improved calibration method based on coplanar constraint is proposed for a camera with a large FOV. Firstly, with an auxiliary plane mirror provided, the positions of the calibration grid and the tilt angles of the plane mirror are changed several times to capture several mirrored calibration images. Secondly, the initial parameters of the camera are calculated based on each group of mirrored calibration images. Finally, adding with the coplanar constraint between each group of calibration grid, the external parameters between the camera and the reference plane are optimized via the Levenberg-Marquardt algorithm (LM). The experimental results show that the proposed camera calibration method has good robustness and accuracy. [ABSTRACT FROM AUTHOR]

A remote sensing (RS) platform consisting of a remote-controlled aerial vehicle (RAV) can be used to monitor crop, environmental conditions, and productivity in agricultural areas. However, the current methods for the calibration of RAV-acquired images are cumbersome. Thus, a calibration method must be incorporated into RAV RS systems for practical and advanced applications. Here, we aimed to develop a standalone RAV RS-based calibration system without the need for calibration tarpaulins (tarps) by quantifying the sensor responses of a multispectral camera, which varies with light intensities. To develop the standalone RAV-based RS calibration system, we used a quadcopter with four propellers, with a rotor-to-rotor length of 46 cm and height of 25 cm. The quadcopter equipped with a multispectral camera with green, red, and near-infrared filters was used to acquire spectral images for formulating the RAV RS-based standardization system. To perform the calibration study process, libraries of sensor responses were constructed using pseudo-invariant tarps according to the light intensities to determine the relationship equations between the two factors. The calibrated images were then validated using the reflectance measured in crop fields. Finally, we evaluated the outcomes of the formulated RAV RS-based calibration system. The results of this study suggest that the standalone RAV RS system would be helpful in the processing of RAV RS-acquired images. [ABSTRACT FROM AUTHOR]

Calibration of the stereo vision systems is a crucial step for precise 3D measurements. Restricted by the outdoors' large field of view (FOV), the conventional method based on precise calibration boards is not suitable since the calibration process is time consuming and the calibration accuracy is not guaranteed. In this paper, we propose a calibration method for estimating the extrinsic parameters of the stereo vision system aided by an inclinometer and a range sensor. Through the parameters given by the sensors, the initial rotation angle of the extrinsic parameters and the translation vector are pre-established by solving a set of linear equations. The metric scale of the translation vector is determined by the baseline length provided by the range sensor or GNSS signals. Finally, the optimal extrinsic parameters of the stereo vision systems are obtained by nonlinear optimization of inverse depth parameterization. The most significant advantage of this method is that it enhances the capability of the stereo vision measurement in the outdoor environment, and can achieve fast and accurate calibration results. Both simulation and outdoor experiments have verified the feasibility and correctness of this method, and the relative error in the outdoor large FOV was less than 0.3%. It shows that this calibration method is a feasible solution for outdoor measurements with a large FOV and long working distance. [ABSTRACT FROM AUTHOR]

The measurement system proposed in this paper, using a measuring arm and line structured light, has a wide range of applications. To improve the scanning efficiency, the system outlined in this paper uses two single-line structured lights to form crosshair structured light, which we combine with a measuring arm to form a comprehensive scanning measurement system. The calibration method of Zhengyou Zhang and a calibration board are used to complete parameter calibration of the sensors and cameras, as well as hand–eye calibration of the measuring arm. For complex curved-surface objects, this system extracts the cross-line structured light optical center location, which suffers from ambiguity. Therefore, we introduce the use of periodic control of the two line structured light sources in order to resolve the light extraction polysemy. Our experimental results indicate that the proposed system can effectively satisfy the function of crosshair structured light scanning of large, complex surfaces. [ABSTRACT FROM AUTHOR]

Low-cost camera calibration is vital in air and underwater photogrammetric applications. However, various lens distortions and the underwater environment influence are difficult to be covered by a universal distortion compensation model, and the residual distortions may still remain after conventional calibration. In this paper, we propose a combined physical and mathematical camera calibration method for low-cost cameras, which can adapt to both in-air and underwater environments. The commonly used physical distortion models are integrated to describe the image distortions. The combination is a high-order polynomial, which can be considered as basis functions to successively approximate the image deformation from the point of view of mathematical approximation. The calibration process is repeated until certain criteria are met and the distortions are reduced to a minimum. At the end, several sets of distortion parameters and stable camera interior orientation (IO) parameters act as the final camera calibration results. The Canon and GoPro in-air calibration experiments show that GoPro owns distortions seven times larger than Canon. Most Canon distortions have been described with the Australis model, while most decentering distortions for GoPro still exist. Using the proposed method, all the Canon and GoPro distortions are decreased to close to 0 after four calibrations. Meanwhile, the stable camera IO parameters are obtained. The GoPro Hero 5 Black underwater calibration indicates that four sets of distortion parameters and stable camera IO parameters are obtained after four calibrations. The camera calibration results show a difference between the underwater environment and air owing to the refractive and asymmetric environment effects. In summary, the proposed method improves the accuracy compared with the conventional method, which could be a flexible way to calibrate low-cost cameras for high accurate in-air and underwater measurement and 3D modeling applications. [ABSTRACT FROM AUTHOR]

In this paper, a procedure for calibrating the image sensors of mobile devices and evaluating their results was developed and implemented in a software application. Regarding the calibration, two methods were used, an OpenCV function and a photogrammetry method, which used the same camera model. In evaluating the calibration results, a method is proposed that uses single-image rectification to examine the performance of the calibration parameters in a practical and supervisory way. After an experiment followed by a study, a standard is proposed regarding the number and shooting angles of the photographs that should be used in the calibration. During the development, problems related to processing large images and automating processes were solved. Finally, the procedure and software application were tested in a case study. [ABSTRACT FROM AUTHOR]

Aiming at the problem of the low accuracy of projector calibration in a structured light system, an improved projector calibration method is proposed in this paper. One of the key ideas is to estimate the sub-pixel coordinates in the projector image plane using local random sample consensus (RANSAC). A bundle adjustment (BA) algorithm is adopted to optimize the calibration parameters to further improve the accuracy and robustness of the projector calibration. After system calibration and epipolar rectification, the mapping relationship between the pixel coordinates and the absolute phase in the projector image plane is established by using cubic polynomial fitting, and the disparity is rapidly solved by using the mapping relationship, which not only ensures the measurement accuracy, but also improves the measurement efficiency. The experimental results demonstrated that the average re-projection error after optimization is reduced to 0.03 pixels, and the proposed method is suitable for high-speed 3D reconstruction without the time-consuming homogenous point searching. [ABSTRACT FROM AUTHOR]

The Automated six Degrees of Freedom (DoF) definition of industrial components has become an added value in production processes as long as the required accuracy is guaranteed. This is where multi-camera systems are finding their niche in the market. These systems provide, among other things, the ease of automating tracking processes without human intervention and knowledge about vision and/or metrology. In addition, the cost of integrating a new sensor into the complete system is negligible compared to other multi-tracker systems. The increase in information from different points of view in multi-camera systems raises the accuracy, based on the premise that the more points of view, the lower the level of uncertainty. This work is devoted to the calibration procedures of multi-camera systems, which is decisive to achieve high performance, with a particular focus on the uncertainty budget. Moreover, an evaluation methodology has been carried out, which is key to determining the level of accuracy of the measurement system. [ABSTRACT FROM AUTHOR]

This paper presents the development of a device that creates two or more light pulses with a precision time delay in a range from microseconds to several seconds and for the purpose of the calibration of velocity of detonation (VOD) measurement instruments. The device was assembled, programmed, and tested for functionality. Measurements were conducted using a reference counter. First, a precision OCXO (oven-controlled crystal oscillator) was used as a clock source. For verification of programmed subroutines, a counter oscillator output port was used as a source of clock signal for the microcontroller. This enabled the cancellation of possible oscillator errors. The signal had to be converted from an AC sine signal to a signal with positive values only using a clamper circuit. By the proposed solution, a calculable standard of time delay between two light pulses was achieved. According to the obtained results, this device can be used to calibrate field measurement devices for VOD measurements in explosives or some other use where the measurement device records the time interval between multiple light pulses. This enables more confidence in measurement results, faster recognition of instrument drift and increases the quality of measurement. [ABSTRACT FROM AUTHOR]

This paper proposes a novel method for the calibration of a stereo camera system used to reconstruct 3D scenes. An error in the pitch angle of the cameras causes the reconstructed scene to exhibit some distortion with respect to the real scene. To do the calibration procedure, whose purpose is to eliminate or at least minimize said distortion, machine learning techniques have been used, and more specifically, regression algorithms. These algorithms are trained with a large number of vectors of input features with their respective outputs, since, in view of the application of the procedure proposed, it is important that the training set be sufficiently representative of the variety that can occur in a real scene, which includes the different orientations that the pitch angle can take, the error in said angle and the effect that all this has on the reconstruction process. The most efficient regression algorithms for estimating the error in the pitch angle are derived from decision trees and certain neural network configurations. Once estimated, the error can be corrected, thus making the reconstructed scene appear more like the real one. Although the authors base their method on U-V disparity and employ this same technique to completely reconstruct the 3D scene, one of the most interesting features of the method proposed is that it can be applied regardless of the technique used to carry out said reconstruction. [ABSTRACT FROM AUTHOR]

RGB and depth cameras are extensively used for the 3D tracking of human pose and motion. Typically, these cameras calculate a set of 3D points representing the human body as a skeletal structure. The tracking capabilities of a single camera are often affected by noise and inaccuracies due to occluded body parts. Multiple-camera setups offer a solution to maximize coverage of the captured human body and to minimize occlusions. According to best practices, fusing information across multiple cameras typically requires spatio-temporal calibration. First, the cameras must synchronize their internal clocks. This is typically performed by physically connecting the cameras to each other using an external device or cable. Second, the pose of each camera relative to the other cameras must be calculated (Extrinsic Calibration). The state-of-the-art methods use specialized calibration session and devices such as a checkerboard to perform calibration. In this paper, we introduce an approach to the spatio-temporal calibration of multiple cameras which is designed to run on-the-fly without specialized devices or equipment requiring only the motion of the human body in the scene. As an example, the system is implemented and evaluated using Microsoft Azure Kinect. The study shows that the accuracy and robustness of this approach is on par with the state-of-the-art practices. [ABSTRACT FROM AUTHOR]

In response to the problem of the small field of vision in 3D reconstruction, a 3D reconstruction system based on a catadioptric camera and projector was built by introducing a traditional camera to calibrate the catadioptric camera and projector system. Firstly, the intrinsic parameters of the camera and the traditional camera are calibrated separately. Then, the calibration of the projection system is accomplished by the traditional camera. Secondly, the coordinate system is introduced to calculate, respectively, the position of the catadioptric camera and projector in the coordinate system, and the position relationship between the coordinate systems of the catadioptric camera and the projector is obtained. Finally, the projector is used to project the structured light fringe to realize the reconstruction using a catadioptric camera. The experimental results show that the reconstruction error is 0.75 mm and the relative error is 0.0068 for a target of about 1 m. The calibration method and reconstruction method proposed in this paper can guarantee the ideal geometric reconstruction accuracy. [ABSTRACT FROM AUTHOR]

The performance of modern digital cameras approaches physical limits and enables high-precision measurements in optical metrology and in computer vision. All camera-assisted geometrical measurements are fundamentally limited by the quality of camera calibration. Unfortunately, this procedure is often effectively considered a nuisance: calibration data are collected in a non-systematic way and lack quality specifications; imaging models are selected in an ad hoc fashion without proper justification; and calibration results are evaluated, interpreted, and reported inconsistently. We outline an (arguably more) systematic and metrologically sound approach to calibrating cameras and characterizing the calibration outcomes that is inspired by typical machine learning workflows and practical requirements of camera-based measurements. Combining standard calibration tools and the technique of active targets with phase-shifted cosine patterns, we demonstrate that the imaging geometry of a typical industrial camera can be characterized with sub-mm uncertainty up to distances of a few meters even with simple parametric models, while the quality of data and resulting parameters can be known and controlled at all stages. [ABSTRACT FROM AUTHOR]

Portable digital devices such as PDAs and camera phones are the easiest and most widely used methods to preserve and collect information. Capturing a document image using this method always has warping issues, especially when capturing pages from a book and rolled-up documents. In this article, we propose an effective method to correct the warping of the captured document image. The proposed method uses a checkerboard calibration pattern to calculate the world and image points. A radial distortion algorithm is used to handle the warping problem based on the computed image and world points. The proposed method obtained an error rate of 3% using a document de-warping dataset (CBDAR 2007). The proposed method achieved a high level of quality compared with other previous methods. Our method fixes the problem of warping in document images acquired with different levels of complexity, such as poor lighting, low quality, and different layouts. [ABSTRACT FROM AUTHOR]

Highly accurate measurements of infrared systems cannot be achieved without precise radiometric calibrations. In order to correctly interpret and process infrared images and monitor the performance of infrared cameras, their radiometric calibration is also required periodically. In this paper, an equivalent calibration method is proposed based on an internal blackbody baffle. It is used for the replacement of a large surface-source blackbody covering the aperture for the field calibration of large-aperture equipment. Subsequently, the expressions of the equivalent calibration conversion function (ECCF) are derived based on the grayscale response of the camera and the calibration models of the two methods, and experimental measurements and fits are performed using a cooled mid-wave infrared camera. The results show that the measured functional form is consistent with the physical meaning. Moreover, in the target imaging experiments, the results of the inversion using the equivalent calibration conversion function and the results of the direct calibration of the external blackbody are largely consistent with the average error of 0.198% between the two, and the maximum error is within 1%. The maximum error between the inversion result of radiation brightness and the actual value of the target is 6.29%, and the accuracy fully meets the radiometric measurement requirements. [ABSTRACT FROM AUTHOR]

Nowadays, the integration between photogrammetry and structure from motion (SFM) has become much closer, and many attempts have been made to combine the two approaches to realize the positioning, calibration, and 3D reconstruction of a large number of images. For the positioning and calibration of high oblique frame sweep (HOFS) aerial cameras, a quadrifocal tensor SFM photogrammetry technique is proposed to resolve the positioning and calibration task of such cameras. It adopts the quadrifocal tensor idea into the OpenMVG SFM pipeline to solve the complexity problem caused by the small single-viewing imaging area and the high image overlapping ratio. It also integrates the photogrammetry iteration idea into the OpenMVG SFM pipeline to enhance the positioning and calibration accuracy, which includes a coarse to fine three-stage Bundle Adjustment (BA) processing approach. In this paper, the overall workflow of the proposed technique was first introduced in detail, from feature extraction and image matching, relative rotation and translation estimation, global rotation and translation estimation, and the quadrifocal tensor model construction to the three-stage BA process and calibration. Then, experiments were carried out in the Zhengzhou area, implementing four types of adjustment methods. The results suggest that the proposed quadrifocal tensor SFM photogrammetry is suitable for large tilt frame sweep camera positioning and calibration without prior information on detailed camera intrinsic parameters and structure. The modifications made to the OpenMVG SFM pipeline enhanced the precision of image positioning and calibration and provided the precision level of professional photogrammetry software. [ABSTRACT FROM AUTHOR]

The MEMS array-based inertial navigation module (M-IMU) reduces the measurement singularities of MEMS sensors by fusing multiple data processing to improve its navigation performance. However, there are still existing random and fixed errors in M-IMU navigation. The calibration method calibrates the fixed error parameters of M-IMU to further improve navigation accuracy. In this paper, we propose a low-cost and efficient calibration method to effectively estimate the fixed error parameters of M-IMU. Firstly, we manually rotate the M-IMU in multiple sets of different attitudes (stationary), then use the LM-calibration algorithm to optimize the cost function of the corresponding sensors in different intervals of the stationary-dynamic filter separation to obtain the fixed error parameters of MEMS, and finally, the global fixed error parameters of the M-IMU are calibrated by adaptive support fusion of the individual MEMS fixed error parameters based on the benchmark conversion. A comparison of the MEMS calibrated separately by the fusion-calibration algorithm and the LM-calibration algorithm verified that the calibrated MEMS array improved the measurement accuracy by about 10 db and reduced the dispersion of the output data by about 8 db compared to the individual MEMS in a multi-dimensional test environment, indicating the robustness and feasibility of the fusion calibration algorithm. [ABSTRACT FROM AUTHOR]

Nowadays, the need for reliable and low-cost multi-camera systems is increasing for many potential applications, such as localization and mapping, human activity recognition, hand and gesture analysis, and object detection and localization. However, a precise camera calibration approach is mandatory for enabling further applications that require high precision. This paper analyzes the available two-camera calibration approaches to propose a guideline for calibrating multiple Azure Kinect RGB-D sensors to achieve the best alignment of point clouds in both color and infrared resolutions, and skeletal joints returned by the Microsoft Azure Body Tracking library. Different calibration methodologies using 2D and 3D approaches, all exploiting the functionalities within the Azure Kinect devices, are presented. Experiments demonstrate that the best results are returned by applying 3D calibration procedures, which give an average distance between all couples of corresponding points of point clouds in color or an infrared resolution of 21.426 mm and 9.872 mm for a static experiment and of 20.868 mm and 7.429 mm while framing a dynamic scene. At the same time, the best results in body joint alignment are achieved by three-dimensional procedures on images captured by the infrared sensors, resulting in an average error of 35.410 mm. [ABSTRACT FROM AUTHOR]

The Gaofen-3 (GF-3) satellite can provide digital elevation model (DEM) data from its interferogram outputs. However, the accuracy of these data cannot be ensured without applying a surveying and mapping (SAM) calibration process, thus necessitating geometric and interferometric calibration technologies. In this paper, we propose an independent parameter decomposition (IPD) method to conduct SAM calibration on GF-3 data and generate high-accuracy DEMs. We resolved the geometric parameters to improve the location accuracy and resolved the interferometric parameters to improve the height accuracy. First, we established a geometric calibration model, analyzed the Range–Doppler (RD) model and resolved the initial imaging time error as well as the initial slant range error. Then, we established a three-dimensional reconstruction (TDR) model to analyze the height error sources. Finally, the interferometric phase error and baseline vector error were precisely estimated to ensure the vertical accuracy of the interferometric results by establishing the interferometric calibration model. We then used the GF-3 interferometric data derived on the same orbit in a north–south distribution to conduct the calibration experiment. The results show that the plane positioning accuracy was 5.09 m following geometric calibration, that the vertical accuracy of the interferometric results was 4.18 m following interferometric calibration and that the average absolute elevation accuracy of the derived DEM product was better than 3.09 m when using the GF-3 SAR data, thus confirming the correctness and effectiveness of the proposed GF-3 IPD calibration method. These results provide a technical basis for SAM calibration using GF-3 interferograms at the 1:50,000 scale in China. [ABSTRACT FROM AUTHOR]

Although robotic vision systems offer a promising technology solution for rapid and reconfigurable in-process 3D inspection of complex and large parts in contemporary manufacturing, measurement accuracy poses a challenge for its wide deployment. One of the key issues in adopting a robotic vision system is to understand the extent of its measurement errors which are directly correlated with the calibration process. In this paper, a possible source of practical and inherent measurement uncertainties involved in the calibration process of a robotic vision system are discussed. The system considered in this work consists of an image sensor mounted on an industrial robot manipulator with six degrees of freedom. Based on a series of experimental tests and computer simulations, the paper gives a comprehensive performance comparison of different calibration approaches and shows the impact of measurement uncertainties on the calibration process. It has been found from the error sensitivity analysis that minor uncertainties in the calibration process can significantly affect the accuracy of the robotic vision system. Further investigations suggest that inducing errors in image calibration patterns can have an adverse effect on the hand–eye calibration process compared to the angular errors in the robot joints. [ABSTRACT FROM AUTHOR]

RGB-D cameras produce depth and color information commonly used in the 3D reconstruction and vision computer areas. Different cameras with the same model usually produce images with different calibration errors. The color and depth layer usually requires calibration to minimize alignment errors, adjust precision, and improve data quality in general. Standard calibration protocols for RGB-D cameras require a controlled environment to allow operators to take many RGB and depth pair images as an input for calibration frameworks making the calibration protocol challenging to implement without ideal conditions and the operator experience. In this work, we proposed a novel strategy that simplifies the calibration protocol by requiring fewer images than other methods. Our strategy uses an ordinary object, a know-size basketball, as a ground truth sphere geometry during the calibration. Our experiments show comparable results requiring fewer images and non-ideal scene conditions than a reference method to align color and depth image layers. [ABSTRACT FROM AUTHOR]

In this article, we propose a method for automatic calibration of a LiDAR–camera system, which can be used in autonomous cars. This approach does not require any calibration pattern, as calibration is only based on real traffic scenes observed by sensors; the results of camera image segmentation are compared with scanning LiDAR depth data. The proposed algorithm superimposes the edges of objects segmented by the Mask-RCNN network with depth discontinuities. The method can run in the background during driving, and it can automatically detect decalibration and correct corresponding rotation matrices in an online and near real-time mode. Experiments on the KITTI dataset demonstrated that, for input data of moderate quality, the algorithm could calculate and correct rotation matrices with an average accuracy of 0.23°. [ABSTRACT FROM AUTHOR]

In this work, we propose a rapid calibration technique for locating the projector in the structured light measurement system. Using Brox optical flow, the calibration of the three-dimensional (3-D) coordinates of the projector only requires two images captured before and after the motion of the calibration plate. The calibration principle presented in geometry depicts the relation between the position of the projector, the camera, and the optical flow caused by the movement of the calibration plate. Some important influences on accuracy are discussed, such as the environmental noises and the localization error of the camera and the calibration plate, illustrated by numerical simulations. The simulation results show that the relative errors of the projector calibration results are less than 0.8% and 1% in the case of the calibration images polluted by Gaussian noise of SNR of 40 dB and 20 dB, respectively. An actual experiment measured a square standard block, and a circular thin plate verifies the proposed method's feasibility and practicality. The results show that the height distributions of the two specimens are in good agreement with their true values, and the maximum absolute errors are 0.1 mm and 0.08 mm, respectively. [ABSTRACT FROM AUTHOR]

Recent industry trends toward more complex and interconnected systems have increased the demand for more reliable pressure sensors. By integrating a microactuator with a pressure sensor, the sensor can self-calibrate, eliminating the complexities and costs associated with traditional sensor calibration methods to ensure reliability. The present work is focused on furthering understanding and improving the thermal performance of a thermopneumatic actuated self-calibrating pressure sensor. A transient numerical model was developed in ANSYS and was calibrated using experimental testing data. The numerical model provided insights into the sensor's performance not previously observed in experimental testing. Furthermore, the model was utilized for two design studies. First, it was found that a substrate with low thermal conductivity and high thermal diffusivity is ideal for both the sensor's efficiency and a faster transient response time. The second design study showed that decreasing the size of the sealed reference cavity lowers power consumption and transient response time. The study also showed that reducing the cavity base dimension has a greater effect on lowering power consumption and response time. Overall, the present work increases understanding of the self-calibrating pressure sensor and provides insight into potential design improvements, moving closer to optimized self-calibrating pressure sensors. [ABSTRACT FROM AUTHOR]

In view of the phenomenon that camera imaging will appear large up close and small from afar in the eye-to-hand hand-calibration system, one hand–eye calibration is carried out. The manipulator is only suitable for grasping objects of the same height, and the calibration results cannot be applied to grasping products with variable height. Based on the study of the pinhole camera model and the rigid transformation model between coordinate systems, the introduction of the calibration height parameters, the relationship between parameters of the rigid transformation matrix between image the coordinate system and the robot coordinate system, and sampling height are established. In the experiment, firstly, through the calibration of camera parameters, the influence of camera distortion on imaging quality is eliminated, and the influence of calibration height is ignored. Then, the machine coordinate system and image coordinate system of the calibration plate at different heights are calibrated using the four-point calibration method. The parameters of the rigid transformation matrix at different heights (H) are calculated. Finally, through experimental analysis, the high linear relationship between the parameters of the rigid transformation matrix from the image coordinate system to the robot coordinate system and the calibration height is fitted. By analyzing the random error of the experiment, the linear relationship between calibration height and pixel density is further established, and the systematic error of the experimental process is deeply analyzed. The experimental results show that the hand–eye calibration system based on this linear relationship is precise and suitable for grabbing products of any height, and the positioning error is less than 0.08%. [ABSTRACT FROM AUTHOR]

The dynamic evolution of photogrammetry led to the development of numerous methods of geometric calibration of cameras, which are mostly based on building flat targets (fields) with features that can be distinguished in the images. Geometric calibration of thermal cameras for UAVs is an active research field that attracts numerous researchers. As a result of their low price and general availability, non-metric cameras are being increasingly used for measurement purposes. Apart from resolution, non-metric sensors do not have any other known parameters. The commonly applied process is self-calibration, which enables the determining of the approximate elements of the camera's interior orientation. The purpose of this work was to analyze the possibilities of geometric calibration of thermal UAV cameras using proposed test field patterns and materials. The experiment was conducted on a FLIR VUE PRO thermal camera dedicated to UAV platforms. The authors propose the selection of various image processing methods (histogram equalization, thresholding, brightness correction) in order to improve the quality of the thermograms. The consecutive processing methods resulted in over 80% effectiveness on average by 94%, 81%, and 80 %, respectively. This effectiveness, for no processing and processing with the use of the filtering method, was: 42% and 38%, respectively. Only high-pass filtering did not improve the obtained results. The final results of the proposed method and structure of test fields were verified on chosen geometric calibration algorithms. The results of fast and low-cost calibration are satisfactory, especially in terms of the automation of this process. For geometric correction, the standard deviations for the results of specific methods of thermogram sharpness enhancement are two to three times better than results without any correction. [ABSTRACT FROM AUTHOR]

Capacitive MEMS accelerometers have a high thermal sensitivity that drifts the output when subjected to changes in temperature. To improve their performance in applications with thermal variations, it is necessary to compensate for these effects. These drifts can be compensated using a lightweight algorithm by knowing the characteristic thermal parameters of the accelerometer (Temperature Drift of Bias and Temperature Drift of Scale Factor). These parameters vary in each accelerometer and axis, making an individual calibration necessary. In this work, a simple and fast calibration method that allows the characteristic parameters of the three axes to be obtained simultaneously through a single test is proposed. This method is based on the study of two specific orientations, each at two temperatures. By means of the suitable selection of the orientations and the temperature points, the data obtained can be extrapolated to the entire working range of the accelerometer. Only a mechanical anchor and a heat source are required to perform the calibration. This technique can be scaled to calibrate multiple accelerometers simultaneously. A lightweight algorithm is used to analyze the test data and obtain the compensation parameters. This algorithm stores only the most relevant data, reducing memory and computing power requirements. This allows it to be run in real time on a low-cost microcontroller during testing to obtain compensation parameters immediately. This method is aimed at mass factory calibration, where individual calibration with traditional methods may not be an adequate option. The proposed method has been compared with a traditional calibration using a six tests in orthogonal directions and a thermal chamber with a relative error difference of 0.3%. [ABSTRACT FROM AUTHOR]

Line-structured light three-dimensional (3D) measurement is apt for measuring the 3D profile of objects in complex industrial environments. The light-plane calibration, which is a crucial link, greatly affects the accuracy of measurement results. This paper proposes a novel calibration method for line-structured light 3D measurement based on a simple target, i.e., a single cylindrical target (SCT). First, the line-structured light intersects with the target to generate a light stripe. Meanwhile, the camera captures the calibration images, extracts the refined subpixel center points of the light stripe (RSCP) and detects the elliptic profiles of the two ends of the cylindrical target (EPCT). Second, two elliptical cones defined by the EPCT and the camera optical center are determined. Combining the two defined elliptical cones and the known radius of the SCT, we can uniquely solve the axis equation of the SCT. Finally, because the coordinates of RSCP in the camera coordinate system fulfill both the camera model and the cylindrical equation, these coordinates can be solved and used to obtain the optimal solution of the light-plane equation. The results of simulations and experiments verify that our proposed method has higher accuracy and effectiveness. [ABSTRACT FROM AUTHOR]

Mobile robotic systems are highly relevant today in various fields, both in an industrial environment and in terms of their applications in medicine. After assembling the robot, components such as the camera and wheels need to be calibrated. This requires human participation and depends on human factors. The article describes the approach to fully automatic calibration of a robot's camera and wheels with a subsequent calibration refinement during the operation. It consists of placing the robot in an inaccurate position, but in a pre-marked area, and using data from the camera, information about the environment configuration, as well as the ability to move, in order to perform calibration without external observers or human participation. There are two stages in this process: the camera and the wheel calibrations. The camera calibration collects the necessary set of images by automatically moving the robot in front of the fiducial markers template, and then moving it on the marked floor, assessing its trajectory curvature. Upon calibration completion, the robot automatically moves to the area of its normal operation and it is proposed to refine the calibration during its operation without blocking its work. The suggested approach was experimentally tested on the Duckietown project base. Based on test results, the approach proved to be comparable to manual calibrations and is capable of replacing a human for this task. [ABSTRACT FROM AUTHOR]

Featured Application: This work is used for calibrating intrinsic parameters of camera and extrinsic parameters between camera and flash LiDAR. Calibration between multiple sensors is a fundamental procedure for data fusion. To address the problems of large errors and tedious operation, we present a novel method to conduct the calibration between light detection and ranging (LiDAR) and camera. We invent a calibration target, which is an arbitrary triangular pyramid with three chessboard patterns on its three planes. The target contains both 3D information and 2D information, which can be utilized to obtain intrinsic parameters of the camera and extrinsic parameters of the system. In the proposed method, the world coordinate system is established through the triangular pyramid. We extract the equations of triangular pyramid planes to find the relative transformation between two sensors. One capture of camera and LiDAR is sufficient for calibration, and errors are reduced by minimizing the distance between points and planes. Furthermore, the accuracy can be increased by more captures. We carried out experiments on simulated data with varying degrees of noise and numbers of frames. Finally, the calibration results were verified by real data through incremental validation and analyzing the root mean square error (RMSE), demonstrating that our calibration method is robust and provides state-of-the-art performance. [ABSTRACT FROM AUTHOR]

The study proposed a robotic calibration algorithm for improving the robot manipulator position precision. At first, the kinematic parameters as well as the compliance parameters of the robot can be identified together to improve its accuracy using the joint deflection model and the conventional kinematic model calibration technique. Then, an artificial neural network is constructed for further compensating the unmodeled errors. The invasive weed optimization is used to determine the parameters of the neural network. To show the advantages of the suggested technique, an HH800 robot is employed for the experimental study of the proposed algorithm. The improved position precision of the robot after the experiment firmly proves the practicability and positional precision of the proposed method over the other algorithms in comparison. [ABSTRACT FROM AUTHOR]

Featured Application: We here present a completely automated and fast method to calibrate optical see-through head-mounted displays based on the use of a calibrated camera replacing the user's eye. The method can work with any type of optical see-through display and it is easy to replicate in both laboratory environments and real-world settings. In recent years, the entry into the market of self contained optical see-through headsets with integrated multi-sensor capabilities has led the way to innovative and technology driven augmented reality applications and has encouraged the adoption of these devices also across highly challenging medical and industrial settings. Despite this, the display calibration process of consumer level systems is still sub-optimal, particularly for those applications that require high accuracy in the spatial alignment between computer generated elements and a real-world scene. State-of-the-art manual and automated calibration procedures designed to estimate all the projection parameters are too complex for real application cases outside laboratory environments. This paper describes an off-line fast calibration procedure that only requires a camera to observe a planar pattern displayed on the see-through display. The camera that replaces the user's eye must be placed within the eye-motion-box of the see-through display. The method exploits standard camera calibration and computer vision techniques to estimate the projection parameters of the display model for a generic position of the camera. At execution time, the projection parameters can then be refined through a planar homography that encapsulates the shift and scaling effect associated with the estimated relative translation from the old camera position to the current user's eye position. Compared to classical SPAAM techniques that still rely on the human element and to other camera based calibration procedures, the proposed technique is flexible and easy to replicate in both laboratory environments and real-world settings. [ABSTRACT FROM AUTHOR]

Multi-camera systems are widely applied in the three dimensional (3D) computer vision, especially when multiple cameras are distributed on both sides of the measured object. The calibration methods of multi-camera systems are critical to the accuracy of vision measurement and the key is to find an appropriate calibration target. In this paper, a high-precision camera calibration method for multi-camera systems based on transparent glass checkerboards and ray tracing is described, and is used to calibrate multiple cameras distributed on both sides of the glass checkerboard. Firstly, the intrinsic parameters of each camera are obtained by Zhang's calibration method. Then, multiple cameras capture several images from the front and back of the glass checkerboard with different orientations, and all images contain distinct grid corners. As the cameras on one side are not affected by the refraction of glass checkerboard, extrinsic parameters can be directly calculated. However, the cameras on the other side are influenced by the refraction of glass checkerboard, and the direct use of projection model will produce a calibration error. A multi-camera calibration method using refractive projection model and ray tracing is developed to eliminate this error. Furthermore, both synthetic and real data are employed to validate the proposed approach. The experimental results of refractive calibration show that the error of the 3D reconstruction is smaller than 0.2 mm, the relative errors of both rotation and translation are less than 0.014%, and the mean and standard deviation of reprojection error of the four-camera system are 0.00007 and 0.4543 pixels, respectively. The proposed method is flexible, highly accurate, and simple to carry out. [ABSTRACT FROM AUTHOR]