1. Optimal affine image normalization approach for optical character recognition
- Author
-
D.P. Nikolaev, I.A. Konovalenko, and V.V. Kokhan
- Subjects
optical character recognition ,Computer science ,Image registration ,02 engineering and technology ,computer.software_genre ,01 natural sciences ,010309 optics ,image normalization ,0103 physical sciences ,0202 electrical engineering, electronic engineering, information engineering ,lcsh:Information theory ,lcsh:QC350-467 ,Computer vision ,Electrical and Electronic Engineering ,projective transformation ,approximation ,business.industry ,coordinate discrepancy ,Optical character recognition ,affine transformation ,Symbolic computation ,lcsh:Q350-390 ,Atomic and Molecular Physics, and Optics ,symbolic computation ,Computer Science Applications ,image registration ,Computer Science::Computer Vision and Pattern Recognition ,020201 artificial intelligence & image processing ,Affine transformation ,Artificial intelligence ,business ,computer ,optimization ,lcsh:Optics. Light - Abstract
Optical character recognition (OCR) in images captured from arbitrary angles requires preliminary normalization, i.e. a geometric transformation resulting in an image as if it was captured at an angle suitable for OCR. In most cases, a surface containing characters can be considered flat, and a pinhole model can be adopted for a camera. Thus, in theory, the normalization should be projective. Usually, the camera optical axis is approximately perpendicular to the document surface, so the projective normalization can be replaced with an affine one without a significant loss of accuracy. An affine image transformation is performed significantly faster than a projective normalization, which is important for OCR on mobile devices. In this work, we propose a fast approach for image normalization. It utilizes an affine normalization instead of a projective one if there is no significant loss of accuracy. The approach is based on a proposed criterion for the normalization accuracy: root mean square (RMS) coordinate discrepancies over the region of interest (ROI). The problem of optimal affine normalization according to this criterion is considered. We have established that this unconstrained optimization is quadratic and can be reduced to a problem of fractional quadratic functions integration over the ROI. The latter was solved analytically in the case of OCR where the ROI consists of rectangles. The proposed approach is generalized for various cases when instead of the affine transform its special cases are used: scaling, translation, shearing, and their superposition, allowing the image normalization procedure to be further accelerated.
- Published
- 2021