101. BIT-VO: Visual Odometry at 300 FPS using Binary Features from the Focal Plane
- Author
-
Paul H. J. Kelly, Sajad Saeedi, and Riku Murai
- Subjects
FOS: Computer and information sciences ,0209 industrial biotechnology ,Pixel ,Computer science ,business.industry ,Computer Vision and Pattern Recognition (cs.CV) ,Feature extraction ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Computer Science - Computer Vision and Pattern Recognition ,Binary number ,02 engineering and technology ,Frame rate ,Light intensity ,020901 industrial engineering & automation ,Cardinal point ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Computer vision ,Artificial intelligence ,Visual odometry ,business ,cs.CV - Abstract
Focal-plane Sensor-processor (FPSP) is a next-generation camera technology which enables every pixel on the sensor chip to perform computation in parallel, on the focal plane where the light intensity is captured. SCAMP-5 is a general-purpose FPSP used in this work and it carries out computations in the analog domain before analog to digital conversion. By extracting features from the image on the focal plane, data which is digitized and transferred is reduced. As a consequence, SCAMP-5 offers a high frame rate while maintaining low energy consumption. Here, we present BIT-VO, which is, to the best of our knowledge, the first 6 Degrees of Freedom visual odometry algorithm which utilises the FPSP. Our entire system operates at 300 FPS in a natural scene, using binary edges and corner features detected by the SCAMP-5., 8 pages, 16 figures
- Published
- 2020