Titre :

Build your own hybrid thermal/EO camera for autonomous vehicle

Auteur(s) :

Zhang, Yigong [Auteur]
Nanjing University of Science and Technology [NJUST]
Gao, Yicheng [Auteur]
Nanjing University of Science and Technology [NJUST]
Gu, Shuo [Auteur]
Nanjing University of Science and Technology [NJUST]
Guo, Yubin [Auteur]
Nanjing University of Science and Technology [NJUST]
Liu, Minghao [Auteur]
Nanjing University of Science and Technology [NJUST]
Sun, Zezhou [Auteur]
Nanjing University of Science and Technology [NJUST]
Hou, Zhixing [Auteur]
Nanjing University of Science and Technology [NJUST]
Yang, Hang [Auteur]
Nanjing University of Science and Technology [NJUST]
Wang, Ying [Auteur]
Nanjing University of Science and Technology [NJUST]
Yang, Jian [Auteur]
Nanjing University of Science and Technology [NJUST]
Ponce, Jean [Auteur]
Models of visual object recognition and scene understanding [WILLOW]
Kong, Hui [Auteur]
Nanjing University of Science and Technology [NJUST]
Horizon Robotics

Titre de la manifestation scientifique :

ICRA 2019 - IEEE International Conference on Robotics and Automation

Ville :

Montreal

Pays :

Canada

Date de début de la manifestation scientifique :

2019-05-20

Discipline(s) HAL :

Informatique [cs]/Vision par ordinateur et reconnaissance de formes [cs.CV]

Résumé en anglais : [en]

In this work, we propose a novel paradigm to design a hybrid thermal/EO (Electro-Optical or visible-light) camera, whose thermal and RGB frames are pixel-wisely aligned and temporally synchronized. Compared with the existing ...
Lire la suite >In this work, we propose a novel paradigm to design a hybrid thermal/EO (Electro-Optical or visible-light) camera, whose thermal and RGB frames are pixel-wisely aligned and temporally synchronized. Compared with the existing schemes, we innovate in three ways in order to make it more compact in dimension, and thus more practical and extendable for real-world applications. The first is a redesign of the structure layout of the thermal and EO cameras. The second is on obtaining a pixel-wise spatial registration of the thermal and RGB frames by a coarse mechanical adjustment and a fine alignment through a constant homography warping. The third innovation is on extending one single hybrid camera to a hybrid camera array, through which we can obtain wide-view spatially aligned thermal, RGB and disparity images simultaneously. The experimental results show that the average error of spatial-alignment of two image modalities can be less than one pixel.Lire moins >

Langue :

Anglais

Comité de lecture :

Oui

Audience :

Internationale

Vulgarisation :

Non

Commentaire :

to appear in the Proc. of the IEEE International Conference on Robotics and Automation, 2019

Collections :

• Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189

Source :

Harvested from HAL