PseudoCal: Towards Initialisation-Free Deep Learning-Based Camera-LiDAR Self-Calibration


Mathieu Cocheteux (Université de Technologie de Compiègne),* Julien Moreau (UTC, Heudiasyc-SyRI), Franck Davoine (Heudiasyc - CNRS - Université de technologie de Compiègne)
The 34th British Machine Vision Conference

Abstract

Camera-LiDAR extrinsic calibration is a critical task for multi-sensor fusion in autonomous systems, such as self-driving vehicles and mobile robots. Traditional techniques often require manual intervention or specific environments, making them labour-intensive and error-prone. Existing deep learning-based self-calibration methods focus on small realignments and still rely on initial estimates, limiting their practicality. In this paper, we present PseudoCal, a novel self-calibration method that overcomes these limitations by leveraging the pseudo-LiDAR concept and working directly in the 3D space instead of limiting itself to the camera field of view. In typical autonomous vehicle and robotics contexts and conventions, PseudoCal is able to perform one-shot calibration quasi-independently of initial parameter estimates, addressing extreme cases that remain unsolved by existing approaches.

Video



Citation

@inproceedings{Cocheteux_2023_BMVC,
author    = {Mathieu Cocheteux and Julien Moreau and Franck Davoine},
title     = {PseudoCal: Towards Initialisation-Free Deep Learning-Based Camera-LiDAR Self-Calibration},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year      = {2023},
url       = {https://papers.bmvc2023.org/0829.pdf}
}


Copyright © 2023 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection