Strong Stereo Features for Self-Supervised Practical Stereo Matching
Pierre-André Brousseau (Université de Montréal),* Sebastien Roy (Universite de Montreal)
The 34th British Machine Vision Conference
Abstract
This paper proposes a new approach to the problem of self-supervised dense stereo correspondence. Disparity estimation is an important problem of computer vision but in many situations, correspondence-based reconstruction cannot be accompanied by a ground truth to train supervised methods. This paper proposes to train a siamese feature encoder in a self-supervised permutation framework and then build a cost volume which is fed to a classical stereo algorithm to compute the disparity. In the absence of ground truth disparity, rather than handcrafting features, we suggest a novel and straightforward way to leverage input images to train for features. A key aspect of this method is that all the trainable weights are located inside a feature computation step, which is followed by strong non-trainable constraints that enforce bidirectional correspondence through cross-attention. Validated on real and synthetic datasets and compared to various methods, our proposed approach yields competitive results. Given its high performance, simplicity, and direct integration with current stereo algorithms, we expect this method to further the adoption of deep methods in real life stereo applications.Video
Citation
@inproceedings{Brousseau_2023_BMVC,
author = {Pierre-André Brousseau and Sebastien Roy},
title = {Strong Stereo Features for Self-Supervised Practical Stereo Matching},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0089.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by