Strong Stereo Features for Self-Supervised Practical Stereo Matching

Pierre-André Brousseau (Université de Montréal),* Sebastien Roy (Universite de Montreal)
The 34th British Machine Vision Conference


This paper proposes a new approach to the problem of self-supervised dense stereo correspondence. Disparity estimation is an important problem of computer vision but in many situations, correspondence-based reconstruction cannot be accompanied by a ground truth to train supervised methods. This paper proposes to train a siamese feature encoder in a self-supervised permutation framework and then build a cost volume which is fed to a classical stereo algorithm to compute the disparity. In the absence of ground truth disparity, rather than handcrafting features, we suggest a novel and straightforward way to leverage input images to train for features. A key aspect of this method is that all the trainable weights are located inside a feature computation step, which is followed by strong non-trainable constraints that enforce bidirectional correspondence through cross-attention. Validated on real and synthetic datasets and compared to various methods, our proposed approach yields competitive results. Given its high performance, simplicity, and direct integration with current stereo algorithms, we expect this method to further the adoption of deep methods in real life stereo applications.



author    = {Pierre-André Brousseau and Sebastien Roy},
title     = {Strong Stereo Features for Self-Supervised Practical Stereo Matching},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year      = {2023},
url       = {}

Copyright © 2023 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection