Floorplan Restoration by Structure Hallucinating Transformer Cascades
Sepidehsadat Hosseini (Simon Fraser University),* Yasutaka Furukawa (Simon Fraser University)
The 34th British Machine Vision Conference
Abstract
This paper presents a novel floorplan restoration task, a new benchmark for the task, and a neural architecture as a solution. Given a partial floorplan reconstruction inferred from panorama images, the task is to restore a complete floorplan including invisible architectural structures. The proposed neural network 1) encodes an input partial floorplan into a set of latent vectors by convolutional neural networks and a Transformer; and 2) recovers an entire floorplan while hallucinating invisible rooms and doors by cascading Transformer decoders. Qualitative and quantitative evaluations demonstrate the effectiveness of our approach over the benchmark of 701 houses, outperforming the state-of-the-art reconstruction techniques. we will publish code and data.Citation
@inproceedings{Hosseini_2023_BMVC,
author = {Sepidehsadat Hosseini and Yasutaka Furukawa},
title = {Floorplan Restoration by Structure Hallucinating Transformer Cascades},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0090.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by