Stream-based Active Learning by Exploiting Temporal Properties in Perception with Temporal Predicted Loss


Sebastian Schmidt (BMW),* Stephan Günnemann (Technical University of Munich)
The 34th British Machine Vision Conference

Abstract

Active learning (AL) reduces the amount of labeled data needed to train a machine learning model by intelligently choosing which instances to label. Classic pool-based AL requires all data to be present in a datacenter, which can be challenging with the increasing amounts of data needed in deep learning. However, AL on mobile devices and robots, like autonomous cars, can filter the data from perception sensor streams before reaching the datacenter. We exploited the temporal properties for such image streams in our work and proposed the novel temporal predicted loss (TPL) method. To evaluate the stream-based setting properly, we introduced the GTA V streets and the A2D2 streets dataset and made both publicly available. Our experiments showed that our approach significantly improves the diversity of the selection while being an uncertainty-based method. As pool-based approaches are more common in perception applications, we derived a concept for comparing pool-based and stream-based AL, where TPL outperformed state-of-the-art pool- or stream-based approaches for different models. TPL demonstrated a gain of 2.5 percent points (pp) less required data while being significantly faster than pool-based methods.

Video



Citation

@inproceedings{Schmidt_2023_BMVC,
author    = {Sebastian Schmidt and Stephan Günnemann},
title     = {Stream-based Active Learning by Exploiting Temporal Properties in Perception with Temporal Predicted Loss},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year      = {2023},
url       = {https://papers.bmvc2023.org/0664.pdf}
}


Copyright © 2023 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection