CERiL: Continuous Event-based Reinforcement Learning
Celyn Walters (University of Surrey), Simon Hadfield (University of Surrey)*
The 34th British Machine Vision Conference
Abstract
This paper explores the potential of event cameras to enable continuous time Reinforcement Learning. We formalise this problem where a continuous stream of unsynchronised observations is used to produce a corresponding stream of output actions for the environment. This lack of synchronisation enables greatly enhanced reactivity. We present a method to train on event streams derived from standard RL environments, thereby solving the proposed continuous time RL problem. The CERiL algorithm uses specialised network layers which operate directly on an event stream, rather than aggregating events into quantised image frames. We show the advantages of event streams over less-frequent RGB images. The proposed system outperforms networks typically used in RL, even succeeding at tasks which cannot be solved traditionally. We also demonstrate the value of our CERiL approach over a standard SNN baseline using event streams.Video
Citation
@inproceedings{Walters_2023_BMVC,
author = {Celyn Walters and Simon Hadfield},
title = {CERiL: Continuous Event-based Reinforcement Learning},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0498.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by