De-identification of facial videos while preserving remote physiological utility
Marko Radisa Savic (University of Oulu),* Guoying Zhao (University of Oulu)
The 34th British Machine Vision Conference
Abstract
Remote photoplethysmography has great potential in future telemedicine and affective computing, but contains sensitive biometric data, making privacy protection essential for future applications. Privacy related research concerning rPPG is severely limited and does not handle utility-preserving de-identification. In this paper we propose the first learning based method for facial video de-identification that preserves the rPPG signal and visual appearance, thus keeping the utility of the data for remote rPPG measure while protecting users' privacy. Our proposed semi-adversarial framework processes an input video by adding unobtrusive perturbations that remove biometric privacy while keeping the rPPG signal quality high. The framework is trained via learning-based constraints that leverage pre-trained biometric recognition networks and rPPG predictors. Furthermore, we propose a novel loss term that improves biometric de-identification by lowering downstream recognition confidence. We systematically evaluate our proposed method on two public datasets and with varied face identification and rPPG extraction methods, and provide a novel benchmark for future research in this direction. Our code is available at: https://github.com/marukosan93/De-id_rPPGVideo
Citation
@inproceedings{Savic_2023_BMVC,
author = {Marko Radisa Savic and Guoying Zhao},
title = {De-identification of facial videos while preserving remote physiological utility},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0230.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by