Fiducial Focus Augmentation for Facial Landmark Detection
Purbayan Kar (Sony Research India), Vishal M Chudasama (Sony Research India), Naoyuki Onoe (Sony), Pankaj Wasnik (Sony Research India),* Vineeth Balasubramanian (Indian Institute of Technology Hyderabad)
The 34th British Machine Vision Conference
Abstract
Deep learning methods have led to significant improvements in the performance on the facial landmark detection (FLD) task. However, detecting landmarks in challenging settings, such as head pose changes, exaggerated expressions, or uneven illumination, continue to remain a challenge due to high variability and insufficient samples. This inadequacy can be attributed to the model's inability to effectively acquire appropriate facial structure information from the input images. To address this, we propose a novel image augmentation technique specifically designed for the FLD task to enhance the model's understanding of facial structures. To effectively utilize the newly proposed augmentation technique, we employ a Siamese architecture-based training mechanism with a Deep Canonical Correlation Analysis (DCCA)-based loss to achieve collective learning of high-level feature representations from two different views of the input images. Furthermore, we employ a Transformer + CNN-based network with a custom hourglass module as the robust backbone for the Siamese framework. Extensive experiments show that our approach outperforms multiple state-of-the-art approaches across various benchmark datasets.Video
Citation
@inproceedings{Kar_2023_BMVC,
author = {Purbayan Kar and Vishal M Chudasama and Naoyuki Onoe and Pankaj Wasnik and Vineeth Balasubramanian},
title = {Fiducial Focus Augmentation for Facial Landmark Detection},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0562.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by