KFC: Kinship Verification with Fair Contrastive loss and Multi-Task Learning
Jia Luo Peng (National Tsing Hua University),* Keng Wei Chang (National Tsing Hua University), Shang-Hong Lai (National Tsing Hua University)
The 34th British Machine Vision Conference
Abstract
Kinship verification is an emerging task in computer vision with multiple potential applications. However, there's no large enough kinship dataset to train a representative and robust model, which is a limitation for achieving better performance. Moreover, face verification is known to exhibit bias, which has not been dealt with by previous kinship verification works and sometimes even results in serious issues. So we first combine existing kinship datasets and label each identity with the correct race in order to take race information into consideration and provide a larger and complete dataset, called KinRace dataset. Secondly, we propose a multi-task learning model structure with attention module to enhance accuracy, which surpasses state-of-the-art performance. Lastly, our fairness-aware contrastive loss function with adversarial learning greatly mitigates racial bias. We introduce a debias term into traditional contrastive loss and implement gradient reverse in race classification task, which is an innovative idea to mix two fairness methods to alleviate bias. Exhaustive experimental evaluation demonstrates the effectiveness and superior performance of the proposed KFC in both standard deviation and accuracy at the same time.Video
Citation
@inproceedings{Peng_2023_BMVC,
author = {Jia Luo Peng and Keng Wei Chang and Shang-Hong Lai},
title = {KFC: Kinship Verification with Fair Contrastive loss and Multi-Task Learning},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0470.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by