TU Darmstadt / ULB / TUbiblio

Bias and Diversity in Synthetic-based Face Recognition

Huber, Marco ; Luu, Anh Thi ; Boutros, Fadi ; Kuijper, Arjan ; Damer, Naser (2024)
Bias and Diversity in Synthetic-based Face Recognition.
Winter Conference on Applications of Computer Vision 2024. Waikoloa, USA (04.01.-08.01.2024)
doi: 10.1109/WACV57701.2024.00610
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

Synthetic data is emerging as a substitute for authentic data to solve ethical and legal challenges in handling authentic face data. The current models can create real-looking face images of people who do not exist. However, it is a known and sensitive problem that face recognition systems are susceptible to bias, i.e. performance differences between different demographic and non-demographics attributes, which can lead to unfair decisions. In this work, we investigate how the diversity of synthetic face recognition datasets compares to authentic datasets, and how the distribution of the training data of the generative models affects the distribution of the synthetic data. To do this, we looked at the distribution of gender, ethnicity, age, and head position. Furthermore, we investigated the concrete bias of three recent synthetic-based face recognition models on the studied attributes in comparison to a baseline model trained on authentic data. Our results show that the generator generate a similar distribution as the used training data in terms of the different attributes. With regard to bias, it can be seen that the synthetic-based models share a similar bias behavior with the authentic-based models. However, with the uncovered lower intra-identity attribute consistency seems to be beneficial in reducing bias.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2024
Autor(en): Huber, Marco ; Luu, Anh Thi ; Boutros, Fadi ; Kuijper, Arjan ; Damer, Naser
Art des Eintrags: Bibliographie
Titel: Bias and Diversity in Synthetic-based Face Recognition
Sprache: Englisch
Publikationsjahr: 9 April 2024
Verlag: IEEE
Buchtitel: Proceedings: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision
Veranstaltungstitel: Winter Conference on Applications of Computer Vision 2024
Veranstaltungsort: Waikoloa, USA
Veranstaltungsdatum: 04.01.-08.01.2024
DOI: 10.1109/WACV57701.2024.00610
Kurzbeschreibung (Abstract):

Synthetic data is emerging as a substitute for authentic data to solve ethical and legal challenges in handling authentic face data. The current models can create real-looking face images of people who do not exist. However, it is a known and sensitive problem that face recognition systems are susceptible to bias, i.e. performance differences between different demographic and non-demographics attributes, which can lead to unfair decisions. In this work, we investigate how the diversity of synthetic face recognition datasets compares to authentic datasets, and how the distribution of the training data of the generative models affects the distribution of the synthetic data. To do this, we looked at the distribution of gender, ethnicity, age, and head position. Furthermore, we investigated the concrete bias of three recent synthetic-based face recognition models on the studied attributes in comparison to a baseline model trained on authentic data. Our results show that the generator generate a similar distribution as the used training data in terms of the different attributes. With regard to bias, it can be seen that the synthetic-based models share a similar bias behavior with the authentic-based models. However, with the uncovered lower intra-identity attribute consistency seems to be beneficial in reducing bias.

Freie Schlagworte: Biometrics, Face recognition, Image generation, Fairness, Machine learning
Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Graphisch-Interaktive Systeme
20 Fachbereich Informatik > Mathematisches und angewandtes Visual Computing
Hinterlegungsdatum: 26 Apr 2024 19:11
Letzte Änderung: 26 Apr 2024 19:11
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen