TU Darmstadt / ULB / TUbiblio

Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognition

Kolf, Jan Niklas ; Rieber, Tim ; Elliesen, Jurek ; Boutros, Fadi ; Kuijper, Arjan ; Damer, Naser (2023)
Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognition.
IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023). Vancouver, Canada (18.06.2023-22.06.2023)
doi: 10.1109/CVPRW59228.2023.00088
Konferenzveröffentlichung, Bibliographie

Kurzbeschreibung (Abstract)

Many of the commonly used datasets for face recognition development are collected from the internet without proper user consent. Due to the increasing focus on privacy in the social and legal frameworks, the use and distribution of these datasets are being restricted and strongly questioned. These databases, which have a realistically high variability of data per identity, have enabled the success of face recognition models. To build on this success and to align with privacy concerns, synthetic databases, consisting purely of synthetic persons, are increasingly being created and used in the development of face recognition solutions. In this work, we present a three-player generative adversarial network (GAN) framework, namely IDnet, that enables the integration of identity information into the generation process. The third player in our IDnet aims at forcing the generator to learn to generate identity-separable face images. We empirically proved that our IDnet synthetic images are of higher identity discrimination in comparison to the conventional two-player GAN, while maintaining a realistic intra-identity variation. We further studied the identity link between the authentic identities used to train the generator and the generated synthetic identities, showing very low similarities between these identities. We demonstrated the applicability of our IDnet data in training face recognition models by evaluating these models on a wide set of face recognition benchmarks. In comparison to the state-of-the-art works in synthetic-based face recognition, our solution achieved comparable results to a recent rendering-based approach and outperformed all existing GAN-based approaches. The training code and the synthetic face image dataset are publicly available.

Typ des Eintrags: Konferenzveröffentlichung
Erschienen: 2023
Autor(en): Kolf, Jan Niklas ; Rieber, Tim ; Elliesen, Jurek ; Boutros, Fadi ; Kuijper, Arjan ; Damer, Naser
Art des Eintrags: Bibliographie
Titel: Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognition
Sprache: Englisch
Publikationsjahr: 14 August 2023
Verlag: IEEE
Buchtitel: Proceedings: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
Veranstaltungstitel: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)
Veranstaltungsort: Vancouver, Canada
Veranstaltungsdatum: 18.06.2023-22.06.2023
DOI: 10.1109/CVPRW59228.2023.00088
Kurzbeschreibung (Abstract):

Many of the commonly used datasets for face recognition development are collected from the internet without proper user consent. Due to the increasing focus on privacy in the social and legal frameworks, the use and distribution of these datasets are being restricted and strongly questioned. These databases, which have a realistically high variability of data per identity, have enabled the success of face recognition models. To build on this success and to align with privacy concerns, synthetic databases, consisting purely of synthetic persons, are increasingly being created and used in the development of face recognition solutions. In this work, we present a three-player generative adversarial network (GAN) framework, namely IDnet, that enables the integration of identity information into the generation process. The third player in our IDnet aims at forcing the generator to learn to generate identity-separable face images. We empirically proved that our IDnet synthetic images are of higher identity discrimination in comparison to the conventional two-player GAN, while maintaining a realistic intra-identity variation. We further studied the identity link between the authentic identities used to train the generator and the generated synthetic identities, showing very low similarities between these identities. We demonstrated the applicability of our IDnet data in training face recognition models by evaluating these models on a wide set of face recognition benchmarks. In comparison to the state-of-the-art works in synthetic-based face recognition, our solution achieved comparable results to a recent rendering-based approach and outperformed all existing GAN-based approaches. The training code and the synthetic face image dataset are publicly available.

Freie Schlagworte: Face recognition, Biometrics, Deep learning, Image generation
Fachbereich(e)/-gebiet(e): 20 Fachbereich Informatik
20 Fachbereich Informatik > Graphisch-Interaktive Systeme
20 Fachbereich Informatik > Mathematisches und angewandtes Visual Computing
Hinterlegungsdatum: 04 Dez 2023 12:58
Letzte Änderung: 31 Jan 2024 08:18
PPN: 515149411
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen