Facial Landmarks and Generative Priors Guided Blind Face Restoration

Huan Wang, Zi Teng, Chengdong Wu, Sonya Coleman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Blind face restoration (BFR) from severely degraded face images is important in face image processing, and has attracted increasing attention due to its wide applications. How-ever, due to the complex unknown degradations in real-world scenarios, existing priors-based methods tend to restore faces with unstable quality. In this paper, we propose a Facial Landmarks and Generative Priors Guided Blind Face Restoration Network (FGPNet) to seamlessly integrate the advantages of generative priors and face-specific geometry priors. Specifically, we pretrain a high-quality (HQ) face synthesis generative adversarial network (GAN) and a landmarks prediction network, and then embed them into a U-shaped deep neural network (DNN) as decoder priors to guide face restoration, during which the generative priors can provide adequate details and the landmarks priors provide geometry and semantic information. Furthermore, we design facial priors fusion (FPF) blocks to incorporate the prior features from pretrained face synthesis GAN and landmarks prediction network in an adaptive and progressive manner, making our FGPNet exhibits good generalization in real-world application. Experiments demonstrate the superiority of our FGPNet in comparison to state-of-the-arts, and also show its potential in handling real-world low-quality images from several practical applications.
Original languageEnglish
Title of host publication2022 IEEE 20th International Conference on Industrial Informatics (INDIN)
PublisherIEEE
ISBN (Electronic)978-1-7281-7568-3
ISBN (Print)978-1-7281-7569-0
DOIs
Publication statusPublished (in print/issue) - 15 Dec 2022

Publication series

Name2022 IEEE 20th International Conference on Industrial Informatics (INDIN)
PublisherIEEE Control Society

Keywords

  • Blind face restoration
  • deep neural networks
  • generative adversarial network
  • facial priors transformation

Cite this