Towards Real-World Blind Face Restoration with Generative Facial Prior
Towards Real-World Blind Face Restoration with Generative Facial Prior
Xintao Wang Yu Li Honglun Zhang Ying Shan

Abstract
Blind face restoration usually relies on facial priors, such as facialgeometry prior or reference prior, to restore realistic and faithful details.However, very low-quality inputs cannot offer accurate geometric prior whilehigh-quality references are inaccessible, limiting the applicability inreal-world scenarios. In this work, we propose GFP-GAN that leverages rich anddiverse priors encapsulated in a pretrained face GAN for blind facerestoration. This Generative Facial Prior (GFP) is incorporated into the facerestoration process via novel channel-split spatial feature transform layers,which allow our method to achieve a good balance of realness and fidelity.Thanks to the powerful generative facial prior and delicate designs, ourGFP-GAN could jointly restore facial details and enhance colors with just asingle forward pass, while GAN inversion methods require expensiveimage-specific optimization at inference. Extensive experiments show that ourmethod achieves superior performance to prior art on both synthetic andreal-world datasets.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| blind-face-restoration-on-celeba-test | GFP-GAN | Deg.: 34.60 FID: 42.62 LPIPS: 36.46 NIQE: 4.077 PSNR: 25.08 SSIM: 0.6777 |
| video-super-resolution-on-msu-vsr-benchmark | GFPGAN | 1 - LPIPS: 0.793 ERQAv1.0: 0.538 FPS: 1.562 PSNR: 24.195 QRCRv1.0: 0 SSIM: 0.745 Subjective score: 2.686 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.