HyperAIHyperAI

Command Palette

Search for a command to run...

6 months ago

PFGM++: Unlocking the Potential of Physics-Inspired Generative Models

Yilun Xu; Ziming Liu; Yonglong Tian; Shangyuan Tong; Max Tegmark; Tommi Jaakkola

PFGM++: Unlocking the Potential of Physics-Inspired Generative Models

Abstract

We introduce a new family of physics-inspired generative models termed PFGM++ that unifies diffusion models and Poisson Flow Generative Models (PFGM). These models realize generative trajectories for NNN dimensional data by embedding paths in N+DN{+}DN+D dimensional space while still controlling the progression with a simple scalar norm of the DDD additional variables. The new models reduce to PFGM when D=1D{=}1D=1 and to diffusion models when DD{\to}\inftyD. The flexibility of choosing DDD allows us to trade off robustness against rigidity as increasing DDD results in more concentrated coupling between the data and the additional variable norms. We dispense with the biased large batch field targets used in PFGM and instead provide an unbiased perturbation-based objective similar to diffusion models. To explore different choices of DDD, we provide a direct alignment method for transferring well-tuned hyperparameters from diffusion models (DD{\to} \inftyD) to any finite DDD values. Our experiments show that models with finite DDD can be superior to previous state-of-the-art diffusion models on CIFAR-10/FFHQ 64×6464{\times}6464×64 datasets, with FID scores of 1.91/2.431.91/2.431.91/2.43 when D=2048/128D{=}2048/128D=2048/128. In class-conditional setting, D=2048D{=}2048D=2048 yields current state-of-the-art FID of 1.741.741.74 on CIFAR-10. In addition, we demonstrate that models with smaller DDD exhibit improved robustness against modeling errors. Code is available at https://github.com/Newbeeer/pfgmpp

Code Repositories

newbeeer/pfgmpp
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-generation-on-cifar-10PFGM++
FID: 1.74
image-generation-on-ffhq-64x64-4x-upscalingPFGM++
FID: 2.43

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
PFGM++: Unlocking the Potential of Physics-Inspired Generative Models | Papers | HyperAI