HyperAIHyperAI

Command Palette

Search for a command to run...

6 months ago

Deep Image Harmonization in Dual Color Spaces

Linfeng Tan Li Niu* Jiangtong Li Liqing Zhang*

Deep Image Harmonization in Dual Color Spaces

Abstract

Image harmonization is an essential step in image composition that adjuststhe appearance of composite foreground to address the inconsistency betweenforeground and background. Existing methods primarily operate in correlatedRGBRGBRGB color space, leading to entangled features and limited representationability. In contrast, decorrelated color space (e.g., LabLabLab) has decorrelatedchannels that provide disentangled color and illumination statistics. In thispaper, we explore image harmonization in dual color spaces, which supplementsentangled RGBRGBRGB features with disentangled LLL, aaa, bbb features to alleviatethe workload in harmonization process. The network comprises a RGBRGBRGBharmonization backbone, an LabLabLab encoding module, and an LabLabLab control module.The backbone is a U-Net network translating composite image to harmonizedimage. Three encoders in LabLabLab encoding module extract three control codesindependently from LLL, aaa, bbb channels, which are used to manipulate thedecoder features in harmonization backbone via LabLabLab control module. Our codeand model are available at\href{https://github.com/bcmi/DucoNet-Image-Harmonization}{https://github.com/bcmi/DucoNet-Image-Harmonization}.

Code Repositories

bcmi/duconet-image-harmonization
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-harmonization-on-hadobe5k-1024-timesDucoNet
MSE: 10.94
PSNR: 41.37
SSIM: 0.9886
fMSE: 80.69
image-harmonization-on-iharmony4DucoNet
MSE: 18.47
PSNR: 39.17
fMSE: 212.53

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Deep Image Harmonization in Dual Color Spaces | Papers | HyperAI