Specifying Object Attributes and Relations in Interactive Scene
Generation
Specifying Object Attributes and Relations in Interactive Scene Generation
Oron Ashual Lior Wolf

Abstract
We introduce a method for the generation of images from an input scene graph.The method separates between a layout embedding and an appearance embedding.The dual embedding leads to generated images that better match the scene graph,have higher visual quality, and support more complex scene graphs. In addition,the embedding scheme supports multiple and diverse output images per scenegraph, which can be further controlled by the user. We demonstrate two modes ofper-object control: (i) importing elements from other images, and (ii)navigation in the object space, by selecting an appearance archetype. Our codeis publicly available at https://www.github.com/ashual/scene_generation
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| layout-to-image-generation-on-coco-stuff-2 | SOARISG | FID: 48.7 Inception Score: 10.3 |
| layout-to-image-generation-on-coco-stuff-3 | SOARISG | FID: 59.5 Inception Score: 12.5 SceneFID: 33.46 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.