Tony Beltramelli

Abstract
Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies).
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| class-level-code-generation-on-reside-testset | - | F1 (Hidden Test Set): 159.84 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.