GAN-based Domain Adaptation for Image-aware Layout Generation in Advertising Poster Design
A new GAN model bridges the 'domain gap' to create image-aware poster layouts, outperforming previous methods.
A team of researchers has developed a new AI system that can automatically generate advertising poster layouts conditioned on a product image. The core challenge they address is the 'domain gap'—the difference between the inpainted poster images used for training and the clean product images used in production. To solve this, they created the Content-aware Graphic Layout Dataset (CGL-Dataset) with 60,548 annotated posters and introduced two Generative Adversarial Network (GAN) models.
Their first model, CGL-GAN, applies Gaussian blur to inpainted regions. Their second and more advanced model, the Pixel-level Discriminator Adapter GAN (PDA-GAN), incorporates unsupervised domain adaptation. PDA-GAN's key innovation is a pixel-level discriminator connected to shallow feature maps, which computes a loss for each pixel, allowing it to better adapt to the texture of clean input images and generate more coherent, image-aware layouts.
The researchers also proposed three novel content-aware evaluation metrics to assess how well a model captures relationships between graphic elements and image content. Both quantitative and qualitative evaluations demonstrated that PDA-GAN achieves state-of-the-art performance, producing higher-quality layouts that are semantically aligned with the input product image, a significant step beyond generic template-based design.
- Introduced PDA-GAN, a GAN model with a pixel-level discriminator for unsupervised domain adaptation in layout generation.
- Built the CGL-Dataset containing 60,548 paired inpainted posters and 121,000 clean product images for training.
- Proposed three new content-aware metrics to evaluate layout quality based on alignment with image content, with PDA-GAN outperforming previous methods.
Why It Matters
This automates a core creative task in marketing, potentially saving designers hours on layout iteration for product ads.