Object-Attribute Binding in Text-to-Image Generation: Evaluation and Control

no code implementations • 21 Apr 2024 • Maria Mihaela Trusca, Wolf Nuyts, Jonathan Thomm, Robert Honig, Thomas Hofmann, Tinne Tuytelaars, Marie-Francine Moens

Current diffusion models create photorealistic images given a text prompt as input but struggle to correctly bind attributes mentioned in the text to the right objects in the image.

Attribute Sentence +1

Explicitly Representing Syntax Improves Sentence-to-layout Prediction of Unexpected Situations

no code implementations • 25 Jan 2024 • Wolf Nuyts, Ruben Cartuyvels, Marie-Francine Moens

To test compositional understanding, we collect a test set of grammatically correct sentences and layouts describing compositions of entities and relations that unlikely have been seen during training.

Image Generation Sentence