yahoo-inc

Salient Object-Aware Background Generation using Text-Guided Diffusion Models [](https://arxiv.org/pdf/2404.10157.pdf) This repository accompanies our paper, Salient Object-Aware Background Generation using Text-Guided Diffusion Models, which has been accepted for publication in CVPR 2024 Generative Models for Computer Vision workshop. The paper addresses an issue we call "object expansion" when generating backgrounds for salient objects using inpainting diffusion models. We show that models such as Stable Inpainting can sometimes arbitrarily expand or distort the salient object, which is undesirable in applications where the object's identity should be preserved, such as e-commerce ads. We provide some examples of object expansion as follows: Load an image and extract its background and foreground If you found our work useful, please consider citing our paper: - Erfan Eshratifar: [email protected] - Joao Soares: [email protected] This project is licensed under the terms of the Apache 2.0 open source license. Please refer to LICENSE for the full terms.