AnyDoor

AnyDoor is a diffusion-based image generator with the power to teleport target objects to new scenes at user-specified locations in a harmonious way.

Instead of tuning parameters for each object, the model is trained only once and effortlessly generalizes to diverse object-scene combinations at the inference stage. Such a challenging zero-shot setting requires an adequate characterization of a certain object.

To this end, it complement the commonly used identity feature with detail features, which are carefully designed to maintain texture details yet allow versatile local variations (e.g., lighting, orientation, posture, etc.), supporting the object in favorably blending with different surroundings.