Krita AI Diffusion

Generate images from within Krita with minimal fuss: Select an area, push a button, and new content that matches your image will be generated. Or expand your canvas and fill new areas with generated content that blends right in. Text prompts are optional. No tweaking required!

This plugin seeks to provide what "Generative Fill/Expand" do in Photoshop - and go beyond. Adjust strength to refine existing content (img2img) or generate images from scratch. Powerful customization is available for advanced users.

Features

Features are designed to fit an interactive workflow where AI generation is used as just another tool while painting. They are meant to synergize with traditional tools and the layer stack.

• Inpaint: Use Krita's selection tools to mark an area and remove or replace existing content in the image. Simple text prompts can be used to steer generation.
• Outpaint: Extend your canvas, select a blank area and automatically fill it with content that seamlessly blends into the existing image.
• Generate: Create new images from scratch by decribing them with words or existing images. Supports SD1.5 and SDXL.
• Refine: Use the strength slider to refine existing image content instead of replacing it entirely. This also works great for adding new things to an image by painting a (crude) approximation and refining at high strength!
• Control: Guide image creation directly with sketches or line art. Use depth or normal maps from existing images or 3D scenes. Transfer character pose from snapshots. Control composition with segmentation maps.
• Resolutions: Work efficiently at any resolution. The plugin will automatically use resolutions appropriate for the AI model, and scale them to fit your image region.
• Upscaling: Upscale and enrich images to 4k, 8k and beyond without running out of memory.
• Job Queue: Depending on hardware, image generation can take some time. The plugin allows you to queue and cancel jobs while working on your image.
• History: Not every image will turn out a masterpiece. Preview results and browse previous generations and prompts at any time.
• Strong Defaults: Versatile default style presets allow for a simple UI which covers many scenarios.
• Customization: Create your own presets - select a Stable Diffusion checkpoint, add LoRA, tweak samplers and more.