✎ Art — Node-based pipeline
ComfyUI
A node-graph interface for building image (and other media) generation pipelines with diffusion models, run locally or in the cloud.
Tool open-source
Art / Workflow
Sketch → ControlNet → paint-over
Workflow
Draw a rough sketch by hand, use it as a ControlNet line-art input to explore lighting and color, then repaint the chosen version by hand.
Why it's hybrid
The composition and the final brushwork are both human; AI explores options in between.
Steps
- Sketch thumbnails on paper or in Krita
- Scan or export clean line art
- Generate variations with a ControlNet line-art model in ComfyUI or Krita AI Diffusion
- Pick one as a color and light study
- Repaint fully by hand on a new layer
| Medium | Art, Games |
|---|---|
| AI role | assist |
| Training data | unknown |
| Craft | sketching, digital painting |
| Last verified |
Tools in this workflow
✎ Art — Conditioning
ControlNet
A research method and open model set that steers diffusion images with structural inputs such as line art, poses, edges and depth.
Tool open-source
✎ Art — Painting assistant
Krita AI Diffusion
An open-source plugin that brings Stable Diffusion generation, inpainting and live painting into the free Krita painting app.
Plugin open-source
Sources: [1]
Related
✎ Art — Image generation
Adobe Firefly
Adobe's family of generative models for images, vectors and more, available on the web and built into Creative Cloud apps.
Tool freemium licensed data
▲ Games · ✎ Art — Materials
Adobe Substance 3D Sampler
Material authoring software that turns photos into tileable PBR materials, with AI-assisted features like Image to Material.
Tool subscription
▲ Games — Environment generation
Blockade Labs Skybox AI
A tool for generating 360-degree skybox environments from prompts and sketches.
Tool freemium