[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6FC915M2R3RKHYMNWZXE9EP":3,"skill-same:01M6FC915M2R3RKHYMNWZXE9EP":96},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":23,"publishedAt":47,"linkOnly":48,"markdownContent":49,"markdownBody":50,"frontMatter":51,"refName":63,"commitSha":64,"skillDirectory":65,"forksCount":66,"repositoryHtmlUrl":67,"repositoryHomepageUrl":6,"ownerHtmlUrl":68,"ownerBlogUrl":69,"ownerDescription":70,"updatedAt":71,"install":72,"resources":85},"01M6FC915M2R3RKHYMNWZXE9EP","stable-diffusion-image-generation",null,"State-of-the-art text-to-image generation with Stable Diffusion models via HuggingFace Diffusers. Use when generating images from text prompts, performing image-to-image translation, inpainting, or building custom diffusion pipelines.","Dicklesworthstone\u002Fpi_agent_rust","Dicklesworthstone","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F35050222?v=4","01M6CG26AR942CSVMN1M5E3DSE","Jeff Emanuel","01M6CG26EPP71PSHW1VDS71121",1992,"MIT","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fai-research\u002Fmultimodal-stable-diffusion\u002FSKILL.md",[18],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000016","图像与多媒体","SCENARIO","使用场景",[24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46],"Image Generation","Stable Diffusion","diffusion","generation","image","stable diffusion image generation","vision","when","custom","orchestra","with","Accelerate","translation","Art","images","use","computer","text","Transformers","Diffusers","HuggingFace","multimodal","state","2026-11-10 10:12:30",false,"---\nname: stable-diffusion-image-generation\ndescription: State-of-the-art text-to-image generation with Stable Diffusion models via HuggingFace Diffusers. Use when generating images from text prompts, performing image-to-image translation, inpainting, or building custom diffusion pipelines.\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ntags: [Image Generation, Stable Diffusion, Diffusers, Text-to-Image, Multimodal, Computer Vision]\ndependencies: [diffusers>=0.30.0, transformers>=4.41.0, accelerate>=0.31.0, torch>=2.0.0]\n---\n\n# Stable Diffusion Image Generation\n\nComprehensive guide to generating images with Stable Diffusion using the HuggingFace Diffusers library.\n\n## When to use Stable Diffusion\n\n**Use Stable Diffusion when:**\n- Generating images from text descriptions\n- Performing image-to-image translation (style transfer, enhancement)\n- Inpainting (filling in masked regions)\n- Outpainting (extending images beyond boundaries)\n- Creating variations of existing images\n- Building custom image generation workflows\n\n**Key features:**\n- **Text-to-Image**: Generate images from natural language prompts\n- **Image-to-Image**: Transform existing images with text guidance\n- **Inpainting**: Fill masked regions with context-aware content\n- **ControlNet**: Add spatial conditioning (edges, poses, depth)\n- **LoRA Support**: Efficient fine-tuning and style adaptation\n- **Multiple Models**: SD 1.5, SDXL, SD 3.0, Flux support\n\n**Use alternatives instead:**\n- **DALL-E 3**: For API-based generation without GPU\n- **Midjourney**: For artistic, stylized outputs\n- **Imagen**: For Google Cloud integration\n- **Leonardo.ai**: For web-based creative workflows\n\n## Quick start\n\n### Installation\n\n```bash\npip install diffusers transformers accelerate torch\npip install xformers  # Optional: memory-efficient attention\n```\n\n### Basic text-to-image\n\n```python\nfrom diffusers import DiffusionPipeline\nimport torch\n\n# Load pipeline (auto-detects model type)\npipe = DiffusionPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    torch_dtype=torch.float16\n)\npipe.to(\"cuda\")\n\n# Generate image\nimage = pipe(\n    \"A serene mountain landscape at sunset, highly detailed\",\n    num_inference_steps=50,\n    guidance_scale=7.5\n).images[0]\n\nimage.save(\"output.png\")\n```\n\n### Using SDXL (higher quality)\n\n```python\nfrom diffusers import AutoPipelineForText2Image\nimport torch\n\npipe = AutoPipelineForText2Image.from_pretrained(\n    \"stabilityai\u002Fstable-diffusion-xl-base-1.0\",\n    torch_dtype=torch.float16,\n    variant=\"fp16\"\n)\npipe.to(\"cuda\")\n\n# Enable memory optimization\npipe.enable_model_cpu_offload()\n\nimage = pipe(\n    prompt=\"A futuristic city with flying cars, cinematic lighting\",\n    height=1024,\n    width=1024,\n    num_inference_steps=30\n).images[0]\n```\n\n## Architecture overview\n\n### Three-pillar design\n\nDiffusers is built around three core components:\n\n```\nPipeline (orchestration)\n├── Model (neural networks)\n│   ├── UNet \u002F Transformer (noise prediction)\n│   ├── VAE (latent encoding\u002Fdecoding)\n│   └── Text Encoder (CLIP\u002FT5)\n└── Scheduler (denoising algorithm)\n```\n\n### Pipeline inference flow\n\n```\nText Prompt → Text Encoder → Text Embeddings\n                                    ↓\nRandom Noise → [Denoising Loop] ← Scheduler\n                      ↓\n               Predicted Noise\n                      ↓\n              VAE Decoder → Final Image\n```\n\n## Core concepts\n\n### Pipelines\n\nPipelines orchestrate complete workflows:\n\n| Pipeline | Purpose |\n|----------|---------|\n| `StableDiffusionPipeline` | Text-to-image (SD 1.x\u002F2.x) |\n| `StableDiffusionXLPipeline` | Text-to-image (SDXL) |\n| `StableDiffusion3Pipeline` | Text-to-image (SD 3.0) |\n| `FluxPipeline` | Text-to-image (Flux models) |\n| `StableDiffusionImg2ImgPipeline` | Image-to-image |\n| `StableDiffusionInpaintPipeline` | Inpainting |\n\n### Schedulers\n\nSchedulers control the denoising process:\n\n| Scheduler | Steps | Quality | Use Case |\n|-----------|-------|---------|----------|\n| `EulerDiscreteScheduler` | 20-50 | Good | Default choice |\n| `EulerAncestralDiscreteScheduler` | 20-50 | Good | More variation |\n| `DPMSolverMultistepScheduler` | 15-25 | Excellent | Fast, high quality |\n| `DDIMScheduler` | 50-100 | Good | Deterministic |\n| `LCMScheduler` | 4-8 | Good | Very fast |\n| `UniPCMultistepScheduler` | 15-25 | Excellent | Fast convergence |\n\n### Swapping schedulers\n\n```python\nfrom diffusers import DPMSolverMultistepScheduler\n\n# Swap for faster generation\npipe.scheduler = DPMSolverMultistepScheduler.from_config(\n    pipe.scheduler.config\n)\n\n# Now generate with fewer steps\nimage = pipe(prompt, num_inference_steps=20).images[0]\n```\n\n## Generation parameters\n\n### Key parameters\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `prompt` | Required | Text description of desired image |\n| `negative_prompt` | None | What to avoid in the image |\n| `num_inference_steps` | 50 | Denoising steps (more = better quality) |\n| `guidance_scale` | 7.5 | Prompt adherence (7-12 typical) |\n| `height`, `width` | 512\u002F1024 | Output dimensions (multiples of 8) |\n| `generator` | None | Torch generator for reproducibility |\n| `num_images_per_prompt` | 1 | Batch size |\n\n### Reproducible generation\n\n```python\nimport torch\n\ngenerator = torch.Generator(device=\"cuda\").manual_seed(42)\n\nimage = pipe(\n    prompt=\"A cat wearing a top hat\",\n    generator=generator,\n    num_inference_steps=50\n).images[0]\n```\n\n### Negative prompts\n\n```python\nimage = pipe(\n    prompt=\"Professional photo of a dog in a garden\",\n    negative_prompt=\"blurry, low quality, distorted, ugly, bad anatomy\",\n    guidance_scale=7.5\n).images[0]\n```\n\n## Image-to-image\n\nTransform existing images with text guidance:\n\n```python\nfrom diffusers import AutoPipelineForImage2Image\nfrom PIL import Image\n\npipe = AutoPipelineForImage2Image.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\ninit_image = Image.open(\"input.jpg\").resize((512, 512))\n\nimage = pipe(\n    prompt=\"A watercolor painting of the scene\",\n    image=init_image,\n    strength=0.75,  # How much to transform (0-1)\n    num_inference_steps=50\n).images[0]\n```\n\n## Inpainting\n\nFill masked regions:\n\n```python\nfrom diffusers import AutoPipelineForInpainting\nfrom PIL import Image\n\npipe = AutoPipelineForInpainting.from_pretrained(\n    \"runwayml\u002Fstable-diffusion-inpainting\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\nimage = Image.open(\"photo.jpg\")\nmask = Image.open(\"mask.png\")  # White = inpaint region\n\nresult = pipe(\n    prompt=\"A red car parked on the street\",\n    image=image,\n    mask_image=mask,\n    num_inference_steps=50\n).images[0]\n```\n\n## ControlNet\n\nAdd spatial conditioning for precise control:\n\n```python\nfrom diffusers import StableDiffusionControlNetPipeline, ControlNetModel\nimport torch\n\n# Load ControlNet for edge conditioning\ncontrolnet = ControlNetModel.from_pretrained(\n    \"lllyasviel\u002Fcontrol_v11p_sd15_canny\",\n    torch_dtype=torch.float16\n)\n\npipe = StableDiffusionControlNetPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    controlnet=controlnet,\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\n# Use Canny edge image as control\ncontrol_image = get_canny_image(input_image)\n\nimage = pipe(\n    prompt=\"A beautiful house in the style of Van Gogh\",\n    image=control_image,\n    num_inference_steps=30\n).images[0]\n```\n\n### Available ControlNets\n\n| ControlNet | Input Type | Use Case |\n|------------|------------|----------|\n| `canny` | Edge maps | Preserve structure |\n| `openpose` | Pose skeletons | Human poses |\n| `depth` | Depth maps | 3D-aware generation |\n| `normal` | Normal maps | Surface details |\n| `mlsd` | Line segments | Architectural lines |\n| `scribble` | Rough sketches | Sketch-to-image |\n\n## LoRA adapters\n\nLoad fine-tuned style adapters:\n\n```python\nfrom diffusers import DiffusionPipeline\n\npipe = DiffusionPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\n# Load LoRA weights\npipe.load_lora_weights(\"path\u002Fto\u002Flora\", weight_name=\"style.safetensors\")\n\n# Generate with LoRA style\nimage = pipe(\"A portrait in the trained style\").images[0]\n\n# Adjust LoRA strength\npipe.fuse_lora(lora_scale=0.8)\n\n# Unload LoRA\npipe.unload_lora_weights()\n```\n\n### Multiple LoRAs\n\n```python\n# Load multiple LoRAs\npipe.load_lora_weights(\"lora1\", adapter_name=\"style\")\npipe.load_lora_weights(\"lora2\", adapter_name=\"character\")\n\n# Set weights for each\npipe.set_adapters([\"style\", \"character\"], adapter_weights=[0.7, 0.5])\n\nimage = pipe(\"A portrait\").images[0]\n```\n\n## Memory optimization\n\n### Enable CPU offloading\n\n```python\n# Model CPU offload - moves models to CPU when not in use\npipe.enable_model_cpu_offload()\n\n# Sequential CPU offload - more aggressive, slower\npipe.enable_sequential_cpu_offload()\n```\n\n### Attention slicing\n\n```python\n# Reduce memory by computing attention in chunks\npipe.enable_attention_slicing()\n\n# Or specific chunk size\npipe.enable_attention_slicing(\"max\")\n```\n\n### xFormers memory-efficient attention\n\n```python\n# Requires xformers package\npipe.enable_xformers_memory_efficient_attention()\n```\n\n### VAE slicing for large images\n\n```python\n# Decode latents in tiles for large images\npipe.enable_vae_slicing()\npipe.enable_vae_tiling()\n```\n\n## Model variants\n\n### Loading different precisions\n\n```python\n# FP16 (recommended for GPU)\npipe = DiffusionPipeline.from_pretrained(\n    \"model-id\",\n    torch_dtype=torch.float16,\n    variant=\"fp16\"\n)\n\n# BF16 (better precision, requires Ampere+ GPU)\npipe = DiffusionPipeline.from_pretrained(\n    \"model-id\",\n    torch_dtype=torch.bfloat16\n)\n```\n\n### Loading specific components\n\n```python\nfrom diffusers import UNet2DConditionModel, AutoencoderKL\n\n# Load custom VAE\nvae = AutoencoderKL.from_pretrained(\"stabilityai\u002Fsd-vae-ft-mse\")\n\n# Use with pipeline\npipe = DiffusionPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    vae=vae,\n    torch_dtype=torch.float16\n)\n```\n\n## Batch generation\n\nGenerate multiple images efficiently:\n\n```python\n# Multiple prompts\nprompts = [\n    \"A cat playing piano\",\n    \"A dog reading a book\",\n    \"A bird painting a picture\"\n]\n\nimages = pipe(prompts, num_inference_steps=30).images\n\n# Multiple images per prompt\nimages = pipe(\n    \"A beautiful sunset\",\n    num_images_per_prompt=4,\n    num_inference_steps=30\n).images\n```\n\n## Common workflows\n\n### Workflow 1: High-quality generation\n\n```python\nfrom diffusers import StableDiffusionXLPipeline, DPMSolverMultistepScheduler\nimport torch\n\n# 1. Load SDXL with optimizations\npipe = StableDiffusionXLPipeline.from_pretrained(\n    \"stabilityai\u002Fstable-diffusion-xl-base-1.0\",\n    torch_dtype=torch.float16,\n    variant=\"fp16\"\n)\npipe.to(\"cuda\")\npipe.scheduler = DPMSolverMultistepScheduler.from_config(pipe.scheduler.config)\npipe.enable_model_cpu_offload()\n\n# 2. Generate with quality settings\nimage = pipe(\n    prompt=\"A majestic lion in the savanna, golden hour lighting, 8k, detailed fur\",\n    negative_prompt=\"blurry, low quality, cartoon, anime, sketch\",\n    num_inference_steps=30,\n    guidance_scale=7.5,\n    height=1024,\n    width=1024\n).images[0]\n```\n\n### Workflow 2: Fast prototyping\n\n```python\nfrom diffusers import AutoPipelineForText2Image, LCMScheduler\nimport torch\n\n# Use LCM for 4-8 step generation\npipe = AutoPipelineForText2Image.from_pretrained(\n    \"stabilityai\u002Fstable-diffusion-xl-base-1.0\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\n# Load LCM LoRA for fast generation\npipe.load_lora_weights(\"latent-consistency\u002Flcm-lora-sdxl\")\npipe.scheduler = LCMScheduler.from_config(pipe.scheduler.config)\npipe.fuse_lora()\n\n# Generate in ~1 second\nimage = pipe(\n    \"A beautiful landscape\",\n    num_inference_steps=4,\n    guidance_scale=1.0\n).images[0]\n```\n\n## Common issues\n\n**CUDA out of memory:**\n```python\n# Enable memory optimizations\npipe.enable_model_cpu_offload()\npipe.enable_attention_slicing()\npipe.enable_vae_slicing()\n\n# Or use lower precision\npipe = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)\n```\n\n**Black\u002Fnoise images:**\n```python\n# Check VAE configuration\n# Use safety checker bypass if needed\npipe.safety_checker = None\n\n# Ensure proper dtype consistency\npipe = pipe.to(dtype=torch.float16)\n```\n\n**Slow generation:**\n```python\n# Use faster scheduler\nfrom diffusers import DPMSolverMultistepScheduler\npipe.scheduler = DPMSolverMultistepScheduler.from_config(pipe.scheduler.config)\n\n# Reduce steps\nimage = pipe(prompt, num_inference_steps=20).images[0]\n```\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Custom pipelines, fine-tuning, deployment\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fhuggingface.co\u002Fdocs\u002Fdiffusers\n- **Repository**: https:\u002F\u002Fgithub.com\u002Fhuggingface\u002Fdiffusers\n- **Model Hub**: https:\u002F\u002Fhuggingface.co\u002Fmodels?library=diffusers\n- **Discord**: https:\u002F\u002Fdiscord.gg\u002Fdiffusers\n","# Stable Diffusion Image Generation\n\nComprehensive guide to generating images with Stable Diffusion using the HuggingFace Diffusers library.\n\n## When to use Stable Diffusion\n\n**Use Stable Diffusion when:**\n- Generating images from text descriptions\n- Performing image-to-image translation (style transfer, enhancement)\n- Inpainting (filling in masked regions)\n- Outpainting (extending images beyond boundaries)\n- Creating variations of existing images\n- Building custom image generation workflows\n\n**Key features:**\n- **Text-to-Image**: Generate images from natural language prompts\n- **Image-to-Image**: Transform existing images with text guidance\n- **Inpainting**: Fill masked regions with context-aware content\n- **ControlNet**: Add spatial conditioning (edges, poses, depth)\n- **LoRA Support**: Efficient fine-tuning and style adaptation\n- **Multiple Models**: SD 1.5, SDXL, SD 3.0, Flux support\n\n**Use alternatives instead:**\n- **DALL-E 3**: For API-based generation without GPU\n- **Midjourney**: For artistic, stylized outputs\n- **Imagen**: For Google Cloud integration\n- **Leonardo.ai**: For web-based creative workflows\n\n## Quick start\n\n### Installation\n\n```bash\npip install diffusers transformers accelerate torch\npip install xformers  # Optional: memory-efficient attention\n```\n\n### Basic text-to-image\n\n```python\nfrom diffusers import DiffusionPipeline\nimport torch\n\n# Load pipeline (auto-detects model type)\npipe = DiffusionPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    torch_dtype=torch.float16\n)\npipe.to(\"cuda\")\n\n# Generate image\nimage = pipe(\n    \"A serene mountain landscape at sunset, highly detailed\",\n    num_inference_steps=50,\n    guidance_scale=7.5\n).images[0]\n\nimage.save(\"output.png\")\n```\n\n### Using SDXL (higher quality)\n\n```python\nfrom diffusers import AutoPipelineForText2Image\nimport torch\n\npipe = AutoPipelineForText2Image.from_pretrained(\n    \"stabilityai\u002Fstable-diffusion-xl-base-1.0\",\n    torch_dtype=torch.float16,\n    variant=\"fp16\"\n)\npipe.to(\"cuda\")\n\n# Enable memory optimization\npipe.enable_model_cpu_offload()\n\nimage = pipe(\n    prompt=\"A futuristic city with flying cars, cinematic lighting\",\n    height=1024,\n    width=1024,\n    num_inference_steps=30\n).images[0]\n```\n\n## Architecture overview\n\n### Three-pillar design\n\nDiffusers is built around three core components:\n\n```\nPipeline (orchestration)\n├── Model (neural networks)\n│   ├── UNet \u002F Transformer (noise prediction)\n│   ├── VAE (latent encoding\u002Fdecoding)\n│   └── Text Encoder (CLIP\u002FT5)\n└── Scheduler (denoising algorithm)\n```\n\n### Pipeline inference flow\n\n```\nText Prompt → Text Encoder → Text Embeddings\n                                    ↓\nRandom Noise → [Denoising Loop] ← Scheduler\n                      ↓\n               Predicted Noise\n                      ↓\n              VAE Decoder → Final Image\n```\n\n## Core concepts\n\n### Pipelines\n\nPipelines orchestrate complete workflows:\n\n| Pipeline | Purpose |\n|----------|---------|\n| `StableDiffusionPipeline` | Text-to-image (SD 1.x\u002F2.x) |\n| `StableDiffusionXLPipeline` | Text-to-image (SDXL) |\n| `StableDiffusion3Pipeline` | Text-to-image (SD 3.0) |\n| `FluxPipeline` | Text-to-image (Flux models) |\n| `StableDiffusionImg2ImgPipeline` | Image-to-image |\n| `StableDiffusionInpaintPipeline` | Inpainting |\n\n### Schedulers\n\nSchedulers control the denoising process:\n\n| Scheduler | Steps | Quality | Use Case |\n|-----------|-------|---------|----------|\n| `EulerDiscreteScheduler` | 20-50 | Good | Default choice |\n| `EulerAncestralDiscreteScheduler` | 20-50 | Good | More variation |\n| `DPMSolverMultistepScheduler` | 15-25 | Excellent | Fast, high quality |\n| `DDIMScheduler` | 50-100 | Good | Deterministic |\n| `LCMScheduler` | 4-8 | Good | Very fast |\n| `UniPCMultistepScheduler` | 15-25 | Excellent | Fast convergence |\n\n### Swapping schedulers\n\n```python\nfrom diffusers import DPMSolverMultistepScheduler\n\n# Swap for faster generation\npipe.scheduler = DPMSolverMultistepScheduler.from_config(\n    pipe.scheduler.config\n)\n\n# Now generate with fewer steps\nimage = pipe(prompt, num_inference_steps=20).images[0]\n```\n\n## Generation parameters\n\n### Key parameters\n\n| Parameter | Default | Description |\n|-----------|---------|-------------|\n| `prompt` | Required | Text description of desired image |\n| `negative_prompt` | None | What to avoid in the image |\n| `num_inference_steps` | 50 | Denoising steps (more = better quality) |\n| `guidance_scale` | 7.5 | Prompt adherence (7-12 typical) |\n| `height`, `width` | 512\u002F1024 | Output dimensions (multiples of 8) |\n| `generator` | None | Torch generator for reproducibility |\n| `num_images_per_prompt` | 1 | Batch size |\n\n### Reproducible generation\n\n```python\nimport torch\n\ngenerator = torch.Generator(device=\"cuda\").manual_seed(42)\n\nimage = pipe(\n    prompt=\"A cat wearing a top hat\",\n    generator=generator,\n    num_inference_steps=50\n).images[0]\n```\n\n### Negative prompts\n\n```python\nimage = pipe(\n    prompt=\"Professional photo of a dog in a garden\",\n    negative_prompt=\"blurry, low quality, distorted, ugly, bad anatomy\",\n    guidance_scale=7.5\n).images[0]\n```\n\n## Image-to-image\n\nTransform existing images with text guidance:\n\n```python\nfrom diffusers import AutoPipelineForImage2Image\nfrom PIL import Image\n\npipe = AutoPipelineForImage2Image.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\ninit_image = Image.open(\"input.jpg\").resize((512, 512))\n\nimage = pipe(\n    prompt=\"A watercolor painting of the scene\",\n    image=init_image,\n    strength=0.75,  # How much to transform (0-1)\n    num_inference_steps=50\n).images[0]\n```\n\n## Inpainting\n\nFill masked regions:\n\n```python\nfrom diffusers import AutoPipelineForInpainting\nfrom PIL import Image\n\npipe = AutoPipelineForInpainting.from_pretrained(\n    \"runwayml\u002Fstable-diffusion-inpainting\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\nimage = Image.open(\"photo.jpg\")\nmask = Image.open(\"mask.png\")  # White = inpaint region\n\nresult = pipe(\n    prompt=\"A red car parked on the street\",\n    image=image,\n    mask_image=mask,\n    num_inference_steps=50\n).images[0]\n```\n\n## ControlNet\n\nAdd spatial conditioning for precise control:\n\n```python\nfrom diffusers import StableDiffusionControlNetPipeline, ControlNetModel\nimport torch\n\n# Load ControlNet for edge conditioning\ncontrolnet = ControlNetModel.from_pretrained(\n    \"lllyasviel\u002Fcontrol_v11p_sd15_canny\",\n    torch_dtype=torch.float16\n)\n\npipe = StableDiffusionControlNetPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    controlnet=controlnet,\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\n# Use Canny edge image as control\ncontrol_image = get_canny_image(input_image)\n\nimage = pipe(\n    prompt=\"A beautiful house in the style of Van Gogh\",\n    image=control_image,\n    num_inference_steps=30\n).images[0]\n```\n\n### Available ControlNets\n\n| ControlNet | Input Type | Use Case |\n|------------|------------|----------|\n| `canny` | Edge maps | Preserve structure |\n| `openpose` | Pose skeletons | Human poses |\n| `depth` | Depth maps | 3D-aware generation |\n| `normal` | Normal maps | Surface details |\n| `mlsd` | Line segments | Architectural lines |\n| `scribble` | Rough sketches | Sketch-to-image |\n\n## LoRA adapters\n\nLoad fine-tuned style adapters:\n\n```python\nfrom diffusers import DiffusionPipeline\n\npipe = DiffusionPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\n# Load LoRA weights\npipe.load_lora_weights(\"path\u002Fto\u002Flora\", weight_name=\"style.safetensors\")\n\n# Generate with LoRA style\nimage = pipe(\"A portrait in the trained style\").images[0]\n\n# Adjust LoRA strength\npipe.fuse_lora(lora_scale=0.8)\n\n# Unload LoRA\npipe.unload_lora_weights()\n```\n\n### Multiple LoRAs\n\n```python\n# Load multiple LoRAs\npipe.load_lora_weights(\"lora1\", adapter_name=\"style\")\npipe.load_lora_weights(\"lora2\", adapter_name=\"character\")\n\n# Set weights for each\npipe.set_adapters([\"style\", \"character\"], adapter_weights=[0.7, 0.5])\n\nimage = pipe(\"A portrait\").images[0]\n```\n\n## Memory optimization\n\n### Enable CPU offloading\n\n```python\n# Model CPU offload - moves models to CPU when not in use\npipe.enable_model_cpu_offload()\n\n# Sequential CPU offload - more aggressive, slower\npipe.enable_sequential_cpu_offload()\n```\n\n### Attention slicing\n\n```python\n# Reduce memory by computing attention in chunks\npipe.enable_attention_slicing()\n\n# Or specific chunk size\npipe.enable_attention_slicing(\"max\")\n```\n\n### xFormers memory-efficient attention\n\n```python\n# Requires xformers package\npipe.enable_xformers_memory_efficient_attention()\n```\n\n### VAE slicing for large images\n\n```python\n# Decode latents in tiles for large images\npipe.enable_vae_slicing()\npipe.enable_vae_tiling()\n```\n\n## Model variants\n\n### Loading different precisions\n\n```python\n# FP16 (recommended for GPU)\npipe = DiffusionPipeline.from_pretrained(\n    \"model-id\",\n    torch_dtype=torch.float16,\n    variant=\"fp16\"\n)\n\n# BF16 (better precision, requires Ampere+ GPU)\npipe = DiffusionPipeline.from_pretrained(\n    \"model-id\",\n    torch_dtype=torch.bfloat16\n)\n```\n\n### Loading specific components\n\n```python\nfrom diffusers import UNet2DConditionModel, AutoencoderKL\n\n# Load custom VAE\nvae = AutoencoderKL.from_pretrained(\"stabilityai\u002Fsd-vae-ft-mse\")\n\n# Use with pipeline\npipe = DiffusionPipeline.from_pretrained(\n    \"stable-diffusion-v1-5\u002Fstable-diffusion-v1-5\",\n    vae=vae,\n    torch_dtype=torch.float16\n)\n```\n\n## Batch generation\n\nGenerate multiple images efficiently:\n\n```python\n# Multiple prompts\nprompts = [\n    \"A cat playing piano\",\n    \"A dog reading a book\",\n    \"A bird painting a picture\"\n]\n\nimages = pipe(prompts, num_inference_steps=30).images\n\n# Multiple images per prompt\nimages = pipe(\n    \"A beautiful sunset\",\n    num_images_per_prompt=4,\n    num_inference_steps=30\n).images\n```\n\n## Common workflows\n\n### Workflow 1: High-quality generation\n\n```python\nfrom diffusers import StableDiffusionXLPipeline, DPMSolverMultistepScheduler\nimport torch\n\n# 1. Load SDXL with optimizations\npipe = StableDiffusionXLPipeline.from_pretrained(\n    \"stabilityai\u002Fstable-diffusion-xl-base-1.0\",\n    torch_dtype=torch.float16,\n    variant=\"fp16\"\n)\npipe.to(\"cuda\")\npipe.scheduler = DPMSolverMultistepScheduler.from_config(pipe.scheduler.config)\npipe.enable_model_cpu_offload()\n\n# 2. Generate with quality settings\nimage = pipe(\n    prompt=\"A majestic lion in the savanna, golden hour lighting, 8k, detailed fur\",\n    negative_prompt=\"blurry, low quality, cartoon, anime, sketch\",\n    num_inference_steps=30,\n    guidance_scale=7.5,\n    height=1024,\n    width=1024\n).images[0]\n```\n\n### Workflow 2: Fast prototyping\n\n```python\nfrom diffusers import AutoPipelineForText2Image, LCMScheduler\nimport torch\n\n# Use LCM for 4-8 step generation\npipe = AutoPipelineForText2Image.from_pretrained(\n    \"stabilityai\u002Fstable-diffusion-xl-base-1.0\",\n    torch_dtype=torch.float16\n).to(\"cuda\")\n\n# Load LCM LoRA for fast generation\npipe.load_lora_weights(\"latent-consistency\u002Flcm-lora-sdxl\")\npipe.scheduler = LCMScheduler.from_config(pipe.scheduler.config)\npipe.fuse_lora()\n\n# Generate in ~1 second\nimage = pipe(\n    \"A beautiful landscape\",\n    num_inference_steps=4,\n    guidance_scale=1.0\n).images[0]\n```\n\n## Common issues\n\n**CUDA out of memory:**\n```python\n# Enable memory optimizations\npipe.enable_model_cpu_offload()\npipe.enable_attention_slicing()\npipe.enable_vae_slicing()\n\n# Or use lower precision\npipe = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)\n```\n\n**Black\u002Fnoise images:**\n```python\n# Check VAE configuration\n# Use safety checker bypass if needed\npipe.safety_checker = None\n\n# Ensure proper dtype consistency\npipe = pipe.to(dtype=torch.float16)\n```\n\n**Slow generation:**\n```python\n# Use faster scheduler\nfrom diffusers import DPMSolverMultistepScheduler\npipe.scheduler = DPMSolverMultistepScheduler.from_config(pipe.scheduler.config)\n\n# Reduce steps\nimage = pipe(prompt, num_inference_steps=20).images[0]\n```\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Custom pipelines, fine-tuning, deployment\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fhuggingface.co\u002Fdocs\u002Fdiffusers\n- **Repository**: https:\u002F\u002Fgithub.com\u002Fhuggingface\u002Fdiffusers\n- **Model Hub**: https:\u002F\u002Fhuggingface.co\u002Fmodels?library=diffusers\n- **Discord**: https:\u002F\u002Fdiscord.gg\u002Fdiffusers\n",{"name":5,"tags":52,"author":56,"license":15,"version":57,"description":7,"dependencies":58},[24,25,43,53,54,55],"Text-to-Image","Multimodal","Computer Vision","Orchestra Research","1.0.0",[59,60,61,62],"diffusers>=0.30.0","transformers>=4.41.0","accelerate>=0.31.0","torch>=2.0.0","main","90b50ed0778745a80fd5bfb13b1843d45b9e82f7","tests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fai-research\u002Fmultimodal-stable-diffusion",233,"https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust","https:\u002F\u002Fgithub.com\u002FDicklesworthstone","https:\u002F\u002Fwww.jeffreyemanuel.com\u002F","Building in NY","2026-11-15 01:54:15",{"source":8,"skillName":5,"commands":73,"prompt":83,"zipAvailable":84},[74,77,80],{"tool":75,"command":76},"npx","npx skills add Dicklesworthstone\u002Fpi_agent_rust --skill stable-diffusion-image-generation",{"tool":78,"command":79},"bunx","bunx skills add Dicklesworthstone\u002Fpi_agent_rust --skill stable-diffusion-image-generation",{"tool":81,"command":82},"pnpm","pnpm dlx skills add Dicklesworthstone\u002Fpi_agent_rust --skill stable-diffusion-image-generation","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fai-research\u002Fmultimodal-stable-diffusion\u002FSKILL.md",true,[86,92],{"path":87,"resourceType":88,"resourceTypeDesc":89,"sizeBytes":90,"sourceHtmlUrl":91},"references\u002Fadvanced-usage.md","REFERENCE","参考文档",17690,"https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fai-research\u002Fmultimodal-stable-diffusion\u002Freferences\u002Fadvanced-usage.md",{"path":93,"resourceType":88,"resourceTypeDesc":89,"sizeBytes":94,"sourceHtmlUrl":95},"references\u002Ftroubleshooting.md",12401,"https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fai-research\u002Fmultimodal-stable-diffusion\u002Freferences\u002Ftroubleshooting.md",[97,128,162,185,211,238],{"skillNo":98,"name":99,"nameZh":6,"description":100,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":101,"licenseFileUrl":102,"sourceHtmlUrl":103,"categories":104,"keywords":108,"publishedAt":127},"01M6FCR7G5A005P364Z6ZWCJDP","theme-factory","Toolkit for styling artifacts with a theme. These artifacts can be slides, docs, reportings, HTML landing pages, etc. There are 10 pre-set themes with colors\u002Ffonts that you can apply to any artifact that has been creating, or can generate a new theme on-the-fly.","Apache-2.0","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fcreative-design\u002Ftheme-factory\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fcreative-design\u002Ftheme-factory\u002FSKILL.md",[105],{"categoryNo":106,"categoryName":107,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000015","视觉设计",[109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,34,125,126],"theme factory","factory","theme","docs","toolkit","generate","artifacts","SET","fly","slides","landing","html","styling","artifact","pages","themes","you","fonts","2026-11-11 15:11:14",{"skillNo":129,"name":130,"nameZh":6,"description":131,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":101,"licenseFileUrl":132,"sourceHtmlUrl":133,"categories":134,"keywords":138,"publishedAt":47},"01M6FEGPPK0ZTKCCM0R3E3KS33","web-artifacts-builder","Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web technologies (React, Tailwind CSS, shadcn\u002Fui). Use for complex artifacts requiring state management, routing, or shadcn\u002Fui components - not for simple single-file HTML\u002FJSX artifacts.","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Futilities\u002Fweb-artifacts-builder\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Futilities\u002Fweb-artifacts-builder\u002FSKILL.md",[135],{"categoryNo":136,"categoryName":137,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000009","前端开发",[139,140,115,141,142,143,144,145,146,147,148,149,46,150,151,152,153,154,39,120,155,156,157,158,159,160,161],"web artifacts builder","web","artifacts builder","builder","frontend","css","components","react","component","routing","state management","shadcn","file","ui","Tools","Tailwind","single-file","simple","ui components","multi","for","jsx","suite",{"skillNo":163,"name":164,"nameZh":6,"description":165,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":101,"licenseFileUrl":166,"sourceHtmlUrl":167,"categories":168,"keywords":173,"publishedAt":47},"01M6FEE9VTK1W4GY21AKREJXRG","webapp-testing","Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fsecurity\u002Fwebapp-testing\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fsecurity\u002Fwebapp-testing\u002FSKILL.md",[169,172],{"categoryNo":170,"categoryName":171,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000008","测试与质量",{"categoryNo":136,"categoryName":137,"taxonomyType":21,"taxonomyTypeDesc":22},[174,175,176,143,177,178,140,179,113,180,152,181,182,183,184,34,159],"testing","webapp testing","webapp","screenshots","playwright","debugging","browser","logs","applications","behavior","local",{"skillNo":186,"name":187,"nameZh":6,"description":188,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":189,"sourceHtmlUrl":190,"categories":191,"keywords":192,"publishedAt":47},"01M6FE20F7ZTQBFWKF4MPJ2SBX","neuropixels-analysis","Neuropixels neural recording analysis. Load SpikeGLX\u002FOpenEphys data, preprocess, motion correction, Kilosort4 spike sorting, quality metrics, Allen\u002FIBL curation, AI-assisted visual analysis, for Neuropixels 1.0\u002F2.0 extracellular electrophysiology. Use when working with neural recordings, spike sorting, extracellular electrophysiology, or when the user mentions Neuropixels, SpikeGLX, Open Ephys, Kilosort, quality metrics, or unit curation.","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fscientific\u002Fneuropixels-analysis\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fscientific\u002Fneuropixels-analysis\u002FSKILL.md",[],[193,194,195,196,197,198,199,200,39,201,202,203,204,205,206,207,34,208,209,210,159,31],"analysis","neuropixels analysis","spike","metrics","data","open","quality","user","recordings","Neural","motion","visual","quality metrics","unit","sorting","curation","recording","load",{"skillNo":212,"name":213,"nameZh":6,"description":214,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":101,"licenseFileUrl":215,"sourceHtmlUrl":216,"categories":217,"keywords":221,"publishedAt":47},"01M6FDP0PDK6F1GGX395C7625Z","skill-creator","Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends Claude's capabilities with specialized knowledge, workflows, or tool integrations.","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fproductivity\u002Fskill-creator\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fproductivity\u002Fskill-creator\u002FSKILL.md",[218],{"categoryNo":219,"categoryName":220,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000023","Skill与智能体开发",[222,223,224,225,226,227,228,229,230,231,232,233,234,235,34,159,236,31,237],"skill creator","creator","workflows","create","update","capabilities","knowledge","tool","integrations","specialized","guide","new skill","existing skill","users","Existing","new",{"skillNo":239,"name":240,"nameZh":6,"description":241,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":242,"sourceHtmlUrl":243,"categories":244,"keywords":246,"publishedAt":47},"01M6FDM8Y7VK7NYG9SM7QPA3PW","notebooklm","Use this skill to query your Google NotebookLM notebooks directly from Claude Code for source-grounded, citation-backed answers from Gemini. Browser automation, library management, persistent auth. Drastically reduced hallucinations through document-only responses.","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fproductivity\u002Fnotebooklm\u002FLICENSE","https:\u002F\u002Fgithub.com\u002FDicklesworthstone\u002Fpi_agent_rust\u002Fblob\u002Fmain\u002Ftests\u002Fext_conformance\u002Fartifacts\u002Ftemplates-davila7\u002Fcli-tool\u002Fcomponents\u002Fskills\u002Fproductivity\u002Fnotebooklm\u002FSKILL.md",[245],{"categoryNo":219,"categoryName":220,"taxonomyType":21,"taxonomyTypeDesc":22},[240,247,248,249,250,251,252,180,253,254,39,255,256,257,258,159,259],"google","browser automation","gemini","automation","auth","code","library","management","only","document","query","Citation","source"]