comfyui-prompt-engineer

What this skill does

# ComfyUI Prompt Engineer

Generates optimized prompts tailored to specific models and identity methods. Different models respond differently to prompts.

## Model-Specific Prompt Rules

### FLUX.1 (dev/schnell/Kontext)

- **Style**: Natural language descriptions work best
- **CFG**: 3.5-4 (very low)
- **Quality tags**: Minimal - FLUX doesn't need "masterpiece, best quality"
- **Length**: Medium (50-100 words)
- **Structure**: `{subject description}, {setting}, {lighting}, {camera/style}`

**Good FLUX prompt:**
```
photorealistic portrait of a woman with auburn hair and green eyes, freckles across
her nose and cheeks, wearing a cream knit sweater, sitting in a cafe with warm ambient
lighting, shallow depth of field, shot on Sony A7IV, 85mm lens
```

**Bad FLUX prompt (too many quality tags):**
```
masterpiece, best quality, 8k uhd, highly detailed, photorealistic portrait...
```

### SDXL (RealVisXL, Juggernaut, etc.)

- **Style**: Quality tags at front help significantly
- **CFG**: 7-9
- **Quality tags**: Include `masterpiece, best quality, photorealistic`
- **Length**: Medium-long (50-150 words)
- **Structure**: `{quality tags}, {trigger word}, {subject}, {details}, {setting}, {style}`
- **Weighted syntax**: Supported `(important:1.3)` or `((very important))`

**Good SDXL prompt:**
```
masterpiece, best quality, sage_character, photorealistic portrait of a woman,
detailed skin texture with freckles, emerald green eyes, auburn copper hair,
natural lighting from window, indoor setting, shallow depth of field,
RAW photo quality, 8k uhd, film grain
```

### SD 1.5

- **Style**: Tag-based works best
- **CFG**: 7-8
- **Quality tags**: Essential
- **Length**: Shorter (30-80 words)
- **Structure**: `{quality}, {trigger}, {subject}, {details}, {style tags}`

### Wan 2.1/2.2 (Video)

- **Style**: Concise motion descriptions
- **CFG**: 5-7
- **Quality tags**: Minimal
- **Length**: Short (20-50 words)
- **Focus**: Describe the motion, not just the appearance
- **Structure**: `{subject}, {action/motion}, {setting}, {quality}`

**Good Wan prompt:**
```
young woman with auburn hair, talking naturally with gentle hand gestures,
seated at a modern desk, soft studio lighting, high quality
```

### AnimateDiff

- **Style**: Same as base model (SD1.5/SDXL) but add motion keywords
- **Motion keywords**: Include camera/subject motion description
- **Length**: Same as base model

## With Identity Methods

### InstantID Prompts

**Key adjustments:**
- DO NOT describe specific facial features (the model provides them)
- DO describe everything else: clothing, pose, setting, lighting
- Keep CFG at 4-5

```
photorealistic portrait, wearing black leather jacket, standing in an alley,
dramatic side lighting, urban setting, moody atmosphere, 8k quality
```

### PuLID Prompts

**Key adjustments:**
- Can include some facial descriptions (PuLID is more tolerant)
- Method "neutral" for realistic, "fidelity" for exact match
- CFG 5-7

```
sage_character, photorealistic portrait, green eyes visible, natural makeup,
professional headshot, neutral grey background, studio lighting
```

### IP-Adapter FaceID

**Key adjustments:**
- Describe the style you want, not the face
- weight_type "style transfer" for 3D→realistic
- Standard CFG for base model

```
photorealistic portrait, DSLR photo quality, natural skin texture,
warm indoor lighting, bokeh background, professional photography
```

### FLUX Kontext (Editing)

**Key adjustments:**
- Describe the EDIT, not the full image
- Be specific about what to change
- Mention what to preserve

```
Change the outfit to a formal black evening dress while keeping the face,
hair, and pose exactly the same. Add subtle jewelry.
```

### With Character LoRA

**Key adjustments:**
- ALWAYS include trigger word first
- Don't describe features the LoRA has learned
- Focus on what varies: pose, clothing, setting, lighting

```
sage_character, standing on a rooftop at sunset, wind blowing hair,
wearing casual summer dress, city skyline behind, golden hour lighting,
cinematic composition
```

## Negative Prompt Templates

### Universal Negative (SDXL/SD1.5)
```
(worst quality:1.4), (low quality:1.4), blurry, deformed, bad anatomy,
bad hands, extra fingers, missing fingers, extra limbs, fused fingers,
text, watermark, signature, jpeg artifacts, username, error
```

### Photorealism Negative
```
3d render, cartoon, anime, illustration, painting, drawing, cgi,
plastic skin, smooth skin, airbrushed, video game, doll, mannequin,
oversaturated, artificial lighting
```

### Video Negative (Wan/AnimateDiff)
```
static, frozen, jerky motion, low quality, blurry, distorted face,
bad anatomy, glitch, artifacts, flickering, jittery, unnatural movement
```

### FLUX Negative (keep minimal)
```
blurry, low quality, distorted, deformed, ugly, watermark, text
```

## Prompt Construction Workflow

1. **Get character profile** from `projects/{project}/characters/{name}/profile.yaml`
2. **Get target model** from inventory/user preference
3. **Apply model rules** from above
4. **Add identity method modifiers** if applicable
5. **Include trigger word** if LoRA is being used
6. **Draft positive + negative** pair
7. **Review against past successes** in character's `generation_history`
8. **Adjust CFG** recommendation based on method stack

## Reference

- `references/prompt-templates.md` - Full template library with examples
- `references/workflows.md` - CFG and sampler settings per workflow
- Character profiles in `projects/` for trigger words and feature descriptions