Popiai-skill/content-creation/video-prompting/references/models/wan/prompting.md

Wan 2.6 Video Generation - Prompting Guide

Model Overview

Attribute	Value
Tool Name	wan_i2v_generation (single) / batch_wan_i2v_generation (batch)
Duration	5s, 10s, 15s
Resolution	720P, 1080P
Input Modes	I2V (first frame image required)
Special Features	Audio-driven video generation (lip sync), multi-shot mode

Core Principles

1. Pure I2V Model

Wan 2.6 requires a first frame image (image_path) — pure text-to-video is not supported. The prompt's role is to guide how the first frame comes to life.

2. Basic Prompt Formula

[Subject] + [Action] + [Scene/Environment]

Advanced version:

[Subject] + [Action] + [Scene/Environment] + [Aesthetic control] + [Stylization]

3. Audio-Driven Generation (Core MV Scenario)

Provide an audio file via audio_path, and Wan will generate video driven by the audio's rhythm and vocal content:

• Lip sync: First frame of a speaking/singing character + corresponding audio clip
• Rhythm matching: First frame of dance/movement + music clip
• Atmosphere linking: Environment scene + background music

Batch generation (batch_wan_i2v_generation) supports up to 3 concurrent jobs — the core tool for MV production.

4. Single vs Multi Shot

• shot_type: "single" (default): Single shot — the entire video is one continuous shot
• shot_type: "multi": Multi-shot — the model may switch between different angles/framings within the video

MV scenes typically use single, unless you need to simulate rapid editing.

Best Practices

Prompt Style: Concise and Direct

Wan works best with short, direct prompts — long descriptions are not needed:

✓ "A woman singing emotionally, close-up, tears in her eyes, soft lighting"
✗ "In this beautifully composed cinematic masterpiece, we see an incredibly talented young woman who appears to be in her late twenties, performing a deeply emotional song..."

Action Verbs

Use clear action verbs to drive motion:

Category	Example Verbs
Character actions	walks, runs, turns, reaches, dances, sings, speaks
Camera movement	camera pans, camera zooms in, camera orbits, camera tilts up
Environment motion	wind blows, water flows, clouds drift, leaves fall, fire flickers
Lighting changes	light fades, sunlight breaks through, shadows shift

Camera Movement Modifiers

slow camera push in          → Slow push forward
smooth tracking shot         → Smooth tracking
handheld camera movement     → Handheld shake
static locked-off camera     → Completely static
gentle camera sway           → Subtle swaying (simulates breathing feel)

Duration Planning

Duration	Suitable Content	Action Complexity
5s	Single expression change, simple gesture, static atmosphere	1 action
10s	Complete action sequence, scene atmosphere, simple interaction	2-3 actions
15s	Full narrative segment, multi-step action sequences	3-4 actions

Audio-Driven Best Practices (MV Scenarios)

1. Cut audio clips precisely: Use audio_subclip_batch to pre-split by timestamp
2. Character's mouth slightly open in first frame: Produces more natural lip sync
3. Audio duration ≤ video duration: Audio cannot be longer than the video
4. Moderate-speed segments work best: Very fast rap may not sync properly
5. Unified resolution for batch generation: Makes subsequent stitching easier

Common Pitfalls

1. First frame image is required: Missing the first frame will cause an error
2. Don't write overly long prompts: Under 50 words works best
3. Don't describe what's already in the first frame: The model already sees it — focus on describing changes and motion
4. Don't write contradictory actions with audio: If the audio is a quiet piano piece, don't write "energetic dancing"
5. Quality may drop in the second half of 15s videos: Place important content in the first 10s

Example Prompts

MV Lip Sync (5s, I2V + audio)

image_path: [singer close-up first frame]
audio_path: [corresponding song clip]
prompt: "Close-up, a woman singing passionately, subtle head movements, emotional expression, cinematic lighting"
duration: 5

Atmospheric B-Roll (10s, I2V)

image_path: [rainy city street first frame]
prompt: "Rain falling on empty street, reflections shimmering on wet asphalt, camera slowly moves forward, moody atmospheric lighting, neon signs flickering"
duration: 10

Character Action (10s, I2V)

image_path: [woman in traditional dress standing first frame]
prompt: "Woman in traditional dress turns around gracefully, her long sleeves flowing in the wind, cherry blossoms falling around her, slow motion, ethereal atmosphere"
duration: 10

MV Batch Generation Example

# batch_wan_i2v_generation parameter example
image_paths: [scene1.jpg, scene2.jpg, scene3.jpg]
audio_paths: [clip1.wav, clip2.wav, clip3.wav]
prompts: [
    "Singer performing emotionally, close-up, tears rolling down, soft warm lighting",
    "Wide shot, figure walking alone on moonlit beach, waves crashing, melancholic atmosphere",
    "Two hands reaching for each other in slow motion, golden hour backlight, romantic"
]
durations: [5, 10, 5]
resolution: "1080P"