Flatten skill category directory structure
This commit is contained in:
@@ -0,0 +1,143 @@
|
||||
# Wan 2.6 Video Generation - Prompting Guide
|
||||
|
||||
## Model Overview
|
||||
|
||||
| Attribute | Value |
|
||||
|-----------|-------|
|
||||
| Tool Name | `wan_i2v_generation` (single) / `batch_wan_i2v_generation` (batch) |
|
||||
| Duration | 5s, 10s, 15s |
|
||||
| Resolution | 720P, 1080P |
|
||||
| Input Modes | I2V (first frame image required) |
|
||||
| Special Features | Audio-driven video generation (lip sync), multi-shot mode |
|
||||
|
||||
## Core Principles
|
||||
|
||||
### 1. Pure I2V Model
|
||||
|
||||
Wan 2.6 **requires a first frame image** (`image_path`) — pure text-to-video is not supported. The prompt's role is to guide how the first frame comes to life.
|
||||
|
||||
### 2. Basic Prompt Formula
|
||||
|
||||
```
|
||||
[Subject] + [Action] + [Scene/Environment]
|
||||
```
|
||||
|
||||
Advanced version:
|
||||
|
||||
```
|
||||
[Subject] + [Action] + [Scene/Environment] + [Aesthetic control] + [Stylization]
|
||||
```
|
||||
|
||||
### 3. Audio-Driven Generation (Core MV Scenario)
|
||||
|
||||
Provide an audio file via `audio_path`, and Wan will generate video driven by the audio's rhythm and vocal content:
|
||||
- **Lip sync**: First frame of a speaking/singing character + corresponding audio clip
|
||||
- **Rhythm matching**: First frame of dance/movement + music clip
|
||||
- **Atmosphere linking**: Environment scene + background music
|
||||
|
||||
Batch generation (`batch_wan_i2v_generation`) supports up to 3 concurrent jobs — **the core tool for MV production**.
|
||||
|
||||
### 4. Single vs Multi Shot
|
||||
|
||||
- `shot_type: "single"` (default): Single shot — the entire video is one continuous shot
|
||||
- `shot_type: "multi"`: Multi-shot — the model may switch between different angles/framings within the video
|
||||
|
||||
MV scenes typically use single, unless you need to simulate rapid editing.
|
||||
|
||||
## Best Practices
|
||||
|
||||
### Prompt Style: Concise and Direct
|
||||
|
||||
Wan works best with **short, direct prompts** — long descriptions are not needed:
|
||||
|
||||
```
|
||||
✓ "A woman singing emotionally, close-up, tears in her eyes, soft lighting"
|
||||
✗ "In this beautifully composed cinematic masterpiece, we see an incredibly talented young woman who appears to be in her late twenties, performing a deeply emotional song..."
|
||||
```
|
||||
|
||||
### Action Verbs
|
||||
|
||||
Use **clear action verbs** to drive motion:
|
||||
|
||||
| Category | Example Verbs |
|
||||
|----------|---------------|
|
||||
| Character actions | walks, runs, turns, reaches, dances, sings, speaks |
|
||||
| Camera movement | camera pans, camera zooms in, camera orbits, camera tilts up |
|
||||
| Environment motion | wind blows, water flows, clouds drift, leaves fall, fire flickers |
|
||||
| Lighting changes | light fades, sunlight breaks through, shadows shift |
|
||||
|
||||
### Camera Movement Modifiers
|
||||
|
||||
```
|
||||
slow camera push in → Slow push forward
|
||||
smooth tracking shot → Smooth tracking
|
||||
handheld camera movement → Handheld shake
|
||||
static locked-off camera → Completely static
|
||||
gentle camera sway → Subtle swaying (simulates breathing feel)
|
||||
```
|
||||
|
||||
### Duration Planning
|
||||
|
||||
| Duration | Suitable Content | Action Complexity |
|
||||
|----------|-----------------|-------------------|
|
||||
| 5s | Single expression change, simple gesture, static atmosphere | 1 action |
|
||||
| 10s | Complete action sequence, scene atmosphere, simple interaction | 2-3 actions |
|
||||
| 15s | Full narrative segment, multi-step action sequences | 3-4 actions |
|
||||
|
||||
### Audio-Driven Best Practices (MV Scenarios)
|
||||
|
||||
1. **Cut audio clips precisely**: Use `audio_subclip_batch` to pre-split by timestamp
|
||||
2. **Character's mouth slightly open in first frame**: Produces more natural lip sync
|
||||
3. **Audio duration ≤ video duration**: Audio cannot be longer than the video
|
||||
4. **Moderate-speed segments work best**: Very fast rap may not sync properly
|
||||
5. **Unified resolution for batch generation**: Makes subsequent stitching easier
|
||||
|
||||
## Common Pitfalls
|
||||
|
||||
1. **First frame image is required**: Missing the first frame will cause an error
|
||||
2. **Don't write overly long prompts**: Under 50 words works best
|
||||
3. **Don't describe what's already in the first frame**: The model already sees it — focus on describing **changes and motion**
|
||||
4. **Don't write contradictory actions with audio**: If the audio is a quiet piano piece, don't write "energetic dancing"
|
||||
5. **Quality may drop in the second half of 15s videos**: Place important content in the first 10s
|
||||
|
||||
## Example Prompts
|
||||
|
||||
### MV Lip Sync (5s, I2V + audio)
|
||||
|
||||
```
|
||||
image_path: [singer close-up first frame]
|
||||
audio_path: [corresponding song clip]
|
||||
prompt: "Close-up, a woman singing passionately, subtle head movements, emotional expression, cinematic lighting"
|
||||
duration: 5
|
||||
```
|
||||
|
||||
### Atmospheric B-Roll (10s, I2V)
|
||||
|
||||
```
|
||||
image_path: [rainy city street first frame]
|
||||
prompt: "Rain falling on empty street, reflections shimmering on wet asphalt, camera slowly moves forward, moody atmospheric lighting, neon signs flickering"
|
||||
duration: 10
|
||||
```
|
||||
|
||||
### Character Action (10s, I2V)
|
||||
|
||||
```
|
||||
image_path: [woman in traditional dress standing first frame]
|
||||
prompt: "Woman in traditional dress turns around gracefully, her long sleeves flowing in the wind, cherry blossoms falling around her, slow motion, ethereal atmosphere"
|
||||
duration: 10
|
||||
```
|
||||
|
||||
### MV Batch Generation Example
|
||||
|
||||
```python
|
||||
# batch_wan_i2v_generation parameter example
|
||||
image_paths: [scene1.jpg, scene2.jpg, scene3.jpg]
|
||||
audio_paths: [clip1.wav, clip2.wav, clip3.wav]
|
||||
prompts: [
|
||||
"Singer performing emotionally, close-up, tears rolling down, soft warm lighting",
|
||||
"Wide shot, figure walking alone on moonlit beach, waves crashing, melancholic atmosphere",
|
||||
"Two hands reaching for each other in slow motion, golden hour backlight, romantic"
|
||||
]
|
||||
durations: [5, 10, 5]
|
||||
resolution: "1080P"
|
||||
```
|
||||
Reference in New Issue
Block a user