WAN 2.1 is now officially launched with the brand-new AI Video Generation feature, supporting both Text-to-Video and Image-to-Video creation methods. Whether you're a novice or a professional in video production, WAN AI Video Generation can effortlessly help you transform your ideas into high-quality video content. This document will provide a detailed introduction to the features, prompt formulas, and prompt dictionaries, along with other usage tips, to help you get started quickly and embark on your video creation journey!
Table of Contents
Feature Introduction | Prompt Formulas | Prompt Dictionary | |
---|---|---|---|
Text-to-Video | Basic Formula | Shot Type | |
Image-to-Video | Advanced Formula | Perspective | |
Camera Movement | Lens | ||
Transformation Formula | More |
Feature Introduction
Text-to-Video
Basic Introduction
Enter text prompts to describe the visuals and motion of the video, and generate a video clip. The feature supports both Chinese and English, as well as multiple aspect ratios such as 16:9, 4:3, 1:1, 3:4, and 9:16, to meet the needs of various scenarios and devices. Whether you're creating content for social media, presentations, or other platforms, this flexibility ensures your video fits perfectly!
Smart Expansion
The Smart Expansion feature is provided, which can generate more comprehensive and detailed prompt descriptions based on simple input keywords through intelligent expansion. This significantly enhances the richness and expressiveness of the video visuals. Below is an example of how to use it:
Prompt Writing
Prompts are a key factor in controlling the content and effects of video visuals. By understanding prompt techniques, you can significantly enhance the quality and control of video visuals. For more advanced techniques, refer to the Prompt Formulas and Prompt Dictionary.
Prompt = Subject + Scene + Motion
Subject
The subject is the main focus of the video content, which can be a person, animal, plant, object, or even an imagined entity that does not physically exist.
Scene
The scene is the environment where the subject is located, including the background and foreground. It can be a real physical space or an imagined fictional setting.
Motion
Motion includes the specific movements of the subject and the motion states of non-subject elements. It can be static, slight movement, significant movement, partial movement, or overall motion.
Example Effect
Prompt Example: A black-haired ancient-style girl wearing a mecha Hanfu, with her hair tied in a bun, turns to look at the camera. Her soft and glossy hair dances lightly in the air.
Image-to-Video
Basic Introduction
Upload or drag an image to serve as the first frame of the video, accompanied by text describing the motion process and camera movement effects. The uploaded image supports cropping in any aspect ratio, and prompt descriptions are supported in both Chinese and English.
Example Effect
Image + Prompt Example | Video Effect |
---|---|
Prompt Formulas
Prompts are used to describe the content and motion processes included in a video. They are a key factor in controlling the content and effects of video visuals. The more complete, precise, and rich the prompt description, the higher the quality of the generated video, and the closer it aligns with the desired content. To help you get started quickly, we provide four prompt formulas for different usage needs:
Basic Formula
Suitable for new users trying AI video for the first time, or those using AI video for inspiration. Simple and free-form prompts can generate more imaginative videos.
Prompt = Subject + Scene + Motion
Subject
The subject is the main focus of the video content, which can be a person, animal, plant, object, or even an imagined entity that does not physically exist.
Scene
The scene is the environment where the subject is located, including the background and foreground. It can be a real physical space or an imagined fictional setting.
Motion
Motion includes the specific movements of the subject and the motion states of non-subject elements. It can be static, slight movement, significant movement, partial movement, or overall motion.
Advanced Formula
Suitable for users with some experience in AI video. Adding more detailed descriptions to the basic formula can effectively enhance the texture, vividness, and storytelling of the video.
Prompt = Subject (Subject Description) + Scene (Scene Description) + Motion (Motion Description) + Camera Language + Atmosphere Words + Stylization
Subject (Subject Description)
Describes the detailed appearance features of the subject, using adjectives or short phrases. For example, "a black-haired Miao girl in ethnic attire" or "a fairy from another world with a pair of fantastical wings."
Scene (Scene Description)
Describes the detailed features of the environment where the subject is located, using adjectives or short phrases.
Motion (Motion Description)
Describes the detailed features of the motion, including the amplitude, speed, and effects of the movement. For example, "swaying violently," "moving slowly," or "shattering a broken jar."
Camera Language
Includes atmosphere, perspective, lens, and motion. Common camera language can be found in the prompt dictionary.
Atmosphere Words
Describes the atmosphere of the audiovisual scene, such as "dreamy," "lonely," or "grand." Common atmosphere words can be found in the prompt dictionary.
Stylization
Describes the stylistic language of the visuals, such as "dreamy," "fantasy art," or "post-apocalyptic style." Common stylization terms can be found in the prompt dictionary.
Camera Movement
Suitable for users with specific requirements for camera movement and professional video output scenarios. Adding more detailed camera movement descriptions to the basic or advanced formulas can effectively enhance the dynamism and narrative quality of the video.
Prompt = Camera Movement Description + Subject (Subject Description) + Scene (Scene Description) + Motion (Motion Description) + Camera Language + Atmosphere Words + Stylization
Camera Movement Description
Describes the specific movements of the camera. Effectively combining camera movements with changes in visual content on the timeline can significantly enhance the richness and professionalism of the video narrative. Users can imagine and script the camera movement process from a director's perspective. It is important to keep the duration of camera movements within 5 seconds to avoid overly complex sequences.
Subject (Subject Description)
Describes the detailed appearance features of the subject, using adjectives or short phrases. For example, "a black-haired Miao girl in ethnic attire" or "a fairy from another world with a pair of fantastical wings."
Scene (Scene Description)
Describes the detailed features of the environment where the subject is located, using adjectives or short phrases.
Motion (Motion Description)
Describes the detailed features of the motion, including the amplitude, speed, and effects of the movement. For example, "swaying violently," "moving slowly," or "shattering a broken jar."
Camera Language
Includes atmosphere, perspective, lens, and motion. Common camera language can be found in the prompt dictionary.
Atmosphere Words
Describes the atmosphere of the audiovisual scene, such as "dreamy," "lonely," or "grand." Common atmosphere words can be found in the prompt dictionary.
Stylization
Describes the stylistic language of the visuals, such as "dreamy," "fantasy art," or "post-apocalyptic style." Common stylization terms can be found in the prompt dictionary.
Prompt Example and Video Effect
The camera starts with a full screen of an antique water-patterned screen, slowly panning to the left to reveal a classical-style girl sitting behind the screen. She is wearing a chiffon dress with her hair tied up in a high bun, attending an online video conference.
Transformation Formula
The transformation formula is suitable for users with clear creative needs. Adding transformation descriptions on the basis of basic or advanced formulas can effectively enhance the fun of videos and bring unexpected visual effects.
Prompt = Subject A (Description) + Transformation Process + Subject B (Description) + Scene (Description) + Movement (Description) + Camera Language + Atmosphere Words + Stylization
Subject A
Refers to the characteristics and state of the subject before transformation.
Transformation Process
The transformation process describes the subject's change from form A to form B. Detailed process descriptions can effectively enhance the naturalness and vividness of the transformation.
Subject B
Refers to the characteristics and state of the subject after transformation.
Prompt Example and Video Effect
- Anime Style. In a corner of the city street, a black cat is crouching under a streetlight, gazing at the distant neon lights. Suddenly, a blue light descends from the sky, quickly wrapping around its body. The black cat rises into the air amidst the light, its black fur gradually dissipating into the air, and its body rapidly lengthening. Its fur turns into a black tailored suit, outlining a slender silhouette. The cat ears disappear, and the facial contours gradually become clear, eventually turning into a handsome and cold young face. He lightly lands on the ground, his suit fluttering slightly in the night breeze, the blue light gradually fading, like a mysterious young man walking out of a future world, elegant and confident.
Prompt Dictionary
By writing prompts from different dimensions, you can enhance the controllability and expressiveness of the generated video in specific dimensions. We have carefully prepared common dimensions and prompt examples for reference, and we also welcome everyone to explore more usage tips.