1What is the goal of AI video generation?
To create video sequences from various inputs, most commonly text prompts or images.
2Which early (2022) model focused on generating longer videos from sequential prompts?
Phenaki
3What is a major hurdle in AI video generation mentioned as a 'Core Challenge'?
Maintaining temporal consistency (ensuring characters, objects, and styles remain coherent).
4What technique allows changing the text prompt during generation to evolve the scene smoothly?
Prompt Travel
5What technique adds conditional control to diffusion models using inputs like human pose estimations, depth maps, or Canny edges?
ControlNet
6What is IP-Adapter?
A lightweight neural network adapter that enables image prompting by guiding generation with a reference image.
7How does IP-Adapter work?
By injecting image features into the diffusion model's cross-attention layers.
8What is LoRA (Low-Rank Adaptation)?
An efficient fine-tuning method to adapt large pre-trained models to specific characters or styles without full retraining.
9What is the primary purpose of 'Character Sheets' in the context of LoRA?
As training data for creating a character-specific LoRA.
10What is the focus of specialized models like 'Animate Anyone'?
Animating a character from a reference image based on a driving pose video.
11What component does the WAN model use to compress video/images into a latent space and decode them back?
Video Autoencoder (VAE)
12What component does WAN use for the core denoising process in the latent space?
Diffusion Transformer (DiT) blocks
13What architecture component does a Diffusion Transformer (DiT) primarily replace compared to earlier diffusion models?
The convolutional U-Net structure.
14What does the 'Mixture of Experts' (MoE) approach in WAN 2.2 involve?
Using different expert models or components specialized for different stages (e.g., high vs. low noise levels).
15Name one potential negative application (misuse) of generative AI video.
Disinformation (or deepfake commodification, scams, harassment).
16How does Prompt Travel allow for intentional changes during video generation?
By modifying the text embedding used for conditioning the diffusion model at different specified frame numbers.