Wan2.1 14B T2V LoRAs
Collection
A collection of Remade's Wan2.1 14B T2V LoRAs
• 20 items • Updated • 35
import torch
from diffusers import DiffusionPipeline
from diffusers.utils import export_to_video
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-T2V-14B", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("Remade-AI/Lego")
prompt = "l3g0_5ty13 Lego animation style, a close-up shot of a Lego pirate minifigure with a black tricorn hat, an eye patch, and a red coat. He is holding a silver cutlass in his right hand, and a small Lego parrot is perched on his shoulder. The background is a blurry mix of blue and brown Lego bricks resembling an ocean scene."
output = pipe(prompt=prompt).frames[0]
export_to_video(output, "output.mp4")Lego Style LoRA for Wan2.1 14B T2V
Overview
This LoRA is trained on the Wan2.1 14B T2V model and allows you to generate videos in Lego style!
Features
- Trained on the Wan2.1 14B T2V base model
- Consistent results across different object and scenes types
- Simple prompt examples that are easy to adapt
Community
- Discord: Join our community to generate videos with this LoRA for free
- Request LoRAs: We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!
- Prompt
- l3g0_5ty13 Lego animation style, a close-up shot of a Lego pirate minifigure with a black tricorn hat, an eye patch, and a red coat. He is holding a silver cutlass in his right hand, and a small Lego parrot is perched on his shoulder. The background is a blurry mix of blue and brown Lego bricks resembling an ocean scene.
- Prompt
- l3g0_5ty13 Lego animation style, a Lego figure of a cat with a blue bow tie is walking down a street, with cars driving on the road beside him.
- Prompt
- l3g0_5ty13 Lego animation style, a Lego spaceship flies through space, with planets in the background.
- Prompt
- l3g0_5ty13 Lego animation style, a close-up shot of a Lego minifigure with sunglasses and a black leather jacket, sitting inside a Lego sports car. His hands grip the tiny steering wheel, and the dashboard has tiny glowing screens. The background is a blurry city filled with neon Lego signs.
Model File and Inference Workflow
📥 Download Links:
- lego_35_epochs.safetensors - LoRA Model File
- wan_txt2vid_lora_workflow.json - Wan T2V with LoRA Workflow for ComfyUI
Recommended Settings
- LoRA Strength: 1.0
- Embedded Guidance Scale: 6.0
- Flow Shift: 5.0
Trigger Words
The key trigger phrase is: l3g0_5ty13 Lego animation style
Prompt Template
For prompting, check out the example prompts; this way of prompting seems to work very well.
ComfyUI Workflow
This LoRA works with a modified version of Kijai's Wan Video Wrapper workflow. The main modification is adding a Wan LoRA node connected to the base model.
See the Downloads section above for the modified workflow.
Model Information
The model weights are available in Safetensors format. See the Downloads section above.
Training Details
- Base Model: Wan2.1 14B T2V
- Training Data: Trained on 1 minute of video comprised of 25 short clips (each clip captioned separately) of various Lego style scenes.
- Epochs: 35
Additional Information
Training was done using Diffusion Pipe for Training
Acknowledgments
Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!
- Downloads last month
- 75
Model tree for Remade-AI/Lego
Base model
Wan-AI/Wan2.1-T2V-14B