AI Video Generation - General Discussion, Tips, Tricks, Frustrations and Showcases

[Casshern2]

If the LoRA you're after is of a specific looking (or just specific) person, just my opinion, but I would opt for working on the LoRA with an image model. That way I could use it to place that person in any environment I wanted via prompts, and then send the images through a video model like Wan or LTX. I think it is harder and more hardware intense to try to train a video LoRA for a specific person.

Am I understanding that to be your goal? Train a video LoRA to produce a specific subject?

 

[kharo88]

Yes, you're correct, my goal is to train a character LoRA to use with, say, wan 2.2 14B. I'm not familiar with any image models, but I'll look into that. I didn't even think about using an image gen AI, then using the resulting pictures with a video gen AI, but yeah, you're definitely right that training a LoRA for an image model should be less resource intensive. I'll report back once I have something to show!

(Edit: I completely misunderstood your previous post. I thought that you meant that training a LoRA on videos was not possible with my rig, but training one on images was, but now I get it. You didn't mean training a LoRA on videos or images for a video gen AI, but training one on images for an image gen AI.)