TemporalDiff is a finetune of the original AnimateDiff weights on a higher resolution dataset (512x512).
Testing so far indicates a higher level of video coherency than the original weights, i also adjusted the stride from 4 to 2 frames to improve how smooth the motion was.
Current limitations are that the labelling for my dataset was a bit off, so it has slightly reduced ability to interpret the prompt, i'll be releasing a new version that fixes that soon.
This should work the same as any the base model in terms of use, just drag and drop it into comfy ui or the animatediff repository and use as normal.
This does not require any additional memory to run as the generations were 512x512 before, the training was just done at 256x256.
评论