Apply AnimateDiff Model 🎭🅐🅓②

Documentation

• Class name: ADE_ApplyAnimateDiffModelSimple
• Category: Animate Diff 🎭🅐🅓/② Gen2 nodes ②
• Output node: False

This node is designed to apply a motion model to animate images or sequences, offering a simplified interface for integrating motion effects. It abstracts the complexities involved in the animation process, making it accessible for users to apply predefined motion models to their content.

Input types

Required

• motion_model
  • Specifies the motion model to be applied. It is crucial for defining the animation behavior and effects on the target content.
  • Comfy dtype: MOTION_MODEL_ADE
  • Python dtype: MotionModelPatcher

Optional

• motion_lora
  • Optional parameter for incorporating motion Lora adjustments, enhancing the animation with additional motion effects.
  • Comfy dtype: MOTION_LORA
  • Python dtype: MotionLoraList
• scale_multival
  • Optional parameter for scaling effects, providing flexibility in the intensity of the applied motion.
  • Comfy dtype: MULTIVAL
  • Python dtype: Optional[MultiVal]
• effect_multival
  • Optional parameter for effect adjustments, enabling customization of the visual impact of the motion.
  • Comfy dtype: MULTIVAL
  • Python dtype: Optional[MultiVal]
• ad_keyframes
  • Optional parameter for specifying keyframes, allowing for more controlled and precise animation effects.
  • Comfy dtype: AD_KEYFRAMES
  • Python dtype: Optional[ADKeyframeGroup]

Output types

• m_models
  • Comfy dtype: M_MODELS
  • Outputs the modified motion models after applying the specified motion effects, keyframes, and adjustments.
  • Python dtype: MotionModelGroup

Usage tips

• Infra type: GPU
• Common nodes: unknown

Source code

class ApplyAnimateDiffModelBasicNode:
    @classmethod
    def INPUT_TYPES(s):
        return {
            "required": {
                "motion_model": ("MOTION_MODEL_ADE",),
            },
            "optional": {
                "motion_lora": ("MOTION_LORA",),
                "scale_multival": ("MULTIVAL",),
                "effect_multival": ("MULTIVAL",),
                "ad_keyframes": ("AD_KEYFRAMES",),
            }
        }

    RETURN_TYPES = ("M_MODELS",)
    CATEGORY = "Animate Diff 🎭🅐🅓/② Gen2 nodes ②"
    FUNCTION = "apply_motion_model"

    def apply_motion_model(self,
                           motion_model: MotionModelPatcher, motion_lora: MotionLoraList=None,
                           scale_multival=None, effect_multival=None, ad_keyframes=None):
        # just a subset of normal ApplyAnimateDiffModelNode inputs
        return ApplyAnimateDiffModelNode.apply_motion_model(self, motion_model, motion_lora=motion_lora,
                                                            scale_multival=scale_multival, effect_multival=effect_multival,
                                                            ad_keyframes=ad_keyframes)