EDVARD TOTH

EDVARD TOTH

art | design | technology | entertainment

Menu
  • Posts
  • News
  • About
  • Games
    • The Teal Sphere
    • Casino Games
      • Catch you on the flipside
      • Gamblit Gallery
      • Big expo, much wow
      • Expo Schmexpo
      • Deal or No Deal
      • Chasing Goldilocks
      • TriStation launched!
      • I know what you did at G2E
      • Model G launched!
      • Gaming expo of the undead
      • The skill of being lucky
      • Gamblit interactive table games
      • Gamblit mobile games
    • Mobile & Casual Games
      • BINGO Blitz
      • Solitaire and Prizes
      • Serf Wars
      • Action AllStars
      • Tiki Resort
      • MonkWerks
      • Snood
    • Console Games
      • Jak X Combat Racing
      • Jak 3
      • The Incredibles
      • Spongebob Squarepants: BFBB
      • True Crime: Streets of L.A.
      • Ghostworld / Fishdemo
      • Star Wars: Demolition
      • Vigilante 8: Second Offense
    • Perihelion
  • Art
    • The Tower
    • Banshee Waifu
    • Dark Architecture
    • AI-dventures in a Strange Realm
    • AI-pocalypse
    • The Teal Sphere
    • Gamblit Gallery
    • Archive Gallery
    • Vintage Pixel Gallery
    • Photography
    • Korn video
  • AI
    • All-In-Wan Video Workflow
    • The Tower
    • Starter Character Workflow
    • Banshee Waifu
    • Dark Architecture
    • AI-dventures in a Strange Realm
    • pAIn & gAIn
    • AI-pocalypse
    • The Teal Sphere
    • Warhammer 40k + Midjourney 5
  • Technology
  • Contact
  • ©
Menu

All-In-Wan Video Workflow

Posted on April 26, 2025April 28, 2025 by edvardtoth

Some generative models are a pleasure to work with, while others are quite a bit more temperamental.
While impressive, the Wan 2.1 video generation model (or more specifically the Wan 2.1 Fun Control variant) definitely landed in the latter category for me, but the payoff was totally worth it.

I decided to release the end-to-end video generation ComfyUI workflow I have been working on that combines Wan and Flux into a comprehensive All-In-Wan package (no apologies for the terrible pun :D).

Here’s a breakdown of what the workflow does:

  • Loads a source video.
  • Generates a control video using two ControlNets (OpenPose and Depth), at a resolution matching the target video.
  • Extracts the first frame and its depth map, then stylizes it using Flux with an adjustable scaling factor, allowing you to provide Wan with a high-resolution styling guidance image, beyond the target video resolution.
  • Combines the control video and the styled starter frame (or alternatively, an external image prepared separately) to generate a Wan output video at either 480p or 720p resolution.
  • It can also upscale video frames up to 4x, with an ESRGAN-type upscale model of your choice.
  • It stitches the frames together into a final video, and BOOM, done!

To make things easier, it includes a Note node summarizing all necessary model files you will need to get, so guesswork is kept to a minimum.
The workflow should also serve as a solid foundation for incorporating other variants of the Wan model, like first-frame-last-frame or the newer VACE capabilities.

And here’s the best part: it’s absolutely free, no strings attached, no upsells.
Just grab it and send some good vibes my way: All-In-Wan Workflow ZIP

Here’s a visual snapshot of the workflow:

As well as a video pan-through inside ComfyUI (no sound):

…and finally, a composite video showcase with the example assets used during workflow development.
The original source video of the boxing dude came from Vecteezy.

Now for some disclaimers:

1) This is certainly NOT a lightweight workflow.
Both Wan and Flux are quite resource-intensive on their own, and the workflow has been specifically constructed to avoid the nightmare scenario of trying to cram both of them into VRAM at the same time.
It’s good practice to:

  • Bypass the Video Generation node group when generating the starter frame using Flux.
  • Once the starter image is complete, select “Unload Models” from the Comfy top bar to free up Flux from VRAM, and make space for Wan.
  • Re-enable the Video Generation node group and resume the workflow again to proceed with video generation. This method worked flawlessly during development.
  • You can also avoid using Flux entirely and load an externally style starter image, which the workflow also allows.

2) It should be relatively straightforward to substitute the model files with less demanding versions for a lower-spec workflow (if you happen to make one, let me know, I’d love to check it out!)

  • Flux-Dev can be replaced with Flux-Schnell (although ControlNets may have to be updated as well).
  • The 14B Wan model can be replaced with the lighter and faster 1.3B variant.
  • While the workflow contains an optimizations node group for Wan, be cautious with it, as it may significantly compromise generation quality, particularly for realistic outputs.

3) The workflow deliberately avoids using any “wireless” broadcast nodes like Anything Everywhere or Get/Set Nodes. As good as these nodes are, they break or introduce various data propagation and execution-order issues too frequently for comfort.
I decided to keep workflows as tidy and readable as possible the old-fashioned way.
(I also wrote about this in a recent LinkedIn post).

Spread the word

  • Click to share on Facebook (Opens in new window) Facebook
  • Click to share on LinkedIn (Opens in new window) LinkedIn
  • Click to share on X (Opens in new window) X
  • Click to share on Reddit (Opens in new window) Reddit
  • Click to share on Pinterest (Opens in new window) Pinterest
  • Click to share on Telegram (Opens in new window) Telegram
  • Click to email a link to a friend (Opens in new window) Email
  • More
  • Click to share on Tumblr (Opens in new window) Tumblr

Like this:

Like Loading...

2 thoughts on “All-In-Wan Video Workflow”

  1. pablo says:
    April 30, 2025 at 2:08 pm

    imageResizeKJv2 is deprecated, how we can replace it?

    Loading...
  2. edvardtoth says:
    April 30, 2025 at 4:01 pm

    It’s not deprecated, the issue is related to this recent ComfyUI update that affected many nodes: https://github.com/kijai/ComfyUI-KJNodes/issues/280

    The workflow used to have a deprecated “Upscale and Resize” KJ node, but it was replaced by the newer V2 version before publishing.

    Loading...

Leave a Reply

Your email address will not be published. Required fields are marked *

  • LinkedIn
  • YouTube
  • Link
  • X
  • GitHub

News

  • Lip-sync test with Sonic

    Lip-sync test with Sonic

    March 6, 2025
  • Testing Nvidia’s Sana model

    Testing Nvidia’s Sana model

    January 18, 2025
  • The Cultist – a GenAI test using Invoke

    The Cultist – a GenAI test using Invoke

    November 3, 2024
  • The Lich – a GenAI case study

    The Lich – a GenAI case study

    January 16, 2024
  • Warhammer 40k + Midjourney 5

    Warhammer 40k + Midjourney 5

    March 24, 2023
  • ROG releases Aimlab-themed mouse!

    ROG releases Aimlab-themed mouse!

    January 11, 2023
  • Aimlabs.com launched!

    Aimlabs.com launched!

    December 9, 2022
  • …and third time’s the charm at the EKG Slot Awards!

    …and third time’s the charm at the EKG Slot Awards!

    March 20, 2021
  • Won another EKG Slot Award!

    Won another EKG Slot Award!

    March 2, 2020
  • Won an EKG Slot Award!

    Won an EKG Slot Award!

    March 17, 2019
(C) 2023 Edvard Toth
 

Loading Comments...
 

    %d