Skip to content

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, Animation, Video, Audio, 3D Model, and more!🔥

License

Notifications You must be signed in to change notification settings

Yuan-ManX/ComfyUI-Tools-Roadmap

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

91 Commits
 
 
 
 
 
 

Repository files navigation

ComfyUI Tools Roadmap 🎮

ComfyUI

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, 3D Model, Animation, Video, Avatar, Audio, Music and more!🔥

Table of Contents

Project List

ComfyUI

ComfyUI Description Source Paper
Comflowyspace Comflowyspace is an open-source AI image and video generation tool committed to providing a better, interactive experience than the standard SDWebUI and ComfyUI. Comflowyspace
ComfyUI The most powerful and modular stable diffusion GUI and backend. ComfyUI
ComfyUI Browser An image/video/workflow browser and manager for ComfyUI. ComfyUI Browser
Comfy.ICU ComfyICU - Run ComfyUI workflows in the Cloud. Comfy.ICU
ComfyUI-Custom-Scripts Enhancements & experiments for ComfyUI, mostly focusing on UI features. ComfyUI-Custom-Scripts
ComfyUI Manager ComfyUI-Manager is an extension designed to enhance the usability of ComfyUI. ComfyUI Manager
ComfyUI_TensorRT This node enables the best performance on NVIDIA RTX™ Graphics Cards (GPUs) for Stable Diffusion by leveraging NVIDIA TensorRT. ComfyUI_TensorRT

^ Back to Contents ^

Image

ComfyUI Description Source Paper
ComfyUI-AnyText AnyText: Multilingual Visual Text Generation And Editing. AnyText arXiv
ComfyUI-AuraSR AuraSR: GAN-based Super-Resolution for real-world. AnyText
ComfyUI_CatVTON CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models. CatVTON arXiv
comfyui_controlnet_aux ComfyUI's ControlNet Auxiliary Preprocessors.
ComfyUI_ExtraModels Support for miscellaneous image models. Currently supports: DiT, PixArt, T5 and a few custom VAEs. Hunyuan-DiT arXiv
ComfyUI-Flowty-LDSR This is a custom node that lets you take advantage of Latent Diffusion Super Resolution (LDSR) models inside ComfyUI.
ComfyUI-IC-Light ComfyUI native implementation of IC-Light. IC-Light
ComfyUI-InstanceDiffusion Instance-level Control for Image Generation. InstanceDiffusion arXiv
ComfyUI InstantID Zero-shot Identity-Preserving Generation in Seconds. InstantID arXiv
ComfyUI-IMAGDressing IMAGDressing👔: Interactive Modular Apparel Generation for Virtual Dressing. IMAGDressing arXiv
ComfyUI IPAdapter plus The IPAdapter are very powerful models for image-to-image conditioning. IP-Adapter arXiv
ComfyUI-Kolors Kolors: Effective Training of Diffusion Model for Photorealistic Text-to-Image Synthesis. Kolors
ComfyUI-layerdiffuse Transparent Image Layer Diffusion using Latent Transparency. LayerDiffuse
ComfyUI_MagicClothing Magic Clothing: Controllable Garment-Driven Image Synthesis. Magic Clothing arXiv
ComfyUI-Marigold Marigold depth estimation in ComfyUI. Marigold arXiv
ComfyUI-MimicBrush Zero-shot Image Editing with Reference Imitation. MimicBrush arXiv
ComfyUI_omost Omost is a project to convert LLM's coding capability to image generation (or more accurately, image composing) capability. Omost
ComfyUI OOTDiffusion Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on. OOTDiffusion arXiv
ComfyUI PhotoMaker Plus Customizing Realistic Human Photos via Stacked ID Embedding. PhotoMaker arXiv
ComfyUI Segment Anything Based on GroundingDino and SAM, use semantic strings to segment any element in an image. Segment Anything Model (SAM) arXiv
ComfyUI-Segment-Anything-2 SAM 2: Segment Anything in Images and Videos. Segment Anything Model 2 (SAM 2) arXiv
ComfyUI StableZero123 A Single Image to Consistent Multi-view Diffusion Base Model. Zero123++ arXiv
ComfyUI_UltimateSDUpscale ComfyUI nodes for the Ultimate Stable Diffusion Upscale script by Coyote-A. Ultimate SD Upscale
DiffMorpher-ComfyUI DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing. DiffMorpher arXiv
PuLID ComfyUI Pure and Lightning ID Customization via Contrastive Alignment. PuLID arXiv

^ Back to Contents ^

Mesh

ComfyUI Description Source Paper
ComfyUI InstantMesh Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models. InstantMesh arXiv

^ Back to Contents ^

Texture

ComfyUI Description Source Paper
Comfy Textures Unreal Engine ⚔️ ComfyUI - Automatic texturing using generative diffusion models.

^ Back to Contents ^

3D Model

ComfyUI Description Source Paper
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! CharacterGen arXiv
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! CRM arXiv
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! Era3D arXiv
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! InstantMesh arXiv
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! Stable Fast 3D arXiv
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! Unique3D arXiv
ComfyUI-3D-Pack Make 3D assets generation in ComfyUI good and convenient as it generates image/video! Zero123++ arXiv
ComfyUI-Flowty-TripoSR TripoSR custom node for comfyui. TripoSR arXiv
ComfyUI-Tripo This extension integrates Tripo into ComfyUI, allowing users to generate 3D models from text prompts or images directly within the ComfyUI interface. TripoSR arXiv

^ Back to Contents ^

Animation

ComfyUI Description Source Paper
ComfyUI-ADMotionDirector ComfyUI nodes for training AnimateDiff motion loras. AnimateDiff MotionDirector
ComfyUI-AnimateAnyone-Evolved Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation. Animate Anyone arXiv
ComfyUI-AnimateDiff-Evolved Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning. AnimateDiff arXiv
ComfyUI-AnimateDiff-Evolved AnimateDiff-Lightning is a lightning-fast text-to-video generation model. AnimateDiff-Lightning arXiv
Comfyui-AnimateLCM Accelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning. AnimateLCM arXiv
ComfyUI-DynamiCrafter Animating Open-domain Images with Video Diffusion Priors. DynamiCrafter arXiv
ComfyUI-MagicAnimate Easily use Magic Animate within ComfyUI!
ComfyUI-ToonCrafter Generative Cartoon Interpolation. ToonCrafter

^ Back to Contents ^

Video

ComfyUI Description Source Paper
ComfyUI-DiffSynth-Studio Diffutoon: High-Resolution Editable Toon Shading via Diffusion Models. Diffutoon arXiv
ComfyUI-MagicAnimate MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model. MagicAnimate arXiv
ComfyUI-MimicMotion MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance. MimicMotion arXiv
ComfyUI-DragNUWA DragNUWA enables users to manipulate backgrounds or objects within images directly, and the model seamlessly translates these actions into camera movements or object motions, generating the corresponding video. DragNUWA
ComfyUI-SVD Experimental use of stable-video-diffusion in ComfyUI.
ComfyUI-VideoHelperSuite Nodes related to video workflows.

^ Back to Contents ^

Avatar

ComfyUI Description Source Paper
avatar-graph-comfyui A custom nodes module for creating real-time interactive avatars powered by blender bpy mesh api + Avatech Shape Flow runtime.
ComfyUI-AniPortrait Audio-Driven Synthesis of Photorealistic Portrait Animations. AniPortrait arXiv
ComfyUI_EchoMimic EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning. EchoMimic arXiv
ComfyUI-Hallo Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation. Hallo arXiv
ComfyUI-IP_LAP The comfyui custom node of IP_LAP to make audio driven videos! IP_LAP arXiv
ComfyUI-LivePortraitKJ LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control! LivePortrait arXiv
Comfyui-MusePose MusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation. MusePose
ComfyUI-MuseTalk Real-Time High Quality Lip Synchorization with Latent Space Inpainting! MuseTalk
ComfyUI-MuseV Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising! MuseV
ComfyUI-V-Express Conditional Dropout for Progressive Training of Portrait Video Generation. V-Express arXiv
ComfyUI_wav2lip A custom node for ComfyUI that allows you to perform lip-syncing on videos using the Wav2Lip model. It takes an input video and an audio file and generates a lip-synced output video. Wav2Lip arXiv

^ Back to Contents ^

Audio

ComfyUI Description Source Paper
ComfyUI-AudioScheduler AudioScheduler project contains a collection of audio processing nodes.
ComfyUI-ChatTTS ChatTTS is a generative speech model for daily dialogue. ChatTTS
ComfyUI-GPT_SoVITS A Powerful Few-shot Voice Conversion and Text-to-Speech WebUI. GPT-SoVITS
ComfyUI_ParlerTTS Parler-TTS is a lightweight text-to-speech (TTS) model that can generate high-quality, natural sounding speech in the style of a given speaker (gender, pitch, speaking style, etc). Parler-TTS
ComfyUI-StableAudioSampler The New Stable Diffusion Audio Sampler 1.0 In a ComfyUI Node. Make some beats!
ComfyUI-UVR5 The comfyui custom node for UVR5 to separate vocals and background music. UVR5
ComfyUI-XTTS a custom comfyui node for coqui-ai/TTS's xtts module! support 17 languages voice cloning and tts. XTTS

^ Back to Contents ^

Music

ComfyUI Description Source Paper
ComfyUI-SunoAI ComfyUI Node wrapper of SunoAI API.

^ Back to Contents ^

ComfyUI Workflow

ComfyUI Description Source Paper

^ Back to Contents ^

About

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, Animation, Video, Audio, 3D Model, and more!🔥

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published