There has been a lot of progress in customizing images using large generative models like changing the subject, background, style, or even identity. But, most of these methods are built for just one specific task. Creating a single system that handles all kinds of image customization is still a big challenge.
DreamO released by Bytedance, a unified diffusion transformer model for all can make your work easier.
| For- Consistent generation |
| For- Ecommerce Industry |
| For-Product Advertising |
The model has been updated to control the over-saturation and plastic-face generation issues. You can find more in-depth information from their research paper.
1. First, install and setup ComfyUI if you are new user. Older user need to update ComfyUI from the Manager section.
2. Now, get the basic Flux installation if not yet. This is important as the flux workflow uses the basic clip, text encoders and VAE models.
3. Move into ComfyUI/custom_nodes folder and clone the repository using command prompt:
git clone https://github.com/ToTheBeginning/ComfyUI-DreamO.git
4. Install the dependencies using command below.
For normal Comfy users:
pip install -r requirements.txt
For ComfyUI portable user, move inside ComfyUI_windows_portable folder and use this command:
python_embededpython.exe -m pip install -r ComfyUIcustom_nodesComfyUI-DreamOrequirements.txt
5. Next is to download DreamO model (all safetensors file)from Hugging Face repository and save it into your “ComfyUI/models/loras” folder.
6. Now, download DreamO embedding and Ben2 model (for image processing) from their Hugging Face repository and save them into “ComfyUI/models/dreamo” folder.
These both model support the auto-download when you run the workflow for first time. So, you can also leave if you want.
7. Another model you need to download, Flux Turbo Alpha by alimama. After downloading, rename the model file to “flux-turbo.safetensors” filename and save it into your “ComfyUI/models/loras” directory.
8. Restart ComfyUI and refresh it.
1. Get the workflow from “ComfyUI/custom_nodes/ComfyUI-DreamO/workflows” directory
(a) dreamo_comfyui.json (For single condition inputting reference)
(b) dreamo_comfyui_2cond.json (For multiple condition inputting reference)
2. Drag and drop into ComfyUI.
Until now, high-performance image editing with generative models was locked behind closed APIs and proprietary…
Creating cinematic, detailed, and dynamic text to video content usually requires big models that are…
Creating realistic 3D assets is still a tough challenge, especially when balancing high-quality geometry with…
Audio-driven human animation faces three critical problems like maintaining character consistency in dynamic videos, achieving…
Often choosing between AI models like Flux and HiDream can be confusing. As they both…
When it comes to video creation, gaming, memes, or AI agents, there have not been…