Installation of Flux Models through ComfyUI

Karan Kariappa -

The growing popularity of Flux among developers prompts us to draft a simple flow for the installation of this image processing GenAI solution. This article, with our Flux Guidance Series, acts as a connecting bridge to flux usability, letting you do what we do at scale. By following the below guide, you should be able to set up the least operationally intensive version of Flux without breaking the bank. Alongside the same, we have also highlighted the scalable models that can be used for enterprise use cases, allowing you to choose either of the two based on convenience, preference, and accessibility.

Operating systems: Windows or Linux

Minimum Memory: 18 GB and above of unified memory (CPU + GPU) Dedicated GPU is recommended with 24 GB combined memory

Software Requirements: Python 3 and above; Anaconda and pip packages; Pytorch

Do ensure at the start that the above prerequisites are met, before proceeding to install Flux.

Installing on Windows/Linux OS configurations

Open terminal on your computer, and check if the above packages are installed. Once verified, create a new directory where ComfyUI has to be installed.

Git clone this repo: (Copy the below command and run it on terminal)

Git Clone <https://github.com/comfyanonymous/ComfyUI.git>

Place your checkpoint files (GenAI - image generation models) within models/checkpoints, inside the ComfyUI folder. This are LLM files that enable Flux Guidance.

  • "t5xxl_fp16.safetensors" or "clip_l.safetensors" Must be placed in in your ComfyUI/models/clip/. You can download them here.
  • VAE files can be downloaded here and should go in your ComfyUI/models/vae/ folder.
  • Next, download suitable image processing models and place them in the Unet folder. Here, we have chosen the Flux Schnell diffusion model weights, which can be found here and should be placed in: ComfyUI/models/unet/ folder.

AMD GPUs (Linux only)

AMD GPU users can install rocm and pytorch with pip if not already installed

pip install torch torchvision torchaudio --index-url <https://download.pytorch.org/whl/rocm6.0>

Below is the command line to install the nightly with ROCm 6.0:

pip install --pre torch torchvision torchaudio --index-url <https://download.pytorch.org/whl/nightly/rocm6.1>

NVIDIA

  • Nvidia users should install stable pytorch using this command:
pip install torch torchvision torchaudio --extra-index-url <https://download.pytorch.org/whl/cu121>

This is the command to install pytorch nightly instead which might have performance improvements:

pip install --pre torch torchvision torchaudio --index-url <https://download.pytorch.org/whl/nightly/cu124>

Upon completing the above steps, push the ‘requirements.txt’ through terminal using the command line below

pip install -r requirements.txt

Once installed, you are all set to launch ComfyUI running Flux models on your computer. To access ComfyUI, run the below command:

python [main.py](<http://main.py/>)

ComfyUI will run on terminal and provide a specific URL (127.0.0.1:8188) through which the GUI can be accessed. Navigating to the URL should open up a webpage resembling the below image.

Next, you can drag and drop this image on the URL where comfy UI is running, to preconfigure the comfyUI to Schnell models or Flux Dev models, as suited.

In the upcoming sequel to this article, we will be exploring the usability of ComfyUI, where we will be breaking down how an individual with less to no development experience can generate images like the above.

Stay Tuned for more interesting implementations of GenAI.

How to Guide an LLM - Flux Guidance Explained

The Compute-Optimal Approach to Training large language models (LLMs)

Generative AI Vs Discriminative AI - GenAI Explorer

Interact with any media using video intelligence - A Codemonk showcase