How to use Disty0/Z-Image-Turbo-SDNQ-int8 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Disty0/Z-Image-Turbo-SDNQ-int8", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0]
Could you perform INT8/INT4 quantization on the base model?Thanks!
https://huggingface.co/Disty0/Z-Image-SDNQ-4bit-dynamic-hadamard-svd-r32
Thanks!
· Sign up or log in to comment
