You need comfyui-sdnq to load SDNQ quantized models in ComfyUI: https://github.com/EnragedAntelope/comfyui-sdnq
You must log in or # to comment.
What are the tradeoffs? I can’t believe a 50% to 75% RAM reduction is free. Is this like quantization?
Yeah, it’s a different form of quantization. I think it’s supposed to look a little better than conventional quants, but it still has all the tradeoffs of a quant.
gotcha, so this downloads its own custom quantization models?
Yeah.
