Highlights for 2024-09-13
Major refactor of FLUX.1 support:
- Full ControlNet support, better LoRA support, full prompt attention implementation
- Faster execution, more flexible loading, additional quantization options, and more...
- Added image-to-image, inpaint, outpaint, hires modes
- Added workflow where FLUX can be used as refiner for other models
- Since both Optimum-Quanto and BitsAndBytes libraries are limited in their platform support matrix,
try enabling NNCF for quantization/compression on-the-fly!
Few image related goodies...
- Context-aware resize that allows for img2img/inpaint even at massively different aspect ratios without distortions!
- LUT Color grading apply professional color grading to your images using industry-standard .cube LUTs!
- Auto HDR image create for SD and SDXL with both 16ch true-HDR and 8-ch HDR-effect images ;)
And few video related goodies...
- CogVideoX 2b and 5b variants
with support for text-to-video and video-to-video!
- AnimateDiff prompt travel and long context windows!
create video which travels between different prompts and at long video lengths!
Plus tons of other items and fixes - see changelog for details!
Examples:
- Built-in prompt-enhancer, TAESD optimizations, new DC-Solver scheduler, global XYZ grid management, etc.
- Updates to ZLUDA, IPEX, OpenVINO...