feat: add flux support (#356)

Browse Source

* add flux support

* avoid build failures in non-CUDA environments

* fix schnell support

* add k quants support

* add support for applying lora to quantized tensors

* add inplace conversion support for f8_e4m3 (#359)

in the same way it is done for bf16
like how bf16 converts losslessly to fp32,
f8_e4m3 converts losslessly to fp16

* add xlabs flux comfy converted lora support

* update docs

---------

Co-authored-by: Erik Scholz <Green-Sky@users.noreply.github.com>

...

This commit is contained in:

leejetandErik Scholz authored and GitHub committed 2024-08-24 14:29:52 +08:00

1 parent 697d000f49

commit 64d231f384

25 files changed

+1886 -172

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

assets/flux/flux1-dev-q2_k.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 416 KiB