aboutsummaryrefslogtreecommitdiff
path: root/extensions-builtin/Lora/network_oft.py
AgeCommit message (Expand)Author
2023-11-15feat: LyCORIS/kohya OFT network supportv0xie
2023-11-15fix: ignore calc_scale() for COFT which has very small alphav0xie
2023-11-04refactor: remove unused functionv0xie
2023-11-04refactor: use same updown for both kohya OFT and LyCORIS diag-oftv0xie
2023-11-03refactor: move factorization to lyco_helpers, separate calc_updown for kohya ...v0xie
2023-11-03skip multihead attn for nowv0xie
2023-11-02no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_of...v0xie
2023-11-01test implementation based on kohaku diag-oft implementationv0xie
2023-10-22style: conform stylev0xie
2023-10-22fix: multiplier applied twice in finalize_updownv0xie
2023-10-22refactor: remove used OFT functionsv0xie
2023-10-21fix: use merge_weight to cache valuev0xie
2023-10-21style: cleanup oftv0xie
2023-10-21fix: support multiplier, no forward pass hookv0xie
2023-10-21fix: return orig weights during updown, merge weights before forwardv0xie
2023-10-21refactor: use forward hook instead of custom forwardv0xie
2023-10-19style: fix ambiguous variable namev0xie
2023-10-19style: formattingv0xie
2023-10-19refactor: fix constraint, re-use get_weightv0xie
2023-10-18faster by calculating R in updown and using cached R in forwardv0xie
2023-10-18faster by using cached R in forwardv0xie
2023-10-18inference working but SLOWv0xie
2023-10-17wip incorrect OFT implementationv0xie