diff options
| author | Josh Watzman <github@jwatzman.org> | 2022-10-27 21:59:16 +0100 |
|---|---|---|
| committer | Josh Watzman <github@jwatzman.org> | 2022-10-27 22:01:06 +0100 |
| commit | b50ff4f4e4d4d6bf31e222832d3fe4cfde4703c9 (patch) | |
| tree | 318905a69b66bcefcce4eeb4832372b667fe23f1 /textual_inversion_templates | |
| parent | 737eb28faca8be2bb996ee0930ec77d1f7ebd939 (diff) | |
Reduce peak memory usage when changing models
A few tweaks to reduce peak memory usage, the biggest being that if we
aren't using the checkpoint cache, we shouldn't duplicate the model
state dict just to immediately throw it away.
On my machine with 16GB of RAM, this change means I can typically change
models, whereas before it would typically OOM.
Diffstat (limited to 'textual_inversion_templates')
0 files changed, 0 insertions, 0 deletions