Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Save Last State" behavior #277

Open
MarvyD opened this issue Jan 26, 2025 · 1 comment
Open

"Save Last State" behavior #277

MarvyD opened this issue Jan 26, 2025 · 1 comment

Comments

@MarvyD
Copy link

MarvyD commented Jan 26, 2025

I don't understand how "Save Last State" works, no matter what options I choose it always save states for each epoch, instead of saving just the last one.
For testing purposes I launched training of LORA with 55 epochs, and states are saved each epoch with "Save Last State" Epochs 1 and "Save Last State" Epochs 55 setting.

@derrian-distro
Copy link
Owner

I'm going to be entirely honest, the saving inputs for kohya are esoteric at best, I still, to this day, do not fully understand how they work, and the code is too spaghetti to make it easy to find the answer. I did attempt to check the code, but I wasn't able to find an answer within the, admittedly small, amount of time I had to look into it. For now, I will leave this issue open, and will close once I can accurately explain what the save args do

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants