im a beginner who i find myself babysitting and micro managing this thing all day. overfitting,under training,watching graphs and stopping,readjusting…its a lot of work. now im a beginner who got lucky with my first training model and despite the most likely wrong and terrible graphs i trained a "successful" model that is good enough for me usually only needing a Detailer on the face on the mid distance. from all my hours of youtube, google and chat gpt i have only learned that theirs no magic numbers, its just apply,check and reapply. now i see a lot of things i haven't touched too much on like the optimisers and ema. Are there settings here that make it automacally change speeds when they detect overfitting or increasing Unet?
here's some optimisers i have tried
adafactor – my go to, only uses mostly 16gb of my 24gb of vram and i can use my pc while it does this
adamW – no luck uses more then 24gb vram and hard crashes my pc often
lion – close to adamW but crashes a little less, usually avoid as i hear it wants large datasets.
any tips for better automation?
submitted by /u/XDM_Inc
[comments]
Source link