CalvinBackup/iperov-DeepFaceLab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

remove lrcos from adabelief

Browse Source
This commit is contained in:
iperov
2020-12-11 20:34:14 +04:00
parent 26ed582aff
commit da058cf17f
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
models/Model_SAEHD/Model.py
View File

@@ -285,7 +285,7 @@ Examples: df, liae, df-d, df-ud, liae-ud, ...
OptimizerClass = nn.RMSprop
if adabelief:
lr_dropout = 1.0
lr_cos = 2000
#lr_cos = 2000
OptimizerClass = nn.AdaBelief
clipnorm = 1.0 if self.options['clipgrad'] else 0.0