CalvinBackup/iperov-DeepFaceLab
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

remove lrcos from adabelief

Browse Source
This commit is contained in:
iperov committed 2020-12-11 20:34:14 +04:00
1 parent 26ed582aff
commit da058cf17f
1 file changed
+1 -1
Download Patch File Download Diff File Expand all files Collapse all files
models/Model_SAEHD/Model.py
+1 -1
View File
@@ -285,7 +285,7 @@ Examples: df, liae, df-d, df-ud, liae-ud, ...
OptimizerClass = nn.RMSprop
if adabelief:
lr_dropout = 1.0
lr_cos = 2000
#lr_cos = 2000
OptimizerClass = nn.AdaBelief
clipnorm = 1.0 if self.options['clipgrad'] else 0.0