iperov 35877dbfd7 AMP, SAEHD: added option use_fp16: Increases training/inference speed, reduces model size. Model may crash. Enable it after 1-5k iters. ...

AMP: removed lr_dropout, now it is enabled by default;

2021-07-14 23:03:54 +04:00

54 KiB

Raw Blame History

View Raw