iperov 35877dbfd7 AMP, SAEHD: added option use_fp16: Increases training/inference speed, reduces model size. Model may crash. Enable it after 1-5k iters. ...

AMP: removed lr_dropout, now it is enabled by default;

2021-07-14 23:03:54 +04:00

..

__init__.py

removed SAEv2,

2019-10-08 15:09:28 +04:00

Model.py

AMP, SAEHD: added option use_fp16: Increases training/inference speed, reduces model size. Model may crash. Enable it after 1-5k iters.

2021-07-14 23:03:54 +04:00