iperov 704b5dc072 SAEHD: added new option Use AdaBelief optimizer? ...

Experimental AdaBelief optimizer. It requires more VRAM, but the accuracy of the model is higher, and lr_dropout is not needed.

2020-12-11 15:48:27 +04:00

..

__init__.py

removed SAEv2,

2019-10-08 15:09:28 +04:00

Model.py

SAEHD: added new option Use AdaBelief optimizer?

2020-12-11 15:48:27 +04:00