Commit Graph

540 Commits

Author SHA1 Message Date
iperov 3f0bf2e994 upd readme 2019-08-20 17:11:37 +04:00
iperov 4058f51c02 Merge branch 'master' of https://github.com/iperov/DeepFaceLab 2019-08-20 17:10:31 +04:00
iperov fc5efb559d upd readme 2019-08-20 17:10:00 +04:00
Luke Barr a33ef50da5 Long startup time on Linux (#356) 2019-08-19 22:56:54 +04:00
Auroir e7562054d0 Fix sorting pathlib objects (#353)
Fixing an issue caused by attempting to sort Path objects. Directly using `<` is unsupported between these, so `sorted()` needs a key specified. 

"PurePath" objects support `>` while normal paths do not, causing the confusion. 
https://docs.python.org/3/library/pathlib.html
2019-08-18 08:01:44 +04:00
Auroir a906f24a4d Fix log_info/log_err printing with progress bars (#349) 2019-08-17 11:20:10 +04:00
Auroir c4e68ef539 Formatted Model Summary (#348)
* Formatted Model Summary

Aligns the model summary output using f-string formatting. The logic structure of the base class has not been changed, only the lines put into `model_summary_text`. Output width is calculated from keys & values and will scale to show a clean summary for any model/platform.

GPU VRAM has been added as an output. Incorrect detection of VRAM is possible in broken environments and GPUs of different sizes can report the same name. Showing it here adds clarity for the user and for issue tickets.

Concatenation changed from "\r\n" to "\n", CRLF end of lines for Windows are handled transparently so using it here caused extra blank lines in the summary txt file.

**Examples:**
Using CUDA + SAE-LIAE
```
============= Model Summary ==============
==                                      ==
==         Model name: SAE              ==
==                                      ==
==  Current iteration: 16               ==
==                                      ==
==----------- Model Options ------------==
==                                      ==
==         batch_size: 4                ==
==        sort_by_yaw: False            ==
==        random_flip: True             ==
==         resolution: 128              ==
==          face_type: f                ==
==         learn_mask: True             ==
==     optimizer_mode: 1                ==
==              archi: liae             ==
==            ae_dims: 256              ==
==          e_ch_dims: 42               ==
==          d_ch_dims: 21               ==
== multiscale_decoder: False            ==
==         ca_weights: False            ==
==         pixel_loss: False            ==
==   face_style_power: 0.0              ==
==     bg_style_power: 0.0              ==
==    apply_random_ct: False            ==
==           clipgrad: False            ==
==                                      ==
==------------- Running On -------------==
==                                      ==
==       Device index: 0                ==
==               Name: GeForce GTX 1080 ==
==               VRAM: 8.00GB           ==
==                                      ==
==========================================
```
Colab
```
========== Model Summary ==========
==                               ==
==         Model name: SAE       ==
==                               ==
==  Current iteration: 39822     ==
==                               ==
==-------- Model Options --------==
==                               ==
==         batch_size: 24        ==
==        sort_by_yaw: True      ==
==        random_flip: False     ==
==         resolution: 128       ==
==          face_type: f         ==
==         learn_mask: True      ==
==     optimizer_mode: 2         ==
==              archi: liae      ==
==            ae_dims: 222       ==
==          e_ch_dims: 34        ==
==          d_ch_dims: 16        ==
== multiscale_decoder: True      ==
==         ca_weights: True      ==
==         pixel_loss: False     ==
==   face_style_power: 2.0       ==
==     bg_style_power: 1.5       ==
==    apply_random_ct: False     ==
==           clipgrad: True      ==
==                               ==
==--------- Running On ----------==
==                               ==
==       Device index: 0         ==
==               Name: Tesla K80 ==
==               VRAM: 11.00GB   ==
==                               ==
===================================
```
Using OpenCL + H128
```
=========================== Model Summary ===========================
==                                                                 ==
==        Model name: H128                                         ==
==                                                                 ==
== Current iteration: 0                                            ==
==                                                                 ==
==------------------------- Model Options -------------------------==
==                                                                 ==
==        batch_size: 4                                            ==
==       sort_by_yaw: False                                        ==
==       random_flip: True                                         ==
==        lighter_ae: False                                        ==
==        pixel_loss: False                                        ==
==                                                                 ==
==-------------------------- Running On ---------------------------==
==                                                                 ==
==      Device index: 0                                            ==
==              Name: Advanced Micro Devices, Inc. gfx900 (OpenCL) ==
==              VRAM: 7.98GB                                       ==
==                                                                 ==
=====================================================================
```
Using CPU (output trimmed)
```
==------- Running On --------==
==                           ==
==       Using device: CPU   ==
==                           ==
===============================
```
multi_gpu support is retained (output trimmed)
```
==------------- Running On -------------==
==                                      ==
==    Using multi_gpu: True             ==
==                                      ==
==       Device index: 1                ==
==               Name: Geforce GTX 1080 ==
==               VRAM: 8.00GB           ==
==       Device index: 2                ==
==               Name: Geforce GTX 1080 ==
==               VRAM: 8.00GB           ==
==                                      ==
==========================================
```

Low VRAM warning (output trimmed)
```
==------------- Running On -------------==
==                                      ==
==       Device index: 0                ==
==               Name: Geforce GTX 1050 ==
==               VRAM: 2.00GB           ==
==                                      ==
==========================================
/!\
/!\ WARNING:
/!\ You are using a GPU with 2GB or less VRAM. This may significantly reduce the quality of your result!
/!\ If training does not start, close all programs and try again.
/!\ Also you can disable Windows Aero Desktop to increase available VRAM.
/!\
```

* Fix indent
2019-08-16 18:35:27 +04:00
Auroir 625bcc212d Return sorted filenames in path_utils (#340)
Linux does not guarantee filenames are returned in any specific order. This leads to exporting frames in random order, sorting them here makes the export run sequentially. Other portions of the program should remain unaffected, if not behave more consistently (E.G. get_first_file_by_stem).

This mostly helpful during exporting. Say you are expecting to not have faces for frames 1000-2000, during your export all the "no faces for..." messages will appear in random order. Since you are expecting to see this you ignore them. If you are also (unexpectedly) missing a face for frame 3000 you will not head the warning since it's mixed up in all the warnings that you are expecting. With this patch export runs in sequential order, you'll see the messages all in a row for frames 1000-2000, then again at 3000. The user is much more likely to see and head the warning this way.

This also allows you to force stop the export midway though and have a contiguous set of frames to encode and preview.
2019-08-12 18:18:55 +04:00
iperov d16759bcd3 ConverterMasked: added mask gradient of bottom area, same as side gradient 2019-08-11 13:22:01 +04:00
iperov e8c5f168bd Merge branch 'master' of https://github.com/iperov/DeepFaceLab 2019-08-11 11:17:38 +04:00
iperov b72d5a3f9a fixed error "Failed to get convolution algorithm" on some systems
fixed error "dll load failed" on some systems
Expanded eyebrows line of face masks. It does not affect mask of FAN-x converter mode.
2019-08-11 11:17:22 +04:00
Josh Johnson e2bc65d5f0 Fix issue with RTX GPU and TensorFlow (#322)
An issue affecting at least 2070 and 2080 cards (possibly other RTX cards too) requires auto growth to be enabled for TensorFlow to work.

I don't know enough about the impact of this change to know whether this ought to be made optional or not, but for RTX owners, this simple change fixes TensorFlow errors when generating models.
2019-08-02 16:40:41 +04:00
fakerdaker 582c974851 Colab choose random preview (#316) 2019-07-25 11:29:31 +04:00
Colombo d886cd79a8 upd readme 2019-07-15 15:27:51 +04:00
cclauss 93ee889597 Identity is not the same thing as equality in Python (#291)
Use ==/!= to compare str, bytes, and int literals
$ python
```python
>>> method = 'Mi'
>>> method += 'n'
>>> method == 'Min'
True
>>> method is 'Min'
False
```
2019-06-27 21:10:22 +04:00
iperov 8484060e01 Trainer: added option for all models
Enable autobackup? (y/n ?:help skip:%s) :
Autobackup model files with preview every hour for last 15 hours. Latest backup located in model/<>_autobackups/01

SAE: added option only for CUDA builds:
Enable gradient clipping? (y/n, ?:help skip:%s) :
Gradient clipping reduces chance of model collapse, sacrificing speed of training.
2019-06-20 10:42:55 +04:00
Jakob6174 ea1d59f620 Update ModelBase.py (#283)
Typo: 'NotImplementeError' --> 'NotImplementedError'
2019-06-19 13:02:19 +04:00
iperov fb9fd8c2b9 Update README.md 2019-06-19 12:24:11 +04:00
iperov 3d29130d5c closing the repo 2019-06-13 08:38:09 +04:00
iperov ab8d03b4bb fix 2019-06-02 19:20:06 +04:00
iperov c9da4cd89b fix for plaidML 2019-05-24 09:30:39 +04:00
iperov 3114ae9d7b upd plaidml ver 2019-05-20 22:42:34 +04:00
iperov 480360ba10 upd 2019-05-18 23:43:40 +04:00
iperov 06831517f5 upd 2019-05-15 08:03:50 +04:00
iperov 7be97af845 upd paypal link 2019-05-15 07:58:40 +04:00
iperov 66a12a973a fix choosing preview image on options override 2019-05-14 17:00:25 +04:00
Luke Barr ba4e377d13 Don't pass multiprocess object on pickle (#261) 2019-05-14 11:30:23 +04:00
iperov d6e8dde481 'sort by yaw' option now can be overriden each run 2019-05-14 09:33:53 +04:00
iperov 615a999c68 added google drive download link 2019-05-14 09:33:10 +04:00
iperov b04e9e77e2 upd doc 2019-05-12 07:59:35 +04:00
iperov 444bf699f7 back to 100 chance of random_ct 2019-05-11 21:20:02 +04:00
iperov 28af2f41ec fix 2019-05-11 19:49:02 +04:00
iperov 22efba57a3 fix 2019-05-11 19:44:01 +04:00
iperov 1493551410 fix 2019-05-11 19:42:03 +04:00
iperov 8d7edd172c random_ct_sample - now not applying with 20% chance 2019-05-11 19:40:02 +04:00
iperov 8294feca24 extractior: fix extract from already extracted dflimg 2019-05-11 17:36:22 +04:00
iperov 53c4f8a86e cleaning 2019-05-11 16:55:06 +04:00
iperov 39809ff7dc upd 2019-05-11 16:15:16 +04:00
iperov 2239c8d9ab upd readme 2019-05-11 12:18:43 +04:00
iperov 6143962248 SAE: option apply_random_ct now True by default 2019-05-10 19:50:19 +04:00
iperov e8f207557b fix bgr_shuffle 2019-05-10 08:11:17 +04:00
iperov 5a9498543d refactoring 2019-05-09 18:05:50 +04:00
iperov d2011f8c32 upd doc 2019-05-08 09:32:32 +04:00
iperov 3555801046 upd docs 2019-05-07 13:09:20 +04:00
iperov d003366033 cleaning 2019-05-07 10:47:51 +04:00
iperov d8c1e2e58b change help for apply_random_ct option 2019-05-07 10:47:29 +04:00
iperov 809cc14860 fix 2019-05-06 16:27:18 +04:00
iperov d9c2e96f01 fix 2019-05-06 12:52:47 +04:00
iperov a805f81142 SAE: added test option: 'Apply random color transfer to src faceset' 2019-05-06 11:34:56 +04:00
iperov bde700243c fix for plaidML 2019-05-05 19:22:26 +04:00