Commit Graph

90 Commits

Author SHA1 Message Date
henryruhs f4a7ae6824 Downgrade onnxruntime as of buggy 1.17.0 release 2024-02-01 21:46:16 +01:00
henryruhs 2013653760 Introduce more helpers to suite the lip-syncer needs 2024-02-01 21:06:23 +01:00
Harisreedhar 0276f33184 Add target image check 2024-02-01 18:41:07 +05:30
henryruhs 697266fda2 Fix the check in the source component 2024-02-01 14:08:18 +01:00
henryruhs cc915171ea Add lip-syncer support to source component 2024-02-01 12:59:23 +01:00
henryruhs 3c8ad63d25 Add lip-syncer support to source component 2024-02-01 12:51:59 +01:00
Henry Ruhs d44b38103d Cuda 12 installer (#362)
* Make cuda nightly (12) the default

* Better keep legacy cuda just in case

* Use CUDA and ROCM versions

* Remove MacOS options from installer (CoreML include in default package)
2024-02-01 10:14:31 +01:00
henryruhs 0d00c74bc1 Minor cleanup 2024-01-31 19:10:13 +01:00
henryruhs aa9dd20cc1 Fix testing 2024-01-31 18:38:44 +01:00
henryruhs 06cb05bd3f Fix testing 2024-01-31 18:33:11 +01:00
henryruhs 872094a1fd Rename to lip syncer 2024-01-31 18:25:58 +01:00
henryruhs 7f9348dcaa Simplify testing 2024-01-31 18:12:46 +01:00
Harisreedhar 808460ae09 Lip Sync (#356)
* Cli implementation of wav2lip

* - create get_first_item()
- remove non gan wav2lip model
- implement video memory strategy
- implement get_reference_frame()
- implement process_image()
- rearrange crop_mask_list
- implement test_cli
2024-01-31 17:37:04 +01:00
henryruhs b50f021743 Fix the output framerate vs. time 2024-01-31 09:28:40 +01:00
Henry Ruhs d19e5918dd Add age and gender to face debugger items (#353)
* Add age and gender to face debugger items

* Rename like suggested in the code review
2024-01-31 09:16:34 +01:00
henryruhs 0b345a7e33 Minor cleanups 2024-01-30 21:26:24 +01:00
henryruhs ce579846b4 Enforce output resolution on merge video 2024-01-30 13:23:37 +01:00
Harisreedhar bc408a9102 include audio file functions 2024-01-30 15:11:36 +05:30
henryruhs 4b56086fd0 Reduce terminal output 2024-01-29 20:44:05 +01:00
henryruhs 5a4cd4bbdf Clear temp before processing 2024-01-29 20:35:08 +01:00
henryruhs 0870422731 Force Gradio to shut up 2024-01-29 14:50:24 +01:00
henryruhs 7703eeda95 Force Gradio to shut up 2024-01-29 14:46:30 +01:00
henryruhs 9effc3c877 Revert venv on the fly 2024-01-28 20:50:14 +01:00
henryruhs 32d2941f32 Revert venv on the fly 2024-01-28 20:40:53 +01:00
henryruhs 6fb23fe747 Enable venv on the fly 2024-01-28 20:35:36 +01:00
henryruhs f1c7b3d6c9 Enable venv on the fly 2024-01-28 20:14:23 +01:00
henryruhs f84ff766bd Fix indent 2024-01-28 19:45:18 +01:00
henryruhs 87bcc3e334 Add more todo for testing 2024-01-28 15:18:45 +01:00
henryruhs dcd4576e03 Add more todo for testing 2024-01-28 15:17:21 +01:00
henryruhs 066665aae7 Introduce audio testing 2024-01-28 12:54:42 +01:00
henryruhs 895aac5549 Minor tidy up 2024-01-28 12:42:17 +01:00
Henry Ruhs b7b81303e9 Rename Frame to VisionFrame (#346) 2024-01-28 12:31:22 +01:00
Harisreedhar 3a2127eb63 Audio functions (#345)
* Update ffmpeg.py

* Create audio.py

* Update ffmpeg.py

* Update audio.py

* Update audio.py

* Update typing.py

* Update ffmpeg.py

* Update audio.py
2024-01-28 12:25:49 +01:00
Henry Ruhs 32cbf0ca5b Update help message for arguments, Notation based wording approach (#347)
* Update help message for arguments, Notation based wording approach

* Fix installer
2024-01-28 10:49:44 +01:00
henryruhs 0f65313d05 Use correct typing in choices 2024-01-27 20:33:02 +01:00
henryruhs 9a0a9e6f7a Fix naming 2024-01-26 18:06:56 +01:00
henryruhs e2e3cd7dbd Change order 2024-01-25 11:46:30 +01:00
henryruhs 38ba53e5a3 Add testing for audio handlers 2024-01-23 10:52:12 +01:00
Harisreedhar 42c591f758 include audio file functions (#336) 2024-01-23 08:31:49 +01:00
Henry Ruhs 6aea186ee8 feat/yoloface (#334)
* added yolov8 to face_detector (#323)

* added yolov8 to face_detector

* added yolov8 to face_detector

* Initial cleanup and renaming

* Update README

* refactored detect_with_yoloface (#329)

* refactored detect_with_yoloface

* apply review

* Change order again

* Restore working code

* modified code (#330)

* refactored detect_with_yoloface

* apply review

* use temp_frame in detect_with_yoloface

* reorder

* modified

* reorder models

* Tiny cleanup

---------

Co-authored-by: tamoharu <133945583+tamoharu@users.noreply.github.com>
2024-01-22 13:56:45 +01:00
henryruhs 122da0545b Improve naming 2024-01-21 14:47:28 +01:00
Henry Ruhs 906c78126a Allow partial facefusion.ini file (#325) 2024-01-21 14:41:59 +01:00
Henry Ruhs 7e990ac5e5 Fix/image to image (#322)
* Fix image to image when using tolerate

* Bump version
2024-01-21 14:17:53 +01:00
Henry Ruhs 7c3900685c Replace restoreformer with restoreformer++ (#324)
* Replace restoreformer with restoreformer++

* Replace restoreformer with restoreformer++
2024-01-21 14:17:35 +01:00
Henry Ruhs f6e56a3d8c Next (#318)
* renaming and restructuring (#282)

* Renaming and restructuring

* Renaming and restructuring

* Renaming and restructuring

* Fix gender detection

* Implement distance to face debugger

* Implement distance to face debugger part2

* Implement distance to face debugger part3

* Mark as next

* Fix reference when face_debugger comes first

* Use official onnxruntime nightly

* CUDA on steroids

* CUDA on steroids

* Add some testing

* Set inswapper_128_fp16 as default

* Feat/block until post check (#292)

* Block until download is done

* Introduce post_check()

* Fix webcam

* Update dependencies

* Add --force-reinstall to installer

* Introduce config ini (#298)

* Introduce config ini

* Fix output video encoder

* Revert help listings back to commas, Move SSL hack to download.py

* Introduce output-video-preset which defaults to veryfast

* Mapping for nvenc encoders

* Rework on events and non-blocking UI

* Add fast bmp to temp_frame_formats

* Add fast bmp to temp_frame_formats

* Show total processing time on success

* Show total processing time on success

* Show total processing time on success

* Move are_images, is_image and is_video back to filesystem

* Fix some spacings

* Pissing everyone of by renaming stuff

* Fix seconds output

* feat/video output fps (#312)

* added output fps slider, removed 'keep fps' option (#311)

* added output fps slider, removed 'keep fps' option

* now uses passed fps instead of global fps for ffmpeg

* fps values are now floats instead of ints

* fix previous commit

* removed default value from fps slider

this is so we can implement a dynamic default value later

* Fix seconds output

* Some cleanup

---------

Co-authored-by: Ran Shaashua <47498956+ranshaa05@users.noreply.github.com>

* Allow 0.01 steps for fps

* Make fps unregulated

* Make fps unregulated

* Remove distance from face debugger again (does not work)

* Fix gender age

* Fix gender age

* Hotfix benchmark suite

* Warp face normalize (#313)

* use normalized kp templates

* Update face_helper.py

* My 50 cents to warp_face()

---------

Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>

* face-swapper-weight (#315)

* Move prepare_crop_frame and normalize_crop_frame out of apply_swap

* Fix UI bug with different range

* feat/output video resolution (#316)

* Introduce detect_video_resolution, Rename detect_fps to detect_video_fps

* Add calc_video_resolution_range

* Make output resolution work, does not auto-select yet

* Make output resolution work, does not auto-select yet

* Try to keep the origin resolution

* Split code into more fragments

* Add pack/unpack resolution

* Move video_template_sizes to choices

* Improve create_video_resolutions

* Reword benchmark suite

* Optimal speed for benchmark

* Introduce different video memory strategies, rename max_memory to max… (#317)

* Introduce different video memory strategies, rename max_memory to max_system_memory

* Update readme

* Fix limit_system_memory call

* Apply video_memory_strategy to face debugger

* Limit face swapper weight to 3.0

* Remove face swapper weight due bad render outputs

* Show/dide logic for output video preset

* fix uint8 conversion

* Fix whitespace

* Finalize layout and update preview

* Fix multi renders on face debugger

* Restore less restrictive rendering of preview and stream

* Fix block mode for model downloads

* Add testing

* Cosmetic changes

* Enforce valid fps and resolution via CLI

* Empty config

* Cosmetics on args processing

* Memory workover (#319)

* Cosmetics on args processing

* Fix for MacOS

* Rename all max_ to _limit

* More fixes

* Update preview

* Fix whitespace

---------

Co-authored-by: Ran Shaashua <47498956+ranshaa05@users.noreply.github.com>
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
2024-01-19 19:57:48 +01:00
henryruhs 3e93f99eeb Bump version 2023-12-26 19:41:49 +01:00
henryruhs 98d0bd2d4a Hotfix onnxruntime-directml for Windows 2023-12-26 19:38:36 +01:00
Henry Ruhs b267629161 2.1.2 (#271)
* Fix round issues on CLI arguments with range

* Refresh face references on frame processor change

* Add cuda 12 support to installer

* Add cuda 12 support to installer

* Add cuda 12 support to installer

* Add cuda 12 support to installer

* Simplify check

* Simplify check
2023-12-24 15:55:21 +01:00
henryruhs e18e84e4f8 Bump to 2.1.1 2023-12-20 22:46:59 +01:00
henryruhs d67a84642c Remove falsy clear reference faces in preview 2023-12-20 22:35:32 +01:00