CalvinBackup/sd-webui-faceswaplab
1
0
Fork 0
Code Issues 56 Pull Requests 4 Actions Packages Projects Releases 8 Wiki Activity

Excluding the model loading time, how long does inference take on T4 GPU? #128

New Issue
Closed
opened 2023-09-28 16:20:10 +02:00 by DaeseungLee · 1 comment
DaeseungLee commented 2023-09-28 16:20:10 +02:00 (Migrated from github.com)
Copy Link
Copy Source

Hello!

I want to optimize inference time.
How long does inference take on T4 GPU for single image?

I takes 14 seconds excluding loading model.
There are any technique to reduce the time?

Thanks!

Hello! I want to optimize inference time. How long does inference take on T4 GPU for single image? I takes 14 seconds excluding loading model. There are any technique to reduce the time? Thanks!
glucauze commented 2023-10-04 10:35:57 +02:00 (Migrated from github.com)
Copy Link
Copy Source

Did you check GPU is really used and CUDA provider is selected ? It should be enabled on settings too. That's surprisingly slow. Without upscaling it should be less than 2s. It is the case on my RTX3080ti. I don't have experience with T4. I will check on a M40 if i have time.

Did you check GPU is really used and CUDA provider is selected ? It should be enabled on settings too. That's surprisingly slow. Without upscaling it should be less than 2s. It is the case on my RTX3080ti. I don't have experience with T4. I will check on a M40 if i have time.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something isn't working
 configuration
Problem related to configuration
 documentation
Improvements or additions to documentation
 duplicate
This issue or pull request already exists
 enhancement
New feature or request
 fixed in future version
good first issue
Good for newcomers
 gradio
Gradio related bug
 help wanted
Extra attention is needed
 install
Install problem
 invalid
This doesn't seem right
 lack of information
Bug report does not comply with instructions. Not enough information to provide a solution
 question
Further information is requested
 wontfix
This will not be worked on
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
CalvinBackup (Calvin Backup)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: CalvinBackup/sd-webui-faceswaplab#128