Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Real-ESRGAN x2 Plus #44

Open
x5nder opened this issue Mar 27, 2024 · 1 comment
Open

Support Real-ESRGAN x2 Plus #44

x5nder opened this issue Mar 27, 2024 · 1 comment

Comments

@x5nder
Copy link

x5nder commented Mar 27, 2024

I've run a bunch of tests on upscaling SD movies (VHS and DVD) and found that using that using Real-ESRGAN x2 Plus (RealESRGAN_x2plus.pth) is offering much better quality than the included RealESRGAN encoder, which tends to smooth out details so people look like they're made of plastic.

Unfortunately, using x2 Plus as custom model has a severe impact on the transcoding speed (going from approx 60-110fps for RealESRGAN TensorRT 2x to around 13-24fps for the custom model converted to TensorRT engine).

Is there any way to speed this up, or is there any way you could implement a fast x2 (or x4) upscaler that is much better for realistic movies (as opposed to anime content)?

@styler00dollar
Copy link

RealESRGAN_x2plus.pth is ESRGAN (RRDBNet) which is known to be slow while the included model is also from the RealESRGAN repository but based on SRVGGNetCompact which is much smaller. That are completely different architectures. Behavior is expected and there isn't really something you can do. You would need to find a different model to make it faster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants