About reproduction

[sHaol0w]

Hi, I have tried to reproduce your excellent work LiveHand, but I encountered some problems in the rendered border. Do you have any ideas?

[amundra15]

Hi,

Are these renderings from the model weights we provide or did you train a new model?

[sHaol0w]

Hi,

Are these renderings from the model weights we provide or did you train a new model?

I trained a new model and used my data preprocessing, which is fine for my method and other method.
If you do not see this ever, then there may be some problems in my side?

[amundra15]

We never saw these artifacts in the final training configuration. In one of the older configurations where we tried an additional BG loss resulted in somewhat similar artifacts.

I assume that the results you uploaded are for the super-resolved image. In that case, I would also save the low-res image from the neural rendering part to see if it is present there as well. Otherwise, the issue comes from an improperly trained SR module.

Another source of error could be incorrect supervision. I think I binarize the loaded BG mask and multiply it with the RGB image to get the GT image. If there is some issue here, that can cause this error too.