Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feed two batches and then dividing the ended FLOPs by 2 to avoid the batch_norm error? #132

Open
cloude-z opened this issue Mar 21, 2023 · 0 comments

Comments

@cloude-z
Copy link

cloude-z commented Mar 21, 2023

Hi dear fvcore team,

in my model there is a very special case, where the input tensor only have the shape of [3, 1, 1] and [9, 1, 1], thus while estimating the FLOPs by feeding only one batch, the BatchNorm2d layer can't handle this sinlge input tensor and also it seems that fvcore lib doesn't consider this case too, so an error will just be threw out.

So I'm just wondering is it possible to feed two batches and get the FLOPs computed over them, then dividing the FLOPs by 2 to have the equivalent FLOPs as feeding one batch? Just as a beginner in computing FLOPs so really have no too much idea if this works in theory.... so I would appreciate if I can have some answers on this question. Big thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant