-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
question about pruning at Residual connection of ResNet #1
Comments
hi @Yindong-Zhang , in this repos, channel align is necessary when pruning model. For ResNet, each bottleneck keep the same input/output (except the input of the first bottleneck) channels in every stage, so before pruning one stage, I counted each bottleneck's output pruning channel and choose the biggest one as the output channel number |
what happened the case when bottlenecks' output pruning channels don't overlap with each other. choose the biggest one seems to be an approximation. |
yes, because I want to fit the architecture of ResNet. If you have another solution, I look forward to knowing it |
thanks for your answer, actually i have no better solution. but comparative experimental may serve as a approving evidence for your strategy. hope to see it happen. |
enen, actually i have done some experiments about this repos. About the comparison between this repos and original paper, maybe yes maybe no. Again, the implementation of this ResNet pruning is just because I want to fit the architecture |
Dear author, this repo is a wonderful work. I am recently trouble by the residual connection when pruning using network slim. i read a little of your implementation and assume that there seem no specific manipulation to align the bottleneck input and residual ouput or in some cases, the downsampled input and the residual output. In the end, we have to add them together in ResNet. so alignment seems necessary.
Hope to get your answer.
The text was updated successfully, but these errors were encountered: