"Tip-Adapter/main.py" use test features to eval

[fikry102]

It seems odd to use test features to eval.
see

Tip-Adapter/main.py

Line 111 in fcb0605

# Eval

Could authors give some explanation?

[ZrrSkywalker]

Thanks for your interest.
Here in line 111, we conduct inference on the test set after every epoch's training.

[waleedgondal]

I agree with @fikry102, best 'adapter' selection is done using test features. Shouldn't validation features be used for model selection?

[ZrrSkywalker]

@waleedgondal Thanks for pointing out. Sorry for this mistake. The model selection after every-epoch training should be rectified by using validation set. By our experiments, this would not affect the final performance on the test set.