You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed that in your implementation of CPC your datasets can provide a variable number of positive samples. Scaling with your batch size in your case.
In the original paper, I think the authors intend NCE to be used with only one positive sample.
I wonder if this might affect the outcome.
Certainly it must affect the guarantees made by the paper for having a bound on the mutual information. (?)
-Bahti Zakirov
The text was updated successfully, but these errors were encountered:
Hey David,
Disclaimer: I am far from an expert.
I noticed that in your implementation of CPC your datasets can provide a variable number of positive samples. Scaling with your batch size in your case.
In the original paper, I think the authors intend NCE to be used with only one positive sample.
I wonder if this might affect the outcome.
Certainly it must affect the guarantees made by the paper for having a bound on the mutual information. (?)
-Bahti Zakirov
The text was updated successfully, but these errors were encountered: