Filter/cufe

[ZiaddAhmedd]

team name: cufe

[harsha-simhadri]

please add a separate entry for cufe filter and cufe sparse

[harsha-simhadri]

Are these results as expected

cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 4, 'mt_threshold': 0.0001}))",yfcc-10M,10,7005.467777167178,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.721955
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 4, 'mt_threshold': 0.0003}))",yfcc-10M,10,6284.524075676667,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.762003
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 10, 'mt_threshold': 0.0001}))",yfcc-10M,10,5312.795862267859,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.826379
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 8, 'mt_threshold': 0.0003}))",yfcc-10M,10,5245.602730097057,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.8361879999999999
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 12, 'mt_threshold': 0.0002}))",yfcc-10M,10,4755.515456714368,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.8609640000000001
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 16, 'mt_threshold': 0.0001}))",yfcc-10M,10,4238.071924951995,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.870327
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 16, 'mt_threshold': 0.0003}))",yfcc-10M,10,4033.9051602997056,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.896015
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 16, 'mt_threshold': 0.00033}))",yfcc-10M,10,4013.6914950453065,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.8986319999999999
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 30, 'mt_threshold': 0.00033}))",yfcc-10M,10,2917.1327145073938,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.937862
cufe,"Faiss(('IVF4096,SQ8', {'nprobe': 32, 'mt_threshold': 0.00033}))",yfcc-10M,10,2806.7763921147266,0.0,554.1706802845001,4980820.0,0.0,0.0,filter,0.9411630000000001

[AbdelrahmanMohamed129]

no thats not the expected output can i make a modification?

[harsha-simhadri]

@AbdelrahmanMohamed129 Please do not change the parameters after the submission deadline. That is unfair to other participants. Please limit any changes to small code fixes

[AbdelrahmanMohamed129]

I apologize I was unaware of that rule. What should I do now?

[maumueller]

@AbdelrahmanMohamed129 Please remove your latest commit from this branch.

Add more details about why the results posted by Harsha are "not expected".

[ZiaddAhmedd]

@AbdelrahmanMohamed129 Please remove your latest commit from this branch.

Add more details about why the results posted by Harsha are "not expected".

@maumueller I reverted the commit of changing parameters and I just fixed the problem with neurips23.yml.
The results were too far from the expected I guess because machine specifications, but we were using the suggested machine from AWS.

[ZiaddAhmedd]

Is there something missing we need to do to get our submission merged?

[maumueller]

Alright, all CI runs are passing, I'm merging this.

This has be handled.