Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sparse track private queries Azure results #241

Merged
merged 2 commits into from
Nov 15, 2023
Merged

Sparse track private queries Azure results #241

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
96ce41b
Create operating_points_private_queries_AzureD8lds_v5.csv
harsha-simhadri Nov 14, 2023
a1d4999
Create res_private_queries_AzureD8lds_v5.csv
harsha-simhadri Nov 14, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions neurips23/sparse/operating_points_private_queries_AzureD8lds_v5.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
qps
dataset algorithm
sparse-full NLE-Full 1314.194166
cufe 97.860465
linscan 95.098871
nle 1312.961060
pyanns 6499.652881
shnsw 5078.449772
sustech-whu 788.168885
64 changes: 64 additions & 0 deletions neurips23/sparse/res_private_queries_AzureD8lds_v5.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
algorithm,parameters,dataset,count,qps,distcomps,build,indexsize,mean_ssd_ios,mean_latency,track,recall/ap
cufe,cufe_linscan,sparse-full,10,227.63434120117714,0.0,600.1445260047913,6189808.0,0,0,sparse,0.4206428571428572
cufe,cufe_linscan,sparse-full,10,186.39229552582927,0.0,600.1445260047913,6189808.0,0,0,sparse,0.6936857142857142
cufe,cufe_linscan,sparse-full,10,128.83507399539567,0.0,600.1445260047913,6189808.0,0,0,sparse,0.8408285714285715
cufe,cufe_linscan,sparse-full,10,103.99974105027506,0.0,600.1445260047913,6189808.0,0,0,sparse,0.8892714285714286
cufe,cufe_linscan,sparse-full,10,100.73685289870832,0.0,600.1445260047913,6189808.0,0,0,sparse,0.8954142857142857
cufe,cufe_linscan,sparse-full,10,97.8604649178429,0.0,600.1445260047913,6189808.0,0,0,sparse,0.900457142857143
cufe,cufe_linscan,sparse-full,10,94.78651516094016,0.0,600.1445260047913,6189808.0,0,0,sparse,0.9048428571428572
cufe,cufe_linscan,sparse-full,10,92.40971530702063,0.0,600.1445260047913,6189808.0,0,0,sparse,0.9104142857142857
cufe,cufe_linscan,sparse-full,10,70.25161890632613,0.0,600.1445260047913,6189808.0,0,0,sparse,0.9523142857142858
cufe,cufe_linscan,sparse-full,10,46.95888598717684,0.0,600.1445260047913,6189808.0,0,0,sparse,0.9875
linscan,linscan,sparse-full,10,232.79487832568057,0.0,537.684385061264,9695816.0,0,0,sparse,0.47709999999999997
linscan,linscan,sparse-full,10,179.690479113319,0.0,537.684385061264,9695816.0,0,0,sparse,0.7132571428571428
linscan,linscan,sparse-full,10,124.49983965839021,0.0,537.684385061264,9695816.0,0,0,sparse,0.8423285714285715
linscan,linscan,sparse-full,10,101.19950394259968,0.0,537.684385061264,9695816.0,0,0,sparse,0.8887571428571428
linscan,linscan,sparse-full,10,98.18691889340374,0.0,537.684385061264,9695816.0,0,0,sparse,0.895357142857143
linscan,linscan,sparse-full,10,95.0988707651076,0.0,537.684385061264,9695816.0,0,0,sparse,0.9011285714285714
linscan,linscan,sparse-full,10,92.12243963919174,0.0,537.684385061264,9695816.0,0,0,sparse,0.9063285714285714
linscan,linscan,sparse-full,10,89.38919448398978,0.0,537.684385061264,9695816.0,0,0,sparse,0.9110857142857143
linscan,linscan,sparse-full,10,68.36809348664507,0.0,537.684385061264,9695816.0,0,0,sparse,0.9535285714285715
linscan,linscan,sparse-full,10,42.29337341267943,0.0,537.684385061264,9695816.0,0,0,sparse,0.9999857142857144
nle,pisa,sparse-full,10,2856.234458470133,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8074714285714286
nle,pisa,sparse-full,10,2856.1916683034246,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8087
nle,pisa,sparse-full,10,2691.1462133877158,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8203285714285714
nle,pisa,sparse-full,10,2408.921108341739,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8432999999999999
nle,pisa,sparse-full,10,2321.3958549348977,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8505571428571429
nle,pisa,sparse-full,10,2235.7683607868653,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8567428571428571
nle,pisa,sparse-full,10,2157.2421337235946,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8611285714285714
nle,pisa,sparse-full,10,2088.192461089093,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8646571428571429
nle,pisa,sparse-full,10,1703.9572842521488,0.0,7.253209590911865,4134136.0,0,0,sparse,0.8938714285714285
nle,pisa,sparse-full,10,1312.9610604099873,0.0,7.253209590911865,4134136.0,0,0,sparse,0.9120857142857142
pyanns,pyanns_qdrop0.1_ef50,sparse-full,10,8990.107862451949,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8599
pyanns,pyanns_qdrop0.08_ef50,sparse-full,10,8501.653268995944,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8619285714285715
pyanns,pyanns_qdrop0.1_ef55,sparse-full,10,8486.996538442083,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8681285714285714
pyanns,pyanns_qdrop0.1_ef60,sparse-full,10,7985.339242168499,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8773428571428571
pyanns,pyanns_qdrop0.1_ef65,sparse-full,10,7552.275486053431,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8836714285714284
pyanns,pyanns_qdrop0.08_ef65,sparse-full,10,7085.3217677704215,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8871857142857144
pyanns,pyanns_qdrop0.1_ef70,sparse-full,10,7166.3483806466475,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8909285714285714
pyanns,pyanns_qdrop0.08_ef70,sparse-full,10,6731.237045119037,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8935857142857143
pyanns,pyanns_qdrop0.1_ef75,sparse-full,10,6812.592567670259,0.0,30594.126573085785,14059868.0,0,0,sparse,0.8964142857142857
pyanns,pyanns_qdrop0.1_ef80,sparse-full,10,6499.652881086978,0.0,30594.126573085785,14059868.0,0,0,sparse,0.9007428571428571
shnsw,sparse_hnswlib,sparse-full,10,12129.236952038496,0.0,28544.545388936996,11030276.0,0,0,sparse,0.7550714285714286
shnsw,sparse_hnswlib,sparse-full,10,7906.671521241277,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8482571428571429
shnsw,sparse_hnswlib,sparse-full,10,7349.001456277387,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8579428571428572
shnsw,sparse_hnswlib,sparse-full,10,7039.667007938772,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8632428571428571
shnsw,sparse_hnswlib,sparse-full,10,6845.15150427144,0.0,28544.545388936996,11030276.0,0,0,sparse,0.867157142857143
shnsw,sparse_hnswlib,sparse-full,10,6653.749323806608,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8710142857142857
shnsw,sparse_hnswlib,sparse-full,10,6395.084693117865,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8759428571428571
shnsw,sparse_hnswlib,sparse-full,10,6221.471994704143,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8805571428571428
shnsw,sparse_hnswlib,sparse-full,10,5338.993320468404,0.0,28544.545388936996,11030276.0,0,0,sparse,0.8991
shnsw,sparse_hnswlib,sparse-full,10,5078.449771911833,0.0,28544.545388936996,11030276.0,0,0,sparse,0.9044571428571428
shnsw,sparse_hnswlib,sparse-full,10,4829.60866193775,0.0,28544.545388936996,11030276.0,0,0,sparse,0.9086857142857143
shnsw,sparse_hnswlib,sparse-full,10,4615.94774694466,0.0,28544.545388936996,11030276.0,0,0,sparse,0.9123285714285714
shnsw,sparse_hnswlib,sparse-full,10,4422.575886160742,0.0,28544.545388936996,11030276.0,0,0,sparse,0.9158142857142858
sustech-whu,{'ef': 35}),sparse-full,10,932.5329338958998,0.0,-1.0,11171640.0,0,0,sparse,0.8805857142857143
sustech-whu,{'ef': 40}),sparse-full,10,853.7173850703973,0.0,-1.0,11171640.0,0,0,sparse,0.8910714285714286
sustech-whu,{'ef': 43}),sparse-full,10,812.474843760468,0.0,-1.0,11171640.0,0,0,sparse,0.8976571428571429
sustech-whu,{'ef': 45}),sparse-full,10,788.1688849568907,0.0,-1.0,11171640.0,0,0,sparse,0.9018
sustech-whu,{'ef': 48}),sparse-full,10,752.8134485126051,0.0,-1.0,11171640.0,0,0,sparse,0.9062714285714286
sustech-whu,{'ef': 50}),sparse-full,10,731.3218632375791,0.0,-1.0,11171640.0,0,0,sparse,0.9089285714285713
sustech-whu,{'ef': 55}),sparse-full,10,682.7062880137389,0.0,-1.0,11171640.0,0,0,sparse,0.9164428571428571
sustech-whu,{'ef': 65}),sparse-full,10,605.4877324719387,0.0,-1.0,11171640.0,0,0,sparse,0.9249142857142857
sustech-whu,{'ef': 75}),sparse-full,10,543.3627694265316,0.0,-1.0,11171640.0,0,0,sparse,0.9339142857142857
sustech-whu,{'ef': 80}),sparse-full,10,516.4006986012673,0.0,-1.0,11171640.0,0,0,sparse,0.9381142857142857