Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NeurIPS 2023 OOD] Update of parameters by team UTokyo #212

Merged
merged 14 commits into from
Nov 1, 2023

Conversation

maronuu
Copy link
Contributor

@maronuu maronuu commented Oct 30, 2023

This is a PR that updates the parameter for epsearch.
The original PR is #197 .
If you encounter the same kind of issues described in #197 , please follow the comment in the PR.

Could you please re-run the alogrithm? Some part of construction can utilize cache in the previous evaluation.
Thank you for the patient evaluation and sorry for the multiple updates.

@maronuu maronuu changed the title Submission/utokyo [NeurIPS 2023 OOD] Update of parameters by team UTokyo Oct 30, 2023
@maronuu maronuu marked this pull request as ready for review October 30, 2023 19:41
@maronuu
Copy link
Contributor Author

maronuu commented Oct 31, 2023

I have no idea why the CI Billion-Scale ANN Benchmarks, NeurIPS 2023 / build (sustech-ood, random-xs, ood) (pull_request) Failing after 27m is failing...

@maronuu

This comment was marked as outdated.

@maumueller
Copy link
Collaborator

I have no idea why the CI Billion-Scale ANN Benchmarks, NeurIPS 2023 / build (sustech-ood, random-xs, ood) (pull_request) Failing after 27m is failing...

This is not related to your PR, so do not worry about it.

@maronuu
Copy link
Contributor Author

maronuu commented Oct 31, 2023

Note

Here is a note that might be helpful for organizers to evaluate our submission.

Comment

Here are some notations that might be helpful to understand my source code

  • Dockerfile is much longer compared to other submission, sorry, but it installs minimum requirements for our submission.
  • ENV MKL_NUM_THREADS or similar envs are introduced to make sure that our algoirthm fully utilizes the cores.

Evaluation in my env

In my local environment, refining docker container using only 8 vCPU, and 16GB RAM,
we have:

  • baseline diskann: ~1600 QPS
  • our method: ~2400 QPS

And, in aws instance c6i.2xlarge, we have:

  • baseline diskann: 3882 QPS
  • our method: 4941 QPS

@harsha-simhadri harsha-simhadri merged commit 0269a9d into harsha-simhadri:main Nov 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants