Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

An error occurs between the kmeans function runs. #21

Open
JeonHyeongJunKW opened this issue Feb 19, 2021 · 0 comments
Open

An error occurs between the kmeans function runs. #21

JeonHyeongJunKW opened this issue Feb 19, 2021 · 0 comments

Comments

@JeonHyeongJunKW
Copy link

JeonHyeongJunKW commented Feb 19, 2021

I'm going to try to do 64 clusters kmeans for 50,000 datasets with 512 dimensions, and the following error occurs.
running k-means on cuda.. [running kmeans]: 0it [00:00, ?it/s]tcmalloc: large alloc 6553600000 bytes == 0x7f7bf5600000 @ 0x7f82122b0b6b 0x7f82122d0379 0x7f81c2f8b74e 0x7f81c2f8d7b6 0x7f81fd3e1fa2 0x7f81fd6ccbd3 0x7f81fd6a4207 0x7f81fd6bf2dc 0x7f81fd69b78a 0x7f81fd6a4207 0x7f81fd6bf2dc 0x7f81fd78b0dd 0x7f81fd3f309f 0x7f81fd3f56b6 0x7f81fd3f5bad 0x7f81fd3f5d28 0x7f81fd103ae5 0x7f81fd6cdae9 0x7f81fcf4d124 0x7f81fd85ea02 0x7f81fd75cc4e 0x7f81fecc8321 0x7f81fcf4d124 0x7f81fd85ea02 0x7f81fd9a369e 0x7f820d350fa9 0x7f820d3519b6 0x566f73 0x59fd0e 0x4b1eea 0x619d0c tcmalloc: large alloc 6553600000 bytes == 0x7f7a6ec00000 @ 0x7f82122b0b6b 0x7f82122d0379 0x7f81c2f8b74e 0x7f81c2f8d7b6 0x7f81fd9f7d53 0x7f81fd3e28cf 0x7f81fd6f9cac 0x7f81fd6a531b 0x7f81fd6c4135 0x7f81fd69fb4b 0x7f81fd6a531b 0x7f81fd6c4135 0x7f81fd78e2be 0x7f81fd3e1145 0x7f81fd9491ff 0x7f81fcfaec1b 0x7f81fd87b056 0x7f81fd78dba2 0x7f81fd2dbe43 0x7f81fd6cea59 0x7f81fcf4d1b1 0x7f81fd869183 0x7f81fd778d9e 0x7f81fed60021 0x7f81fcf4d1b1 0x7f81fd869183 0x7f81fd9ae69e 0x7f820d37c5f3 0x566f73 0x59fd0e 0x4b1eea ^C

I don't know why '^C' is printed on its own.
I tried to use this code as part of the loss class of pytorch. Is there any other solution?

this is the code
_, centroids = kmeans(descriptor, num_clusters=64, distance='euclidean', device=torch.device('cuda'))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant