Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incremental KNN Query Doesn't hold state #4

Open
bitsondatadev opened this issue Oct 11, 2014 · 0 comments
Open

Incremental KNN Query Doesn't hold state #4

bitsondatadev opened this issue Oct 11, 2014 · 0 comments
Assignees

Comments

@bitsondatadev
Copy link

KNN right now does not maintain the state of the top k from one round of tweets to the next round. To see this in full effect have the tweets come in at a slow rate (set the sleep for 4000) and you will notice that for each query the one tweet record that is added is the top k every time. i.e. the query focal point and k are saved but the top k are not. I believe this is due to the built in priority queue that is holding the current top k needs to be maintained in a DStream. At the moment Thamir agreed to look into this but anyone is welcome help since I need to refocus my efforts on data mining for these next few weeks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants