Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stage 1 & 2 rework #6

Open
legraphista opened this issue May 27, 2016 · 0 comments
Open

Stage 1 & 2 rework #6

legraphista opened this issue May 27, 2016 · 0 comments

Comments

@legraphista
Copy link
Contributor

Stage 2 is still very slow and it keeps both node's process and neo4j's processes bellow 50%.
A wild guess is that because seeking a :Claim before creating the :Claim is locking and it needs to be handled single threaded. Since Stage 2 creates relationships and also adds :Claim properties, this means that the node creation is also slowed down.

So a way to work this around and possibly fix the slow import on stage 2 is to create the :Claim nodes beforehand, in stage 1 and leave stage 2 only for relationships. Maybe even store more id's before flushing it out. So the only thing that needs storing is the :Entity id and the :Claim id in a hash table where the key is the relation type.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant