Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

import too slow for large corpus files #210

Open
nschneid opened this issue Aug 20, 2020 · 0 comments
Open

import too slow for large corpus files #210

nschneid opened this issue Aug 20, 2020 · 0 comments

Comments

@nschneid
Copy link
Contributor

django-import-export is not designed for large files. @ablodge is able to get it working locally in dev mode (about 10 min. for STREUSLE usages), but on the server it fails after a minute with a 504 timeout error (and attempts to increase the timeout in apache settings had no effect).

Current workaround: download the database and import everything locally

A better approach in the future might be to test the import locally in the admin interface and then do the real import on the server through the shell: https://gist.github.com/int-ua/b2bcc4bea8227ab14a437900ff424723

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant