Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

downloading sudachidict_core dictionary #20

Open
alejandrojcastaneira opened this issue Aug 12, 2020 · 3 comments
Open

downloading sudachidict_core dictionary #20

alejandrojcastaneira opened this issue Aug 12, 2020 · 3 comments

Comments

@alejandrojcastaneira
Copy link

Hello,

After trying to install the sudachidict_core dictionary from pip, the process suddenly stops without fully downloading the dictionary. It also happened with the other dictionaries, my internet connection is good and stable. Maybe I'm missing something, but just in case I just wanted to let you know,

Bests regards

@sorami
Copy link
Collaborator

sorami commented Aug 12, 2020

Hi,

Thank you for the notice. That sounds pretty weird.

Do you mind sharing us the error message so we can further investigate?

@alejandrojcastaneira
Copy link
Author

Yes, sure:

/ pip install sudachidict_core
Collecting sudachidict_core
  Downloading SudachiDict-core-20200722.tar.gz (8.8 kB)
    ERROR: Command errored out with exit status 1:
     command: /home/www-data/anaconda3/envs/janzz_services/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-i8ew40rs/sudachidict-core/setup.py'"'"'; __file__='"'"'/tmp/pip-install-i8ew40rs/sudachidict-core/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-install-i8ew40rs/sudachidict-core/pip-egg-info
         cwd: /tmp/pip-install-i8ew40rs/sudachidict-core/
    Complete output (8 lines):
    Downloading the Sudachi dictionary (It may take a while) ...
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-i8ew40rs/sudachidict-core/setup.py", line 44, in <module>
        _, _msg = urlretrieve(ZIP_URL, ZIP_NAME)
      File "/home/www-data/anaconda3/envs/janzz_services/lib/python3.7/urllib/request.py", line 288, in urlretrieve
        % (read, size), result)
    urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 22634188 out of 71114304 bytes>
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

@peterdemin
Copy link

I managed to build a .whl files with resources included for SudachiDict, like so:

68M dist/SudachiDict_core-20211220-py3-none-any.whl

and confirmed, that the package can be installed and works. @sorami Would you be open to a PR that creates and uploads binary wheel releases to PyPI with resources/system.dic embedded into the package?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants