Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Show better error message when synonyms file is too large #17226

Open
snikoyo opened this issue Feb 3, 2025 · 0 comments
Open

[BUG] Show better error message when synonyms file is too large #17226

snikoyo opened this issue Feb 3, 2025 · 0 comments
Labels
bug Something isn't working _No response_ untriaged

Comments

@snikoyo
Copy link

snikoyo commented Feb 3, 2025

Describe the bug

I've tried a large synonyms file (22 MB) in OpenSearch 2.17. I referenced the file in the Dockerfile. The image I used is public.ecr.aws/opensearchproject/opensearch:2.17.0. It throws a generic error multiple times that Lucene could not be loaded:

opensearch | [2025-02-03T09:54:35,819][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [opensearch] uncaught exception in thread [main]
opensearch | org.opensearch.bootstrap.StartupException: java.lang.IllegalArgumentException: Could not load codec 'Lucene912'. Did you forget to add lucene-backward-codecs.jar?

I augmented the Java Heap to 8 GB but it didn't help. I couldn't find any documentation about the maximum file size of a synonyms file. There is an old Lucene issue that tested with "huge" file sizes of 44000 lines, generated from WordNet. But that's a rather small size by today's standards.

Related component

No response

To Reproduce

  1. Load a large synonyms file via COPY in the Dockerfile
  2. Start the docker container

Expected behavior

A clear error message that the file was too large (ideally with the possible maximum file size).

Additional Details

Plugins
None

Host/Environment (please complete the following information):

  • OS: Ubuntu
  • Version: 2.17
@snikoyo snikoyo added bug Something isn't working untriaged labels Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working _No response_ untriaged
Projects
None yet
Development

No branches or pull requests

1 participant