Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Nemoretriever-parse (aka Eclair) NIM #230

Merged
merged 79 commits into from
Feb 19, 2025

Conversation

edknv
Copy link
Collaborator

@edknv edknv commented Nov 14, 2024

Description

Part of https://github.com/NVIDIA/nv-ingest-private/issues/52
Also closes https://github.com/NVIDIA/nv-ingest-private/issues/49.

The NIM has its own docker-compose profile nemoretriever-parse so you have to specify --profile to start the NIM service, e.g.,

docker compose --profile nemoretriever-parse up --build

To submit a job via nv-ingest-client, specify extract_method.

CLI:

--task 'extract:{..., "extract_method": "nemoretriever_parse", ...}

Ingestor:

    .extract(
        ...
        extract_method="nemoretriever_parse",
        ...
    )

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@edknv edknv marked this pull request as ready for review November 19, 2024 19:01
@edknv edknv requested review from drobison00 and jdye64 November 19, 2024 21:06
@edknv edknv requested a review from drobison00 November 20, 2024 03:48
@edknv
Copy link
Collaborator Author

edknv commented Nov 22, 2024

321052f adds support for preserving the text bounding boxes in the metadata (in the hierarchy field) and addresses issue https://github.com/NVIDIA/nv-ingest-private/issues/49. It also changes the way text blocks are concatenated to concatenate text blocks with \n\n as requested by research team.

@edknv edknv marked this pull request as draft December 6, 2024 02:45
@edknv edknv changed the title Add doughnut http endpoint Add Nemoretriever-parse (aka Eclair) NIM Feb 12, 2025
@edknv edknv marked this pull request as ready for review February 12, 2025 16:42
@edknv edknv requested a review from a team as a code owner February 19, 2025 04:52
@randerzander randerzander merged commit 863819b into NVIDIA:main Feb 19, 2025
1 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants