Code

Bump TensorRT-LLM to v0.16.0#166

Code

Merged

mfuntowicz merged 40 commits intomainhuggingface/optimum-nvidia:mainfrom update_to_0.15.0huggingface/optimum-nvidia:update_to_0.15.0Copy head branch name to clipboardJan 16, 2025

+240-154

Commits

Commits on Dec 9, 2024

• misc(trtllm): update to v0.15.0

  mfuntowicz

  committed
  417cea6

  Copy full SHA for 417cea6

• chore: quality

  mfuntowicz

  committed
  bfc7a36

  Copy full SHA for bfc7a36

• misc(deps): relax transformers dependency

  mfuntowicz

  committed
  3edd6fb

  Copy full SHA for 3edd6fb

• misc(actions): update dependency on GA

  mfuntowicz

  committed
  c412c82

  Copy full SHA for c412c82

• misc(deps): fu

  mfuntowicz

  committed
  76967a9

  Copy full SHA for 76967a9

• fix(test_causal_lm): double parametrization of tp

  mfuntowicz

  committed
  351b42d

  Copy full SHA for 351b42d

• misc(deps): bump accelerate to > 0.26

  mfuntowicz

  committed
  fb1bd54

  Copy full SHA for fb1bd54

• test(test_causal_lm): ok fixture was "pp" not "tp"

  mfuntowicz

  committed
  9edb6be

  Copy full SHA for 9edb6be

• misc(trtllm): remove lookup_plugin key in export config

  mfuntowicz

  committed
  07a92e5

  Copy full SHA for 07a92e5

• misc(trtllm): ...

  mfuntowicz

  committed
  db9deae

  Copy full SHA for db9deae

Commits on Dec 12, 2024

• misc(trtllm): reenable sparsity

  mfuntowicz

  committed
  a2f3c84

  Copy full SHA for a2f3c84

• misc(trtllm): attempt to automatically push to PyPi release

  mfuntowicz

  committed
  616a094

  Copy full SHA for 616a094

• misc(trtllm): let's try docker too?

  mfuntowicz

  committed
  02abd11

  Copy full SHA for 02abd11

• misc(trtllm): bump to v0.1.0b9 for release

  mfuntowicz

  committed
  f52b4b2

  Copy full SHA for f52b4b2

• misc(trtllm): update readme

  mfuntowicz

  committed
  f06e92c

  Copy full SHA for f06e92c

• misc(trtllm): do not set max_tokens to None

  mfuntowicz

  committed
  adf3dd4

  Copy full SHA for adf3dd4

Commits on Dec 13, 2024

• misc(trtllm): make sure we use the same inputs structure in the output

  mfuntowicz

  committed
  b6b5325

  Copy full SHA for b6b5325

• misc(trtllm): format

  mfuntowicz

  committed
  76321d3

  Copy full SHA for 76321d3

Commits on Jan 11, 2025

• misc(trtllm): bump to 0.16.0

  mfuntowicz

  committed
  aec9ff7

  Copy full SHA for aec9ff7

Commits on Jan 12, 2025

• misc(trtllm): fix test

  mfuntowicz

  committed
  3258b33

  Copy full SHA for 3258b33

• misc(trtllm): fix test

  mfuntowicz

  committed
  f82c2cf

  Copy full SHA for f82c2cf

• misc(trtllm): fix test

  mfuntowicz

  committed
  9c85554

  Copy full SHA for 9c85554

Commits on Jan 15, 2025

• misc(trtllm): fix test

  mfuntowicz

  committed
  94d6e32

  Copy full SHA for 94d6e32

• misc(trtllm): quality

  mfuntowicz

  committed
  9dd82e4

  Copy full SHA for 9dd82e4

• misc(trtllm): quality

  mfuntowicz

  committed
  6aaa045

  Copy full SHA for 6aaa045

• misc(trtllm): attempt to fix test

  mfuntowicz

  committed
  d236ac7

  Copy full SHA for d236ac7

• update docker image to match 0.16

  mfuntowicz

  committed
  5e34bd0

  Copy full SHA for 5e34bd0

• update docker image to match 0.16 (bis)

  mfuntowicz

  committed
  7c728a4

  Copy full SHA for 7c728a4

• top_p > 0 as per trtllm requirements

  mfuntowicz

  committed
  cc3ff70

  Copy full SHA for cc3ff70

• fix some more breaking changes

  mfuntowicz

  committed
  6850bbd

  Copy full SHA for 6850bbd

• fix some more breaking changes bis

  mfuntowicz

  committed
  ea3bc6c

  Copy full SHA for ea3bc6c

• fix test_misc

  mfuntowicz

  committed
  bf519b3

  Copy full SHA for bf519b3

• again

  mfuntowicz

  committed
  01d2d53

  Copy full SHA for 01d2d53

• again

  mfuntowicz

  committed
  c4e80c3

  Copy full SHA for c4e80c3

• again

  mfuntowicz

  committed
  a6f2eac

  Copy full SHA for a6f2eac

• fix: Fix tests to comply with 0.16.0 update.

  Hugoch

  committed
  3a54e9b

  Copy full SHA for 3a54e9b

• Merge branch 'update_to_0.15.0' of github.com:huggingface/optimum-nvidia into update_to_0.15.0

  Hugoch

  committed
  5059840

  Copy full SHA for 5059840

• again

  mfuntowicz

  committed
  ab953f9

  Copy full SHA for ab953f9

• finally?

  mfuntowicz

  committed
  36d635e

  Copy full SHA for 36d635e

Commits on Jan 16, 2025

• reintroduce more model

  mfuntowicz

  committed
  1803709

  Copy full SHA for 1803709