Files

3rdparty
benchmarks
cpp
docker
docs
examples
scripts
tensorrt_llm
- layers
- models
  - baichuan
  - bert
  - bloom
  - chatglm2_6b
  - chatglm6b
  - enc_dec
  - falcon
  - gpt
  - gptj
  - gptneox
  - llama
  - opt
    - __init__.py
    - model.py
  - quantized
  - unet
  - __init__.py
  - generation_mixin.py
- plugin
- quantization
- runtime
- tools
- __init__.py
- _common.py
- _ipc_utils.py
- _utils.py
- builder.py
- functional.py
- graph_rewriting.py
- logger.py
- mapping.py
- module.py
- network.py
- parameter.py
- profiler.py
tests
windows
.clang-format
.dockerignore
.gitattributes
.gitignore
.gitmodules
.pre-commit-config.yaml
LICENSE
README.md
requirements-dev-windows.txt
requirements-dev.txt
requirements-windows.txt
requirements.txt
setup.cfg
setup.py

opt

Oct 11, 2023

027cd51 · Oct 11, 2023

This branch is 1 commit ahead of, 9 commits behind NVIDIA/TensorRT-LLM:release/0.5.0.

Name		Name	Last commit message	Last commit date
parent directory ..
__init__.py		__init__.py	Initial commit	Sep 20, 2023
model.py		model.py	Update	Oct 11, 2023