Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(tests) : Update CI to use new workflow and silicon. #145

Merged
merged 33 commits into from
Jul 24, 2024
Merged

feat(tests) : Update CI to use new workflow and silicon. #145

merged 33 commits into from
Jul 24, 2024

Conversation

mfuntowicz
Copy link
Member

No description provided.

mfuntowicz added 30 commits July 7, 2024 14:55
@mfuntowicz
Update CI to use new workflow and silicon.
89c4b88
@mfuntowicz
remove third-party trtllm
ffdf7f0
@mfuntowicz
Pin TensorRT-LLM version
077b93c
@mfuntowicz
Pin TensorRT-LLM to first 0.12 beta version
9e4f0a8
@mfuntowicz
Ensure torch dependency constraints match TRTLLM
5ac3547
@mfuntowicz
Remove quantization for now
37f7e39
@mfuntowicz
Allow restoring from local dir
b421cc6
@mfuntowicz
build all ranks
9c29aa9
@mfuntowicz
Improve checkpoints and engines discovery
816ff35
@mfuntowicz
use DirEntry.name in the lambda to retrieve filepath
fbfb447
@mfuntowicz
quality
e2b97a5
@mfuntowicz
Update checkpoint detection regex
8e096fc
@mfuntowicz
add logic to reload from local directory if model_id is a local trans…
d91605c 
…formers save_pretrained model path
@mfuntowicz
quality
b06cd39
@mfuntowicz
make sure to create the sharding config
37bae09
@mfuntowicz
move to latest trtllm version
20cd5b3
@mfuntowicz
remove bad_words for now
bd45eb4
@mfuntowicz
in fact its now called bad_token_ids
83cbfa3
@mfuntowicz
move on to GenerationExecutor, removing tokenizer param
f27f85b
@mfuntowicz
specify constructor call order for models
9254910
@mfuntowicz
specify local workspace for converting local model
eb73662
@mfuntowicz
fix wrong way of symlinking files and folder in save_pretrained
ee28669
@mfuntowicz
detect model_type from engine config if applicable
752b3c2
@mfuntowicz
remove deprecated test_config.py
b01c257
@mfuntowicz
handled dtype from prebuilt engine
4d760c8
@mfuntowicz
handled model_type from different config format
d098b39
@mfuntowicz
added test for model_type_from_known_config
83a52d3
@mfuntowicz
quality
0d9b266
@mfuntowicz
fix wrong ref name in test_hub
e2e9637
@mfuntowicz
More robust way to load artifacts
c729068
@mfuntowicz mfuntowicz merged commit fa8556c into main Jul 24, 2024
2 of 6 checks passed
@mfuntowicz mfuntowicz deleted the ci-l4 branch July 24, 2024 20:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mfuntowicz