Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bring back Python backend based PyTorch backend #117

Merged
merged 13 commits into from
Jan 11, 2024
+500 −2
Merged

Bring back Python backend based PyTorch backend #117

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
d126b08
Add Python backend based PyTorch runtime
kthui Nov 4, 2023
8d50071
Add exec env build
kthui Nov 14, 2023
4381340
Add note for adding .pt2 model support
kthui Dec 8, 2023
f71dd17
Do not specify pytorch cuda version
kthui Dec 8, 2023
b459f73
Do not install Python runtime on non x86
kthui Dec 9, 2023
8ff6a3a
Merge branch 'main' of github.com:triton-inference-server/pytorch_bac…
kthui Jan 3, 2024
78c47fe
Remove legacy comment
kthui Jan 3, 2024
e7cf4d2
Merge branch 'main' of github.com:triton-inference-server/pytorch_bac…
kthui Jan 6, 2024
8b856f6
User to build PyTorch env
kthui Jan 6, 2024
7d8a3a7
Add docs
kthui Jan 8, 2024
9aa6b41
Update copyright
kthui Jan 8, 2024
b8abcaa
Clarify model layout between PyTorch and TorchScript
kthui Jan 10, 2024
63251ba
Fix header size
kthui Jan 10, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update copyright
@kthui
kthui committed Jan 8, 2024
commit 9aa6b412335b6bdb9f26c2eb782613b5e7b3613e
2 changes: 1 addition & 1 deletion CMakeLists.txt
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Copyright 2019-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# Copyright 2019-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions
2 changes: 1 addition & 1 deletion README.md
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<!--
# Copyright 2020-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# Copyright 2020-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions
2 changes: 1 addition & 1 deletion src/model.py
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env python3

# Copyright 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# Copyright 2023-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions
2 changes: 1 addition & 1 deletion tools/gen_pb_exec_env.sh
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/bin/bash
# Copyright 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# Copyright 2023-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions