Code

run end_to_end_test_llama.py error#134

Code

Open

SherronBurtint wants to merge 24 commits intotriton-inference-server:maintriton-inference-server/fastertransformer_backend:mainfrom void-main:mainvoid-main/fastertransformer_backend:mainCopy head branch name to clipboard

+102,071-260

Commits

Commits on Apr 25, 2023

• add llama to FT backend

  void-main

  committed
  d927c81

  Copy full SHA for d927c81

• bugfix

  void-main

  committed
  09e3991

  Copy full SHA for 09e3991

• add llama config

  void-main

  committed
  1d24a32

  Copy full SHA for 1d24a32

Commits on Apr 27, 2023

• add ensemble for llama

  void-main

  committed
  83058bb

  Copy full SHA for 83058bb

Commits on Apr 29, 2023

• add bf16 for llama

  void-main

  committed
  ca007ed

  Copy full SHA for ca007ed

Commits on Jun 26, 2023

• edit README

  l1cacheDell

  committed
  60dcf5d

  Copy full SHA for 60dcf5d

• fix docker build bug

  l1cacheDell

  committed
  8cbb24c

  Copy full SHA for 8cbb24c

• fix

  l1cacheDell

  committed
  46c3ac2

  Copy full SHA for 46c3ac2

• add debug in dockerfile

  l1cacheDell

  committed
  eb4fb09

  Copy full SHA for eb4fb09

• fix

  l1cacheDell

  committed
  0302883

  Copy full SHA for 0302883

• all change to llama not 7b

  l1cacheDell

  committed
  960415b

  Copy full SHA for 960415b

• roll back to Release for faster compiling

  l1cacheDell

  committed
  ca3a714

  Copy full SHA for ca3a714

Commits on Jun 28, 2023

• change path

  l1cacheDell

  committed
  562d85a

  Copy full SHA for 562d85a

• add llama guide

  l1cacheDell

  committed
  1f09ab1

  Copy full SHA for 1f09ab1

• edit guide.md

  l1cacheDell

  committed
  cc8e38e

  Copy full SHA for cc8e38e

• roll back to void-main repo

  l1cacheDell

  committed
  5da565e

  Copy full SHA for 5da565e

Commits on Jul 3, 2023

• rollback

  l1cacheDell

  committed
  47f3a71

  Copy full SHA for 47f3a71

• Merge pull request #1 from SamuraiBUPT/main

  Show description for b7ba3dc
  void-main

  authored
  b7ba3dc

  Copy full SHA for b7ba3dc

Commits on Jul 6, 2023

• int8_mode fix and remove decoupled mode in config

  l1cacheDell

  committed
  463fa61

  Copy full SHA for 463fa61

• Merge branch 'main' of https://github.com/SamuraiBUPT/ft_backend

  l1cacheDell

  committed
  8cd5172

  Copy full SHA for 8cd5172

Commits on Jul 10, 2023

• decoupled mode support

  l1cacheDell

  committed
  4d3292c

  Copy full SHA for 4d3292c

• Merge pull request #3 from SamuraiBUPT/dev-llama-backend

  Show description for 9fbf442
  void-main

  authored
  9fbf442

  Copy full SHA for 9fbf442

Commits on Jul 11, 2023

• Update libfastertransformer.cc

  Show description for dab3126
  happened

  authored
  dab3126

  Copy full SHA for dab3126

• Merge pull request #4 from happened/main

  Show description for 01c793e
  void-main

  authored
  01c793e

  Copy full SHA for 01c793e