Skip to content
label_issue

The model's max seq len (4096) is larger than the maximum number of tokens that can be stored in KV cache (1216). Try increasing gpu_memory_utilization or decreasing max_model_len when initializing the engine #1920

Sign in to view logs

The model's max seq len (4096) is larger than the maximum number of tokens that can be stored in KV cache (1216). Try increasing gpu_memory_utilization or decreasing max_model_len when initializing the engine

The model's max seq len (4096) is larger than the maximum number of tokens that can be stored in KV cache (1216). Try increasing gpu_memory_utilization or decreasing max_model_len when initializing the engine #1920

Workflow file for this run

.github/workflows/label_issue.yml at b558902
name: label_issue
on:
issues:
types:
- opened
jobs:
label_issue:
runs-on: ubuntu-latest
permissions:
issues: write
steps:
- env:
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
ISSUE_URL: ${{ github.event.issue.html_url }}
ISSUE_TITLE: ${{ github.event.issue.title }}
run: |
LABEL=pending
NPU_KEYWORDS=(npu huawei ascend 华为 昇腾)
ISSUE_TITLE_LOWER=$(echo $ISSUE_TITLE | tr '[:upper:]' '[:lower:]')
for KEYWORD in ${NPU_KEYWORDS[@]}; do
if [[ $ISSUE_TITLE_LOWER == *$KEYWORD* ]] && [[ $ISSUE_TITLE_LOWER != *input* ]]; then
LABEL=pending,npu
break
fi
done
gh issue edit $ISSUE_URL --add-label $LABEL