Code

Add LongBench validation#1220

Code

Open

l-bat wants to merge 14 commits intoopenvinotoolkit:masteropenvinotoolkit/openvino.genai:masterfrom l-bat:lt/eval_longbenchl-bat/openvino.genai:lt/eval_longbenchCopy head branch name to clipboard

+359

Commits

Commits on Feb 4, 2025

• Add LongBench validation

  l-bat

  committed
  5bcbb4c

  Copy full SHA for 5bcbb4c

• fix

  l-bat

  committed
  59c7269

  Copy full SHA for 59c7269

• set context len as max len to phi3

  l-bat

  committed
  92fd747

  Copy full SHA for 92fd747

• update model

  l-bat

  committed
  1cbbbf4

  Copy full SHA for 1cbbbf4

• change model to Qwen2

  l-bat

  committed
  6c5e7f6

  Copy full SHA for 6c5e7f6

• add test to precommit

  l-bat

  committed
  053e787

  Copy full SHA for 053e787

• add missing requirement

  l-bat

  committed
  e3d8e91

  Copy full SHA for e3d8e91

• Remove eos_token_id

  l-bat

  committed
  d9b4c84

  Copy full SHA for d9b4c84

• Update test logic to relative diff

  l-bat

  committed
  6705375

  Copy full SHA for 6705375

• Exclude longbench from precommit

  l-bat

  committed
  1bbf232

  Copy full SHA for 1bbf232

• Add license

  l-bat

  committed
  1e88d10

  Copy full SHA for 1e88d10

• Add test to nightly scope

  l-bat

  committed
  3532f79

  Copy full SHA for 3532f79

• Extend test to GPU device

  l-bat

  committed
  13ffa31

  Copy full SHA for 13ffa31

Commits on Feb 5, 2025

• Merge branch 'master' into lt/eval_longbench

  AlexKoff88

  authored
  593dc65

  Copy full SHA for 593dc65