Code

[WIP] Shadereval tasks#173

Code

Draft

Vipitis wants to merge 10 commits intobigcode-project:mainbigcode-project/bigcode-evaluation-harness:mainfrom Vipitis:shaderevalVipitis/bigcode-evaluation-harness:shaderevalCopy head branch name to clipboard

+230-1

Commits

Commits on Sep 2, 2024

• Add shadereval tasks

  Vipitis

  committed
  4b66981

• Fix imports

  Vipitis

  committed
  3c67f32

• Fix missing prompt

  Vipitis

  committed
  2f4c4c2

• Fix non unicode characters causing offset

  Vipitis

  committed
  85f3420

• Add "full" prompt option

  Vipitis

  committed
  3ba31cd

• Fix kwarg in init

  Vipitis

  committed
  f183a17

• Add tagging for "incomplete generations"

  Vipitis

  committed
  de0bab7

• Add documentation

  Vipitis

  committed
  fcafbab

Commits on Sep 16, 2024

• Update FunctionCompletion task

  Vipitis

  committed
  2b17284

Commits on Nov 13, 2024

• update dataset link

  Vipitis

  committed
  b08fdc1