Code

Enable flash attention by default#690

Code

Merged

rsuderman merged 3 commits intonod-ai:mainnod-ai/shark-ai:mainfrom rsuderman:flash_attention_enablersuderman/sharktank:flash_attention_enableCopy head branch name to clipboardDec 13, 2024

+3-5

Commits

Commits on Dec 12, 2024

• Enable flash attention by default and make block size 32

  rsuderman

  committed
  0469c25

• reverted some unneeded changes

  rsuderman

  committed
  9bc64ee

Commits on Dec 13, 2024

• Merge branch 'main' into flash_attention_enable

  rsuderman

  authored
  5eb365a