Skip to content
CI - sharktank perplexity short

Initial fix for token corruption when batching #397

Sign in to view logs

Initial fix for token corruption when batching

Initial fix for token corruption when batching #397

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Llama3.1 8B FP16 (3.11, llama-mi300x-3)
3m 59s
3m 59s