Skip to content

Commit

Permalink
feat: add recommendation for experimental LLM model
Browse files Browse the repository at this point in the history
  • Loading branch information
LogCreative committed Jun 29, 2024
1 parent 022c6bc commit c3c97f1
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions llm/server_llm.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,10 @@
from mlc_llm import MLCEngine

# Create engine
## The original Llama 3 model:
model = "HF://mlc-ai/Llama-3-8B-Instruct-q4f16_1-MLC"
## The experimental finetuned Llama 3 model:
# model = "HF://LogCreative/Llama-3-8B-Instruct-pgfplots-finetune-q4f16_1-MLC"
engine = None

import sys
Expand Down

0 comments on commit c3c97f1

Please sign in to comment.