You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
import argparse
from promptbase.gsm8k import gsm8k
from promptbase.humaneval import humaneval
from promptbase.math import math
from promptbase.drop import drop
from promptbase.bigbench import bigbench
from promptbase.bigbench.consts import BIGBENCH_SUBJECTS
(gpt5) [jfreeman@mir-81 promptbase]$ python -m promptbase mmlu
usage: main.py [-h] [--subject SUBJECT] [--list_subjects] {gsm8k,humaneval,math,drop,bigbench}
main.py: error: argument dataset: invalid choice: 'mmlu' (choose from 'gsm8k', 'humaneval', 'math', 'drop', 'bigbench')
Head of main.py :
import argparse
from promptbase.gsm8k import gsm8k
from promptbase.humaneval import humaneval
from promptbase.math import math
from promptbase.drop import drop
from promptbase.bigbench import bigbench
from promptbase.bigbench.consts import BIGBENCH_SUBJECTS
VALID_DATASETS = ["gsm8k", "humaneval", "math", "drop", "bigbench"]
:/
The text was updated successfully, but these errors were encountered: