Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
LSX-Sneakerprogrammer
5e1eae5f3e
|
1 month ago | |
|---|---|---|
| .. | ||
| readme.md | 1 month ago | |
| score_CEVAL.py | 1 month ago | |
| score_MMLU.py | 1 month ago | |
readme.md
榜单复现方法
CEVAL
首先，下载CEVAL数据集并解压：
wget https://huggingface.co/datasets/ceval/ceval-exam/resolve/main/ceval-exam.zip
unzip ceval-exam.zip
之后运行预测脚本：
python score_CEVAL.py --path /path/to/ckpt --five_shot
得到提交结果submission.json，并提交到CEVAL官方网站上得到评测结果。
MMLU
数据下载路径：https://github.com/hendrycks/test?tab=readme-ov-file
之后运行预测脚本：
python score_MMLU.py
中国电信开源星辰语义大模型-7B
Python Shell other