Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
duzx16
0a499b7e9a
|
10 months ago | |
|---|---|---|
| .. | ||
| README.md | 10 months ago | |
| evaluate_ceval.py | 10 months ago | |
README.md
首先从 Tsinghua Cloud 下载处理好的 C-Eval 数据集，解压到 evaluation 目录下。然后运行
cd evaluation
python evaluate_ceval.py
这个脚本会在C-Eval的验证集上进行预测并输出准确率。如果想要得到测试集上的结果可以将代码中的 ./CEval/val/**/*.jsonl 改为 ./CEval/test/**/*.jsonl，并按照 C-Eval 规定的格式保存结果并在 官网 上提交。
汇报的结果使用的是内部的并行测试框架，结果可能会有轻微波动。
No Description
Python Markdown Shell other