Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
chengwx
88667dcdb8
|
1 year ago | |
|---|---|---|
| PTB | 1 year ago | |
| finetune_ckpt_path | 1 year ago | |
| src | 1 year ago | |
| README.md | 1 year ago | |
| code.sh | 1 year ago | |
| requirement.txt | 1 year ago | |
| run_language_model_dis.py | 1 year ago | |
| run_language_model_single.py | 1 year ago | |
| run_train_distribute.sh | 1 year ago | |
| start_predict.py | 1 year ago | |
| stop_train.sh | 1 year ago | |
| tokenizer.py | 1 year ago | |
README.md
基于MindSpore框架的OPT模型实现，更新中。。。
模型训练
数据集为PTB数据集，已经保存在PTB目录下。
- 单机单卡运行脚本：python run_language_model_single.py
- 单机多卡运行脚本：sh run_language_model_dis.py
模型推理（CPU）
- 下载相关模型至文件夹finetune_ckpt_path下的对应模型文件夹内
- 运行脚本：python start_predict.py
项目存在问题
- 模型损失函数设置存在问题
- 由于MindSpore在NPU下mindspore.ops.multinomial算子兼容性问题，目前只能在CPU、GPU平台上进行模型推理、
- 。。。