Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
houysh
5f64055528
|
2 years ago | |
|---|---|---|
| .. | ||
| code | 2 years ago | |
| Dockerfile | 2 years ago | |
| README.md | 2 years ago | |
| client | 2 years ago | |
| code_desc.md | 2 years ago | |
| config.yaml | 2 years ago | |
| copy_files.sh | 2 years ago | |
| local_eval.sh | 2 years ago | |
| local_train.sh | 2 years ago | |
| requirements.txt | 2 years ago | |
| start.sh | 2 years ago | |
README.md
云际学习client端
主要功能
- 参数获取：从参数服务器获取参数
- 模型训练：以获取到的参数为初始参数进行模型训练
- 参数上传：完成训练后，把更新后的模型参数上传到参数服务器
- 模型验证：测试训练后的模型，把测试结果上传到管理平台
支撑模块
- client：客户端程序
- code : 算法代码
- start.sh :启动脚本，负责启动模型训练进程
- Dockerfile: docker 镜像编译文件
代码说明
本地运行
- 本地训练
# 脚本 local_train.sh
python code/train.py --local_run --epochs=10
# 默认数据位置在data目录下，模型存放位置为 models/avg
- 本地评估
# 脚本 local_eval.sh 进行批量评估
code/test.py --local_run
# 默认测试数据为data/dev.tsv，默认模型存放位置在 models/avg，默认checkpoint为finial.pdparams