#1191 NPU调试任务的数据集选择

Closed
created 2 years ago by jiaojy · 5 comments
jiaojy commented 2 years ago
由于NPU模式下,无法同步checkpoint和代码,需要通过像数据压缩成zip的方式来上传,然后选择同步 但是呢,NPU模式下的数据集选择只能选择一个zip文件,导致checkpoint和代码、数据集需要压缩成一个zip 上传同步,不能实现增量式的同步
wangj added the
need review
label 1 year ago
wangj added the
enhancement
label 1 year ago
jiaojy commented 1 year ago
Poster
可以通过git来同步代码,但是ckpt就不行了
JeffDing commented 1 year ago
可以尝试上传成数据集,然后在调试任务中使用wget命令下载数据集。使用浏览器下载数据集可以获取到数据集的下载地址,然后去环境里使用wget '下载地址' 就可以把数据集下载到调试任务里了。
jiaojy commented 1 year ago
Poster
好的哈,我之前试过,文件太大上传太慢了
tanglj added this to the V20221228 milestone 1 year ago
tanglj commented 1 year ago
Collaborator
目前已支持选多个数据集,马上会支持添加模型。
tanglj removed this from the V20221228 milestone 1 year ago
tanglj commented 1 year ago
Collaborator
关闭该任务。新建NPU调试任务时,已支持选择模型。可以将本地或者线上的模型导入“模型”页签,然后在新建调试任务时使用。
tanglj closed this issue 1 year ago
Sign in to join this conversation.
No Milestone
No Assignees
3 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.