启智AI协作平台停电检修公告>>> 芯动开源-openMind专场活动来袭！连续4周，周周有排名，周周有奖金！每周49个获奖名额，每位获奖者100-1000元不等，快来挑战吧~>>> 关于云脑任务中统一路径访问方式的公告>>>
zeizei
/
OpenI_Learning
Not watched
66
232
Fork 237
Code
Releases 0 Wiki Activity
Issues 307 Pull Requests 0 Datasets Model Cloudbrain
Issues
/
Detail
Labels Milestones
New Issue

#1101 启智集群CPU/GPU资源是暂时用不了吗

Closed
created 1 year ago by pwkQiZhi · 11 comments
pwkQiZhi commented 1 year ago

问题描述

我新建的训练任务都无法跑起来，任务运行简况里显示：
[FailedScheduling]

all nodes are unavailable: 1 plugin NodeUnschedulable predicates failed node(s) were unschedulable, 10 node(s) selector fit queue failed, 26 node(s) resource fit failed.

相关环境（GPU/NPU）

相关集群（启智）

任务类型（训练）

任务名

testsourceisavilable

日志说明或问题截图

<!-- 为了更有效地识别与解决您的问题，请尽可能的补充如下信息 --> ### 问题描述 我新建的训练任务都无法跑起来，任务运行简况里显示： [FailedScheduling] all nodes are unavailable: 1 plugin NodeUnschedulable predicates failed node(s) were unschedulable, 10 node(s) selector fit queue failed, 26 node(s) resource fit failed. ### 相关环境（GPU/NPU） ### 相关集群（启智） ### 任务类型（训练） ### 任务名 testsourceisavilable ### 日志说明或问题截图
pwkQiZhi commented 1 year ago
Poster

状态也一直是WAITING,如果是资源不可用的话有公告吗

状态也一直是WAITING,如果是资源不可用的话有公告吗
liuzx commented 1 year ago
Owner

可以使用啊，换个镜像试试

可以使用啊，换个镜像试试
pwkQiZhi commented 1 year ago
Poster

好的，谢谢，我先试试

好的，谢谢，我先试试
zhj13898241553 commented 1 year ago

我也出现这个问题了，换个镜像也没有用

我也出现这个问题了，换个镜像也没有用
liuzx commented 1 year ago
Owner

是处于waiting状态吗，任务名叫什么

是处于waiting状态吗，任务名叫什么
zhj13898241553 commented 1 year ago

任务名：smoothl1_norm

任务名：smoothl1_norm
zhj13898241553 commented 1 year ago

真是受不了了，创建任务的时候显示第一名，然后就一直waiting，大概四到五个小时才能运行，然后新建一个任务又是这样。

真是受不了了，创建任务的时候显示第一名，然后就一直waiting，大概四到五个小时才能运行，然后新建一个任务又是这样。
liuzx commented 1 year ago
Owner

创建任务时显示第一是表示目前处于排队的第一位，也是需要等有卡空出来了才能开始训练。

创建任务时显示第一是表示目前处于排队的第一位，也是需要等有卡空出来了才能开始训练。
ZHANGBO_whut commented 1 year ago

请问下朋友们怎么解决的，我现在也遇到了这个问题，呜呜呜

请问下朋友们怎么解决的，我现在也遇到了这个问题，呜呜呜
liuzx commented 1 year ago
Owner

重试下看看，还有问题的话，请发下任务名

重试下看看，还有问题的话，请发下任务名
liuzx closed this issue 1 year ago
Sign in to join this conversation.
No Branch/Tag Specified
Clear branch or tag
Branches Tags
Labels
Apply labels
Clear labels
bug
Something is not working dataset
数据集已通过 duplicate
This issue or pull request already exists enhancement
New feature help wanted
Need some help invalid
Something is wrong need review question
More information is needed test wontfix
This won't be fixed 大神经验分享
被平台采纳的用户分享经验贴 开发中
正在开发进行中 待完善
项目待完善后可加分 待确认 评审中 趣开源
精选项目标签 面向社区开发者
No Label
bug
dataset
duplicate
enhancement
help wanted
invalid
need review
question
test
wontfix
大神经验分享
开发中
待完善
待确认
评审中
趣开源
面向社区开发者
Milestone
Set milestone
Clear milestone
No items
No Milestone
Assignees
Assign users
Clear assignees
No Assignees
4 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Write Preview
Loading…
Cancel
Save
There is no content yet.
Delete Branch '%!s(MISSING)'

Deleting a branch is permanent. It CANNOT be undone. Continue?

No
Yes
Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit