panshaowu merged pull request OpenI/MSAdapter#992

临时修复vllm兼容性问题

1 month ago

panshaowu created pull request OpenI/MSAdapter#992

1 month ago

panshaowu created repository panshaowu/MSAdapter

1 month ago

panshaowu created repository panshaowu/llama

8 months ago

panshaowu commented on pull request OpenI/MSAdapter#621

已达成一致

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

因为MSAdapter需要适配GPU和Ascend，torch仅支持GPU所以只有is_nccl_available ，对应的Ascend接口是hccl，所以新开了一个API is_hccl_available。建议修改“Torch没有这个函数”措辞，说明上述原因。

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

scatter 暂时无法支持，培晨过几天会新增这个通信算子，过段时间补上这个功能。 gather 已添加 train 父类已有这个函数

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

已修改

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

已修改

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

已修改

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

已修改

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

有可能在DDP后面才设置pynative或graph模式。给个INFO日志好了。

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

不需要

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

torch只销毁进程组，MindSpore调用releadse就把整个分布式资源释放了。

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

已修改

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

理论上和torch的功能、调用逻辑一致，注释也就是把torch的文档搬过来。如果某些功能没有被覆盖，已统一在ConstraintList中说明。

1 year ago

panshaowu commented on pull request OpenI/MSAdapter#621

后续计划在进程组内部初始化通信算子类，其他模块只需要构造进程组类并调用方法，而不要每次调用通信算子时都传进程组。当前用到的通信算子较少，还没有用这些方法。

1 year ago