Deleting a branch is permanent. It CANNOT be undone. Continue?
No due date set.
This issue currently doesn't have any dependencies.
Deleting a branch is permanent. It CANNOT be undone. Continue?
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》
hf_model分支已更新代码
4.9到4.10,迁移大模型时,发现迁移服务暂停迁移2次
经排查,发现如下问题:
1、服务未暂停,重新发送文件迁移请求也能继续迁移
2、hf sdk以及下载文件请求存在内存泄漏问题,导致下载进程卡死
解决方案,对迁移服务做如下修改:
1、将下载请求的读取rate改成了1mb,之前是5mb
2、hf sdk存在内存泄漏,替换成requests库
3、开启新的下载请求时时强行回收垃圾内存
4.10 上午改一版迁移服务的代码,解决了迁移服务内存泄漏的问题,继续迁移大文件。但是下午大文件迁移似乎又停住了,并发5个文件,目前只剩一个文件以几百K的速度在下载
4.12更新:发现是数据源不稳定造成的连接中文件流传输中断,目前能捕捉到这个错误并且关闭线程,不会影响到服务状态以及后续等待排队的迁移文件。