#859 ImportError: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/torch/lib/../../torch.libs/libgomp-6e1a1d1b.so.1.0.0: cannot allocate memory in static TLS block

Closed
created 3 months ago by zzc0208 · 3 comments
zzc0208 commented 3 months ago
https://openi.pcl.ac.cn/zzc0208/so-vits-svc-npu/src/branch/feat-loguru-4.1-stable/1_preprocess_soft.py 使用的git仓库master分支安装的mindtorch ```shell (MindSpore) [root@b7c53c8b8d524f1d8767ba54e1755a5e-task0-0 so-vits-svc-npu]# python 1_preprocess_soft.py /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/faiss/loader.py:28: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. if LooseVersion(numpy.__version__) >= "1.19": /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/setuptools/_distutils/version.py:345: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. other = LooseVersion(other) /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/jupyter_client/connect.py:22: DeprecationWarning: Jupyter is migrating its paths to use standard platformdirs given by the platformdirs library. To remove this warning and see the appropriate new directories, set the environment variable `JUPYTER_PLATFORM_DIRS=1` and then run `jupyter --paths`. The use of platformdirs will be the default in `jupyter_core` v6 from jupyter_core.paths import jupyter_data_dir, jupyter_runtime_dir, secure_write /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/faiss/loader.py:28: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. if LooseVersion(numpy.__version__) >= "1.19": /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/setuptools/_distutils/version.py:345: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. other = LooseVersion(other) /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/jupyter_client/connect.py:22: DeprecationWarning: Jupyter is migrating its paths to use standard platformdirs given by the platformdirs library. To remove this warning and see the appropriate new directories, set the environment variable `JUPYTER_PLATFORM_DIRS=1` and then run `jupyter --paths`. The use of platformdirs will be the default in `jupyter_core` v6 from jupyter_core.paths import jupyter_data_dir, jupyter_runtime_dir, secure_write concurrent.futures.process._RemoteTraceback: """ Traceback (most recent call last): File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/concurrent/futures/process.py", line 246, in _process_worker r = call_item.fn(*call_item.args, **call_item.kwargs) File "/home/ma-user/so-vits-svc-npu/1_preprocess_soft.py", line 18, in process_batch hmodel = utils.get_speech_encoder(speech_encoder, device=device) File "/home/ma-user/so-vits-svc-npu/utils.py", line 113, in get_speech_encoder from vencoder.ContentVec768L12 import ContentVec768L12 File "/home/ma-user/so-vits-svc-npu/vencoder/ContentVec768L12.py", line 2, in <module> from fairseq import checkpoint_utils File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/fairseq/__init__.py", line 20, in <module> from fairseq.distributed import utils as distributed_utils File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/fairseq/distributed/__init__.py", line 6, in <module> from .distributed_timeout_wrapper import DistributedTimeoutWrapper File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/fairseq/distributed/distributed_timeout_wrapper.py", line 11, in <module> from torch import nn File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/torch/__init__.py", line 235, in <module> from torch._C import * # noqa: F403 ImportError: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/torch/lib/../../torch.libs/libgomp-6e1a1d1b.so.1.0.0: cannot allocate memory in static TLS block """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/ma-user/so-vits-svc-npu/1_preprocess_soft.py", line 52, in <module> parallel_process(filenames, num_processes) File "/home/ma-user/so-vits-svc-npu/1_preprocess_soft.py", line 36, in parallel_process task.result() File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/concurrent/futures/_base.py", line 446, in result return self.__get_result() File "/home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/concurrent/futures/_base.py", line 391, in __get_result raise self._exception ImportError: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.9/site-packages/torch/lib/../../torch.libs/libgomp-6e1a1d1b.so.1.0.0: cannot allocate memory in static TLS block (MindSpore) [root@b7c53c8b8d524f1d8767ba54e1755a5e-task0-0 so-vits-svc-npu]# ```
laich commented 3 months ago
Collaborator
需要检查一下fairseq包,它基于pytorch,调用到了镜像里面的torch
zzc0208 commented 3 months ago
Poster
好的,感谢
zzc0208 closed this issue 3 months ago
hanjr commented 3 months ago
Collaborator
解决方案可参考https://openi.pcl.ac.cn/OpenI/MSAdapter/issues/868#issuecomment-274092
Sign in to join this conversation.
No Label
No Milestone
No Assignees
3 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.