Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
YangLuo f596057871 | 1 year ago | |
---|---|---|
.. | ||
docs | 1 year ago | |
meetings | 3 years ago | |
README.md | 1 year ago | |
README_en.md | 1 year ago | |
sig-info.yaml | 1 year ago |
数据SIG(DATA SIG) 聚焦于MindSpore框架中的数据处理模块,致力于为MindSpore提供更丰富、灵活、易用的数据操作能力,方便用户随心所欲“把玩”手中的数据,并接入到MindSpore中进行训练。
数据处理模块:支持更多业界基准数据集一键读取,支持业界常用的、最新的数据预处理操作。主要负责将用户的数据高效读取到MindSpore框架,然后执行相关的数据增强操作(调整大小、旋转、混洗、批处理...),最终将数据集提供给训练过程。
数据格式模块:支持聚合存储、高效读取的数据格式MindRecord,实现数据统一存储、访问,使得训练时数据读取更加快速。同时MindRecord支持灵活控制数据切分和高效索引,可以支持超大规模的分布式训练场景。
SIG的成员身份包括Members、Contributors、Maintainers,各角色的描述和申请条件如下:
2021 MindSpore Data SIG Meeting
MindSpore community
Markdown Python Jupyter Notebook Text Diff other
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》