#21 数据集去哪里下载?有没有测试的数据集呢?

Closed
created 1 year ago by gg22mm · 1 comments
gg22mm commented 1 year ago
``` from pcl_pangu.context import set_context from pcl_pangu.dataset import txt2mindrecord from pcl_pangu.model import alpha, evolution, mPangu # set_context(backend='mindspore') # data_path = 'path/of/training/dataset' # txt2mindrecord(input_glob='your/txt/path/*.txt', output_prefix=data_path) # config = alpha.model_config_npu(model='350M', # load='./weigth', # data_path=data_path) # alpha.train(config) set_context(backend='mindspore') inputData = './dataset/NLPCC2014_SC_mindrecord' txt2mindrecord(input_glob=inputData, output_prefix='./output') config = alpha.model_config_npu(model='350M', load='./weigth', data_path=data_path) alpha.train(config) ``` 数据集去哪里下载?有没有测试的数据集呢? path/of/training/dataset input_glob='your/txt/path/*.txt 这两个从哪里来?
gg22mm commented 1 year ago
Poster
找到了,好象这里有:https://openi.pcl.ac.cn/ZicongDu/SDK_pangu/datasets?page=2
gg22mm started working 1 year ago
gg22mm cancelled time tracking 1 year ago
gg22mm closed this issue 1 year ago
Sign in to join this conversation.
No Milestone
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.