PCL-陶恒韬 taoht
Loading Heatmap…

taoht commented on issue PCL-Platform.Inte.../mPanGu-Alpha-53#11

GPU方式训练保存的8份checkpoint如何合并然后进行模型推理

1、分布式加载8片模型参数 pangu_alpha = PanguAlphaModel(config) eval_net = EvalNet(pangu_alpha, pad_token=args_opt.padding_id) eval_net.set_train(False) model_predict = Model(eval_net) load_distributed_checkpoint(eval_net, ckpt_file_list, predict_layout) 2、整合保存成单个模型文件 save_checkpoint(pangu_alpha, "/path/to/mPanGu_integrated.ckpt", integrated_save=True)

1 month ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

2 months ago

taoht closed issue PCL-Platform.Inte.../mPanGu-Alpha-53#7

使用lo_mn的模型推理速度较慢

2 months ago

taoht commented on issue PCL-Platform.Inte.../mPanGu-Alpha-53#7

使用lo_mn的模型推理速度较慢

推理时需配置参数: use_past=true use_pynative_op=1

2 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

6 months ago

taoht pushed to master at PCL-Platform.Inte.../mPanGu-Alpha-53

6 months ago

taoht closed issue PCL-Platform.Inte.../mPanGu-Alpha-53#3

GPU 分布式推理报错

6 months ago

taoht closed issue PCL-Platform.Inte.../mPanGu-Alpha-53#4

lo->zh 翻译不达标

6 months ago

taoht pushed to npu at PCL-Platform.Inte.../mPanGu-Alpha-53

6 months ago

taoht pushed to gpu at PCL-Platform.Inte.../mPanGu-Alpha-53

6 months ago

taoht upload dataset mPanGu_Alpha-53_mn-lo.ckpt

6 months ago