lzh
  • Joined on Jan 06, 2023
Loading Heatmap…

lzh commented on pull request OpenI/MSAdapter#419

nn.MultiheadAttention

补充了nn/test_multihead_attention.py里的用例

1 day ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

1 day ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

1 day ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

  • 70b8e84dcc set all add_key_padding_mask to False and add comment

1 day ago

lzh commented on pull request OpenI/MSAdapter#426

changes to Tensor.sum

tensor([-1,1]),sum(dtype=bool)的情况,torch会把-1和1当作bool型处理,结果为True。ms.ops.sum不能处理bool型,如果先转换为int型,-1和1的sum为0,结果会返回False,所以需要先转换成bool再转int。

1 day ago

lzh commented on pull request OpenI/MSAdapter#426

changes to Tensor.sum

已修改

1 day ago

lzh pushed to lzh_sum at OpenI/MSAdapter

  • 297247f5e0 fix bug when dtype==bool
  • a9d3851508 fix review issue
  • d008ee9c8f minor changes
  • cf952cf887 add bool condition
  • 2d06953cd9 adapt some ops for ascend (#425) do some change optim i0 adapt i0 adapt svd use from_numpy adapt fmax and fmin Co-authored-by: lvhaoyu <lvhaoyu@huawei.com> Reviewed-on: https://openi.pcl.ac.cn/OpenI/MSAdapter/pulls/425
  • Compare 8 commits »

1 day ago

lzh commented on pull request OpenI/MSAdapter#426

changes to Tensor.sum

test

1 day ago

lzh pushed to lzh_sum at OpenI/MSAdapter

1 day ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

1 day ago

lzh created pull request OpenI/MSAdapter#426

changes to Tensor.sum

1 day ago

lzh pushed to lzh_sum at OpenI/MSAdapter

1 day ago

lzh pushed to lzh_sum at OpenI/MSAdapter

1 day ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

2 days ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

2 days ago

lzh commented on pull request OpenI/MSAdapter#419

nn.MultiheadAttention

已修改

2 days ago

lzh commented on pull request OpenI/MSAdapter#419

nn.MultiheadAttention

已修改

2 days ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

3 days ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

  • 74507bd812 set mode to pynative in testcases and minor changes

3 days ago

lzh pushed to lzh_multihead at OpenI/MSAdapter

3 days ago