#5 master

Merge branch 'master' into zlq-opt

update doc

Merge branch 'master' into zlq-opt

fix ascend testcases

Merge branch 'master' into zlq-opt

update moduledict/modulelist/parameterlist/parameterdict

Merge branch 'master' into zlq-opt

update supportlist

Merge branch 'master' into zlq-opt

update nn pad apis

updata review

update loss testcases

Merge branch 'master' into zlq-opt

update loss apis

Merge branch 'master' into zlq-opt

improve loss APIs

Merge branch 'master' into zlq

fix some testcases

Merge branch 'master' into zlq

add adapter auto_mixed_precision api

Merge branch 'master' into zlq

Merge branch 'master' into zlq

Merge branch 'master' into zlq

Merge branch 'master' into zlq

update loss testcase on Ascend

update code

Merge branch 'master' into zlq

update loss api

fix bug

fix bug

Merge branch 'master' into zlq

update

Merge branch 'master' into zlq

Merge branch 'master' into zlq

Merge branch 'master' into zlq

fix bug

Merge branch 'master' of https://openi.pcl.ac.cn/OpenI/MSAdapter into zlq

update ms2.0 new change

Merge branch 'master' into zlq

update tensor&parameter

Merge branch 'master' into zlq

fix bug

fix bug

add tensor.__format__

fix bug

Merge branch 'master' into zlq

fix parametr bug

fix bug

fix bug

fix register

Co-authored-by: zlq2020 <zouliqin@huawei.com>
Reviewed-on: OpenI/MSAdapter#657

Fixed Tensor.max, Tensor.min, torch.zeros, Tensor.new_zeros

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#650

fix format

update code

Merge remote-tracking branch 'upstream/master' into lrscheduler

update some code

update supportlist

update supportlist_en

update supportlist

update supportlist

update supporlist

update supportlist

update code

update supportlist

update supporlist

update supportlist

update supportlist

update supportlist

update supportlist

update supporlist

update supporlist

add supportlist

fix pylint

update testcase

add testcase

add new lrscheduler

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#653

update readme

Merge remote-tracking branch 'upstream/master' into fix-testcase

fix somethings

suit to 0810 mindspore

fix somethings

fix more testcase

update testcase

fix sometestcase

fix matmul testcase on Ascend

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#656

更新 '.drone.yml'

Reviewed-on: OpenI/MSAdapter#658

update testcase

fix metadata.version

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#655

comment out

fix testcase comments

add testcases for higher-dimension empty indices

fix index_put

Co-authored-by: lzh <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#652

add is quantized

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#654

Merge branch 'master' into dev0731

Add cond

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#639

for new comments

for new comments

for new comments

for new comments

for new comments

for new comments

for new comments

for replying comments

for replying comments

test git

modify USER_GUIDE.md file

modify USER_GUIDE.md file

modify USER_GUIDE.md file

modify USER_GUIDE.md file

modify USER_GUIDE.md file

modify USER_GUIDE.md file

modify USER_GUIDE.md file

Co-authored-by: ziqi-jin <ziqijincoder@gmail.com>
Reviewed-on: OpenI/MSAdapter#647

fix put_

fix pylinnt

fix diag

fix diag

fix diag

fix diag

fix diag

fix diag

fix scatter_add

fix put_

fix put_

split test_mul1

skip ascend for mul and index_put

fix inner_int(64) index_add

Co-authored-by: lzh <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#646

modify tensor.data new_fill

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#649

add comment for bwk hook

add test for modifying module in fwd hook

fix testcases

fix testcases

fix testcases

fix testcases

fix testcases

fix testcases

override run fwd hook

not override register forward hook in adapter

adapter forward pre hook

fix forward hook basic testcase

add basic forward hook testcases

modify and add backward testcase

register func and basic testcases

Co-authored-by: lzh <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#626

fix some comment

update code

update LambdaLR statedict

update code

remove debug msg

fix pylint

update optimzer

update step func

add jit testcase

update code

update load and save

add testcase

add statedict test

update testcase

add lr_scheduler

add LinearLR

update testcase

add ConstantLR

Merge remote-tracking branch 'refs/remotes/upstream/master' into lrscheduler

update code

update testcase

update get_lr

update code and testcase

add lr_scheduler

Merge remote-tracking branch 'refs/remotes/upstream/master' into lrscheduler

add lrscheduler

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#640

fix randn/interpolate/__matmul__

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#648

add testcase

fix pylint

update code

fix instancenorm load

update testcase

update batchnorm load_from

update module.load

fix testcase

add testcase

fix module load buffer

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#643

update format.

update supportlist

update supportlist

update testcase

update _enable=False

Merge remote-tracking branch 'refs/remotes/upstream/master' into gradscaler

fix testcase

add _growth_tracker

update testcase

update testcase

update scaler update

update testcase

update testcase

fix setstate

update code

update code

update testcase

update check_inf

update _per_optimizer_states

update optimizer_state

fix pylint

update optimizer state

update code

add statedict

update init

update testcast

update api

skip testcase

update code

add GradScalar

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#631

Merge branch 'fix_load' of https://openi.pcl.ac.cn/OpenI/MSAdapter into fix_load

fix pylint

Merge branch 'master' into fix_load

fix load and torchvision/models

Co-authored-by: hanjr92 <jiaronghan@outlook.com>
Reviewed-on: OpenI/MSAdapter#644

Fixed normal_ and random_

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#603

Fixed failed cases on GPU and Ascend

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#638

Add triangular_solve, cross

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#634

fix dataloader multi index

Merge branch 'master' into fix_dataloader_test

fix dataloader test

Co-authored-by: hanjr92 <jiaronghan@outlook.com>
Reviewed-on: OpenI/MSAdapter#642

update doc

update supportlist

update doc

Merge remote-tracking branch 'refs/remotes/upstream/master' into pijit

update doc

update jocabian testcase

fix pylint

update some code

update inference-mode testcase

update inference mode

update graph constrain for is_grad_enabled

add is_grad_enabled()

Merge remote-tracking branch 'upstream/master' into pijit

fix pylint

update some code

add tensor.grad

update testcase

update jacobian 2 output testcase

update testcase

add jocabian testcase

update testcase

update init

update init

fix pylint

skip testcase

add jvp

update set_grad_enabled

update vjp

Merge remote-tracking branch 'upstream/master' into pijit

add somethings

update jacobian

add setgradenable

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#620

Merge branch 'master' into erpim0731

modify default num_workers

Co-authored-by: hanjr <hanjr@pcl.ac.cn>
Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#636

fix dataloader test

Co-authored-by: hanjr92 <jiaronghan@outlook.com>
Reviewed-on: OpenI/MSAdapter#641

update

revert testcase

update optimizer

fix import

add error msg

update

update

fix optimizer ms_state_dict

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#632

add package convert tool

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#633

add num_batches_tracked

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#637

Add ormqr, matrix_rank

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#628

update TensorDataset

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#630

Merge branch 'master' into dev0720

Add promote_types, frexp

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#619

update compose

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#629

Merge branch 'master' into dev0725

Add cholesky_ex, inv_ex, matrix_norm

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#624

update readme

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#625

update readme

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#627

update readme

Co-authored-by: hanjr92 <jiaronghan@outlook.com>
Reviewed-on: OpenI/MSAdapter#623

Fixed TypeError testcases on Ascend

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#605

Add narrow_copy, cholesky_solve

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#618

fix review issue

fix pylint

skip testcases for gpu and ascend

fix arange

update supportlist

use Median

use ms new api

fix typo and uncomment testcases

resolve conflict

add comment

fix pylint

comment out testcases

replace with existing apis(draft)

nanmedian

Co-authored-by: liuzehui2023 <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#537

update _infer_size

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#617

add bool type attn mask

Co-authored-by: liuzehui2023 <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#612

Merge remote-tracking branch 'upstream/master' into master-fix-ascend-testcase

add something

Merge remote-tracking branch 'upstream/master' into master-fix-ascend-testcase

update testcase

update testcase

update testcase

update supportlist

Merge remote-tracking branch 'upstream/master' into master-fix-ascend-testcase

update testcase

update pdist

update atol

Merge remote-tracking branch 'upstream/master' into master-fix-ascend-testcase

update testcase

update test_constant_pad_2d_4d_padding

update testcase

update testcase

update valueerror

fix pylint

update testcase

update testcase

update testcase

update testcase

update xlogy testcase

update logdet testcase

update conv testcase

update truedivide

update floor divide

update true divide

fix rsqrt testcase

update fmod

fix floor divide

fix topk testcase on ascend

fix fmod nan on Ascend

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#611

fix review issue for mm

improve inner and mm

fix inner and mm int input bug

fix scatter_add_ testcase for ascend

fix scatter_add errors for ascend

skip -inf testcase for scatter_reduce_amax on ascend

fix typo

skip scatter_nd_mul for ascend

delete wrongly added file

fix scatter_reduce bug

use scatter_nd for scatter_add on ascend

used scatter_(nd_)add for ascend env

skip concat fp64 on ascend

update inner constraintlist

fix inner bug

fix inner mm

skip inf test for sum on gpu

fix scatter_reduce expand error

Co-authored-by: liuzehui2023 <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#599

Merge branch 'master' into dev0711

Fixed runtime errors

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#615

update testcase

solve runtime error testcase on ascend

update testcase

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#614

fix dropout bug

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#616

Merge branch 'master' into dev0629

Merge branch 'master' into dev0629

Fixed torch funcs

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#593

update module parameter_and_names

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#613

delete useless optim

fix pylint

Merge remote-tracking branch 'refs/remotes/upstream/master' into master-adapte-optimizer

Merge remote-tracking branch 'refs/remotes/upstream/master' into master-adapte-optimizer

update testcase

update lr to parameters

update testcase

add statedict for adam and adamw

update statedict

add some testcase

add adam and adamw

update adam adamw

change testcase

change init

add some code

add sgd

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#594

add no_grad

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#601

Merge branch 'master' into LoadAndSave

Merge branch 'master' into LoadAndSave

fix pylint

fix pylint

fix pylint

remove from_torch in load

Merge branch 'master' into LoadAndSave

fix load

Merge branch 'master' into LoadAndSave

fix pylint

fix pylint

fix pylint

fix pylint

fix pylint

refactor save and load

Co-authored-by: Erpim <erpim@noreply.localhost>
Co-authored-by: hanjr92 <jiaronghan@outlook.com>
Reviewed-on: OpenI/MSAdapter#590

Skip test_normal_ on 2.1

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#608

Merge remote-tracking branch 'refs/remotes/upstream/master' into master-fix-pad

update nn.Pad

Merge remote-tracking branch 'refs/remotes/upstream/master' into master-fix-pad

update something

update support list

update supportlist

adapte

do some adaption

use ms.ops.pad

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#604

Fixed testcases on 2.1

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#598

更新 '.drone.yml'

Reviewed-on: OpenI/MSAdapter#606

update new_full/new_zeros

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#596

fix SELU CELU supportlist errors

remove key-value assignment constraint in the list

use param_compare in normalize

use param_compare in one_ht

use param_compare in pdist

add grid_sample positional args testcase

improve grid_sample and testcases

nn init funcs testcases improvement

update supportlist

improve celu selu gelu for cpu

Co-authored-by: liuzehui2023 <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#592

update flip/matmul

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#597

fix gpu test

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#600

fix some format

Merge remote-tracking branch 'upstream/master' into master-fix-rnn

update supporlist

do some adjustment

use check_forward_args

fix pylint

add comment

use lower-case ops

add _get_sequence_output

update testcase

optimize code

def _get_hx

optimize lstm code

optimize some code

optimize code

optimizer rnn_base code

fix some ops

change testcase

update testcase on ascend

update testcase

update testcase

change gru testcase hidden size to 16 for ascend

add some func

fix some pad sequence code

fix pylint

fix graph mode lstm

add proj_size for lstm

optimize rnn

add pad sequence for lstm

add testcase

add allclose for gru testcase

fix lstm testcase

add allclose testcase for rnn

fix

skip testcase graph mode

add support bidirectional=True

imporve performance

add support of pad sequence

add pad_sequence for rnn

Co-authored-by: lvhaoyu <lvhaoyu@huawei.com>
Reviewed-on: OpenI/MSAdapter#586

更新 'README.md'

Reviewed-on: OpenI/MSAdapter#589

fix review issue

add validity check in logspace, improve _get_max_prec

fix logspace bug

fix review issues

remove empty lines

improve _get_max_prec_and_mask_list

fix typo

add get highest precision dtype func

update constraintlist for logspace

delete unnecessary func

add torch.ones and torch.zeros testcases

row_stack vstack

add comment for stack and cat-related APIs

update torch.eye

add different types in cat/concat testcases

comment out logspace for GPU

change logspace comment

use type_shape_comp for empty

improve arange on cpu

equal_nan

replace all assert with param_compare

Co-authored-by: liuzehui2023 <liuzehui3@huawei.com>
Reviewed-on: OpenI/MSAdapter#585

update istesnor

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#588

Fixed histc on GPU

Co-authored-by: Zhuoranbupt <929623751@qq.com>
Reviewed-on: OpenI/MSAdapter#587

update gelu/mish/linear/bilinear/distance

Co-authored-by: Erpim <dengyepeng@huawei.com>
Reviewed-on: OpenI/MSAdapter#582