You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
lzqoscar
3cc6379f65
|
4 months ago | |
|---|---|---|
| mindcv | 4 months ago | |
| README.md | 4 months ago | |
| TUMD_b_16_224_finetune_ascend.yaml | 4 months ago | |
| TUMD_b_16_224_pretrain_ascend.yaml | 4 months ago | |
| TUMD_finetune.py | 4 months ago | |
| TUMD_pretrain.py | 4 months ago | |
| attn_dist.jpg | 4 months ago | |
| config.py | 4 months ago | |
| pretrain_loss.jpg | 4 months ago | |
| pretrain_loss2.jpg | 4 months ago | |
| visualize.py | 4 months ago | |
README.md
Mindspore Implementation of the paper TOWARDS UNDERSTANDING MASKED DISTILLATION
Our code is based on mindcv. Installation and preparation follow that repo.
Pretrain
python pretrain.py -c TUMD_b_16_224_pretrain_ascend.yaml
Finetune
python pretrain.py -c TUMD_b_16_224_finetune_ascend.yaml
Attention Distance
Loss log for pretrain
