关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
crj1998
/
MoCo
Not watched
1
1
Fork 0
Code
Releases 0 Wiki Activity
Issues 2 Pull Requests 0 Datasets Model Cloudbrain
Issues
/
Detail
Labels Milestones
New Issue

#1 baseline for CIFAR10

Open
created 1 year ago by crj1998 · 1 comments
crj1998 commented 1 year ago

MoCo baseline for CIFAR10

Benchmark

cifar10
resnet50

# MoCo baseline for CIFAR10 ## Benchmark cifar10 resnet50
crj1998 commented 1 year ago
Owner

Tips for reproduce code.

  1. Use BatchNorm in projection head.
  2. REMEMBER use Normalize on output embed_dim.
  3. Adam is better.
  4. Pay attention to transform. RandomCropResize hurt performance.

Tips for train from scratch.

  1. long traning epochs.
## Tips for reproduce code. 1. Use `BatchNorm` in projection head. 2. REMEMBER use `Normalize` on output embed_dim. 3. Adam is better. 4. Pay attention to transform. RandomCropResize hurt performance. ## Tips for train from scratch. 1. long traning epochs.
Sign in to join this conversation.
No Branch/Tag Specified
Clear branch or tag
Branches Tags
Labels
Apply labels
Clear labels
bug
Something is not working duplicate
This issue or pull request already exists enhancement
New feature help wanted
Need some help invalid
Something is wrong question
More information is needed wontfix
This won't be fixed
No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Set milestone
Clear milestone
No items
No Milestone
Assignees
Assign users
Clear assignees
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Write Preview
Loading…
Cancel
Save
There is no content yet.
Delete Branch '%!s(MISSING)'

Deleting a branch is permanent. It CANNOT be undone. Continue?

No
Yes
Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit