Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
You can not select more than 25 topics
Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Adriana Romero
0f633b1bbe
|
9 years ago | |
|---|---|---|
| costs | 9 years ago | |
| extensions | 9 years ago | |
| scripts | 9 years ago | |
| yaml | 9 years ago | |
| .gitignore | 9 years ago | |
| README.md | 9 years ago | |
| __init__.py | 9 years ago | |
README.md
FitNets
FitNets: Hints for Thin Deep Nets
http://arxiv.org/abs/1412.6550
-
To run FitNets stage-wise training:
THEANO_FLAGS="device=gpu,floatX=float32,optimizer_including=cudnn" python fitnets_training.py fitnet_yaml regressor -he hints_epochs -lrs lr_scale- fitnet_yaml: path to the FitNet yaml file,
- regressor: regressor type, either convolutional (conv) or fully-connected (fc),
- Optional argument -he hints_epochs: int - number of epochs to train the 1st stage. It is set to None by default. Leave as None when using the validation set to determine the number of epochs. Set to X when using the whole training set.
- Optional argument -lrs lr_scale: float - learning rate scaler to be applied to the pre-trained layers at the 2nd stage.