More Related Content
More from Preferred Networks (20)
Optuna: A Define-by-Run Hyperparameter Optimization Framework
- 4. https://bit.ly/t3-optuna
Hyperparameter Tuning
First, I want to try
this:
• LR: 0.1
• Dropout: 0.5
… Done!
Accuracy: 0.6
Trial 1
Then, How about
this?:
• LR: 0.01
• Dropout: 0.0
… Done!
Accuracy: 0.5
Trial 2
So, I want to try
this:
• LR: 0.05
• Dropout: 0.3
… Done!
Accuracy: 0.8
Trial 3
4
- 5. https://bit.ly/t3-optuna
Hyperparameter Tuning
First, I want to try
this:
• LR: 0.1
• Dropout: 0.5
… Done!
Accuracy: 0.6
Trial 1
Then, How about
this?:
• LR: 0.01
• Dropout: 0.0
… Done!
Accuracy: 0.5
Trial 2
So, I want to try
this:
• LR: 0.05
• Dropout: 0.3
… Done!
Accuracy: 0.8
Trial 3
5