Not All Layers Are Equal: A Layer-Wise Adaptive Approach Toward Large-Scale DNN Training

Keyphrases

• Adaptive Approach 100%
• Deep Neural Network Training 100%
• Batch Size 80%
• Scaling Method 60%
• Learning Rate 60%
• Fewer Iterations 60%
• Quality Model 60%
• Comprehensive Evaluation 20%
• State-of-the-art Techniques 20%
• Overall Modeling 20%
• Targeting Accuracy 20%
• Existing State 20%
• Deep Neural Network 20%
• Art Learning 20%
• Quality Degradation 20%
• Worker Training 20%
• Data Parallelism 20%
• General Learning 20%

Computer Science

• Deep Neural Network 100%
• Neural Network Training 100%
• Learning Rate 100%
• quality model 42%
• Neural Network Model 14%
• Data Parallelism 14%