Debugging ML Models: Difference between revisions

No edit summary
Tags: Mobile edit Mobile web edit
 
Line 26: Line 26:


==Overfitting==
==Overfitting==
Overfitting occurs when your training loss is below your validation loss.   
Overfitting occurs when your model begins learning attributes specific to your training data, causing your validation loss to increase.   
Historically this was a big concern for ML models and people relied heavily on regularization to address overfitting.   
Historically this was a big concern for ML models and people relied heavily on regularization to address overfitting.   
Recently though, overfitting has become less of a concern with larger ML models.
Recently though, overfitting has become less of a concern with larger ML models.