5,337
edits
Debugging ML Models: Difference between revisions
→NaNs and Infs
| Line 55: | Line 55: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Typically, you | Typically, you get Infs and NaNs when there is an division by ~0 in the forward or backward pass. | ||
However it is also possible that the learning rate is too high or your model is broken. | However it is also possible that the learning rate is too high or your model is broken. | ||
I typically debug by: | I typically debug by: | ||