5,337
edits
Line 1,877: | Line 1,877: | ||
===Recurrent Neural Networks (RNNs)=== | ===Recurrent Neural Networks (RNNs)=== | ||
Hidden state: <math>h_t = \tanh(W_{hh} h_{t-1} + W_{xh} x_t)</math> | Hidden state: <math>h_t = \tanh(W_{hh} h_{t-1} + W_{xh} x_t)</math> | ||
Prediction at t: <math>y_t = W h_{t}</math> | Prediction at t: <math>y_t = W h_{t}</math> | ||