Recurrent Neural Networks

Lets start with a game :) Just try one of the values, and notice how the network can "count".

Now we will teach the network to count by propagating the fire from the dragon all the way through. Notice how + distributes the fire, and how * routes it.

This is a short refresher on derivatives and the rules of the game:

Another way to think of how changes in the input affect the output:

[ WORK IN PROGRESS ]