Since the RProp algorithm uses if/else conditional statements while determining update values some special helper matrix-functions and helper matrices must be introduced. These functions will allow us to express the conditional statements more elegantly, only using matrix operations. Some matrices needed to make the above functions work: D: decision matrix, M: meta-gradient matrix, U: update […]
I am only covering feedforward neural networks in this project. General features of such networks are: Neurons are grouped into one input layer, one or more hidden layers and an output layer. Neurons are not connecting to each other within the same layer. Each neuron of a hidden layer connects to all the neurons of […]
This post will try to give you a brief introduction to artificial neural networks or at least to some types of them. I will skip the introduction to biological neural networks as I am neither a biologist nor a doctor, I prefer not to write about what I do not fully understand. Overview of artificial […]
