Neural Networks Learning The Basics: The Playground

Neural Networks Learning The Basics: The Playground

If you have any interest in the field of machine learning and artificial intelligence (AI), then you must have come across neural networks. I like to think of a neural network as a computer program that learns how to accomplish specific tasks with the help of lots and lots of data. Probably a very common [...]

Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent

Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent

Overview In the previous post we looked at backpropagation. In the example we calculated the gradient of the loss with respect to each weight parameter. The gradient determined which direction to move the weight parameter and how much to move it by. The new weight parameter was then updated using the formula below: $latex w_{new} [...]

Neural Networks Learning The Basics: Backpropagation

Neural Networks Learning The Basics: Backpropagation

In this post I will go through a simple backpropagation algorithm that I have implemented on a spreadsheet. It is simple as I will use one training example with two input features to explain the concept. For example: A single training example In the above we have a single observation with two input variables x1 [...]