## Neural Networks Learning The Basics: The Playground If you have any interest in the field of machine learning and artificial intelligence (AI), then you must have come across neural networks. I like to think of a neural network as a computer program that learns how to accomplish specific tasks with the help of lots and lots of data. Probably a very common [...]

## Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent Overview In the previous post we looked at backpropagation. In the example we calculated the gradient of the loss with respect to each weight parameter. The gradient determined which direction to move the weight parameter and how much to move it by. The new weight parameter was then updated using the formula below: \$latex w_{new} [...]

## Neural Networks Learning The Basics : Layers, Activation This post continues from neural network basics part 1: Layers Matrix Multiplication. This post therefore assumes that you have basic knowledge on what a neuron is. Why Add an Activation Function? In neural network basics part 1: Layers Matrix Multiplication I covered matrix multiplication and defined a simple neural network as the weighted sum of inputs with the equation: [...]

## Neural Networks Learning The Basics : Layers, Matrix Multiplication This blog post takes a close look at the first fundamental concept of a neural network that I introduced briefly in my previous post. The layers. Layers are the building blocks of a neural network and contain the network’s knowledge. In order to achieve our goal one needs to first understand what a neural network [...]

## Neural Networks Learning the Basics Part 0 This is the first blog post in my neural network series and primarily serves as an intro. I aim to use this neural network series as a means of explaining fundamental concepts (as well as I know them) and how they have helped me build better models. This will be not only from an academic [...]