Neural Networks Basics

Neural Networks Learning The Basics: The Playground

by Samantha Van Der MerweLeave a Comment on Neural Networks Learning The Basics: The Playground
Neural Networks Learning The Basics: The Playground

If you have any interest in the field of machine learning and artificial intelligence (AI), then you must have come across neural networks. I like to think of a neural network as a computer program that learns how to accomplish specific tasks with the help of lots and lots of data. Probably a very common [...]

Neural Networks Basics

Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent

by Samantha Van Der MerweLeave a Comment on Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent
Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent

Overview In the previous post we looked at backpropagation. In the example we calculated the gradient of the loss with respect to each weight parameter. The gradient determined which direction to move the weight parameter and how much to move it by. The new weight parameter was then updated using the formula below: $latex w_{new} [...]

Uncategorized

Neural Networks Learning The Basics: Backpropagation

by Samantha Van Der Merwe2 Comments on Neural Networks Learning The Basics: Backpropagation
Neural Networks Learning The Basics: Backpropagation

In this post I will go through a simple backpropagation algorithm that I have implemented on a spreadsheet. It is simple as I will use one training example with two input features to explain the concept. For example: A single training example In the above we have a single observation with two input variables x1 [...]

Neural Networks Basics

Neural Networks Learning The Basics : Layers, Activation

by Samantha Van Der MerweLeave a Comment on Neural Networks Learning The Basics : Layers, Activation
Neural Networks Learning The Basics : Layers, Activation

This post continues from neural network basics part 1: Layers Matrix Multiplication. This post therefore assumes that you have basic knowledge on what a neuron is. Why Add an Activation Function? In neural network basics part 1: Layers Matrix Multiplication I covered matrix multiplication and defined a simple neural network as the weighted sum of inputs with the equation: [...]

Neural Networks Basics

Neural Networks Learning The Basics : Layers, Matrix Multiplication

by Samantha Van Der MerweLeave a Comment on Neural Networks Learning The Basics : Layers, Matrix Multiplication
Neural Networks Learning The Basics : Layers, Matrix Multiplication

This blog post takes a close look at the first fundamental concept of a neural network that I introduced briefly in my previous post. The layers. Layers are the building blocks of a neural network and contain the network’s knowledge. In order to achieve our goal one needs to first understand what a neural network [...]