Data Science is currently marketed as a skill/career that anyone can learn. If you can write code you can become a Data Scientist. Ok, that is an argument for another day. However, because of this marketing and hype surrounding AI (Artificial Intelligence ), it is no surprise that I have crossed paths with Data Scientists [...]

# Author: Samantha Van Der Merwe

## Neural Networks Learning The Basics: The Playground

If you have any interest in the field of machine learning and artificial intelligence (AI), then you must have come across neural networks. I like to think of a neural network as a computer program that learns how to accomplish specific tasks with the help of lots and lots of data. Probably a very common [...]

## Neural Networks Learning The Basics: Gradient Descent and Stochastic Gradient Descent

Overview In the previous post we looked at backpropagation. In the example we calculated the gradient of the loss with respect to each weight parameter. The gradient determined which direction to move the weight parameter and how much to move it by. The new weight parameter was then updated using the formula below: $latex w_{new} [...]

## Neural Networks Learning The Basics: Backpropagation

In this post I will go through a simple backpropagation algorithm that I have implemented on a spreadsheet. It is simple as I will use one training example with two input features to explain the concept. For example: A single training example In the above we have a single observation with two input variables x1 [...]

## Neural Networks Learning The Basics : Layers, Activation

This post continues from neural network basics part 1: Layers Matrix Multiplication. This post therefore assumes that you have basic knowledge on what a neuron is. Why Add an Activation Function? In neural network basics part 1: Layers Matrix Multiplication I covered matrix multiplication and defined a simple neural network as the weighted sum of inputs with the equation: [...]

## Neural Networks Learning The Basics : Layers, Matrix Multiplication

This blog post takes a close look at the first fundamental concept of a neural network that I introduced briefly in my previous post. The layers. Layers are the building blocks of a neural network and contain the network’s knowledge. In order to achieve our goal one needs to first understand what a neural network [...]