Neural Networks Learning The Basics : Layers, Activation

Neural Networks Learning The Basics : Layers, Activation

This post continues from neural network basics part 1: Layers Matrix Multiplication. This post therefore assumes that you have basic knowledge on what a neuron is. Why Add an Activation Function? In neural network basics part 1: Layers Matrix Multiplication I covered matrix multiplication and defined a simple neural network as the weighted sum of inputs with the equation: [...]

Neural Networks Learning The Basics : Layers, Matrix Multiplication

Neural Networks Learning The Basics : Layers, Matrix Multiplication

This blog post takes a close look at the first fundamental concept of a neural network that I introduced briefly in my previous post. The layers. Layers are the building blocks of a neural network and contain the network’s knowledge. In order to achieve our goal one needs to first understand what a neural network [...]