Skip to main content



Step by Step Back Propagation:

A very detailed step by step Back Propagation Example.
Background Backpropagation is the most common method for training any neural network. You can find various papers here and there regarding backpropagation. However, most undergraduate and grate guys like me struggle to understand the equation for backpropagations especially when they involve tons of notations and you have scroll back every time to check which notation means what.  In this post, I'll try my best to explain how it works with a simple example and a pseudo code that can be applied to any number of layers. For a better understanding, y'all should also perform the calculations in order to get a grip on what is going on.
Do check my post on multiclass perceptron classification in case you are interested. Click here to visit the post.

I'll begin with a 3 layer network. The first layer is the input layer obviously. The second layer is the hidden layer and the third layer is the output layer.

I am using the min…

Latest Posts

Multiclass Perceptron Implementation

ESP32 Cam programming without Adapters!

Verilog Code for 16 Bit MIPS Pipelined Processor