Backpropagation is an algorithm that is designed to test errors working backwards from the output to the input. As it conducts this, the network readjusted the colors every time the network makes a mistake.