Neural networks

What changes inside a neural network when it “learns”: neurons, layers, the loss function, backpropagation and gradient descent, with a minimal NumPy version and the same loop in PyTorch.