But what *is* a Neural Network?

Backpropagation calculus What is backpropagation really doing? Gradient descent, how neural networks learn The determinant Vectors, what even are they?