1 jan 1951 ano - 1951: (SGD) A precursor to gradient descent is
presented in the paper "A Stochastic
Approximation Method."
Other sources point to gradient descent being
used in control theory as far back as 1940 but I
couldn't find actual publications confirming this.