jan 1, 1951 - 1951: (SGD) A precursor to gradient descent is presented in the paper "A Stochastic Approximation Method." Other sources point to gradient descent being used in control theory as far back as 1940 but I couldn't find actual publications confirming this.
Added to timeline:
Date:
jan 1, 1951
Now
~ 74 years ago