![[Featured Image] A machine learning engineer uses a gradient descent to train a model.](https://images.ctfassets.net/wp1lcwdav1p1/j4dXV8GUtttNlSmJyS94L/b44cae406087d560a0866da5a762c6c7/GettyImages-1388395588.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
What Is Gradient Descent in Machine Learning?
Augustin-Louis Cauchy, a mathematician, first invented gradient descent in 1847 to solve calculations in astronomy and estimate stars’ orbits. Learn about the role it plays today in optimizing machine learning algorithms.
March 21, 2024
Article

![[Featured Image] An engineer considers the six degrees of freedom while examining a model at their desk.](https://images.ctfassets.net/wp1lcwdav1p1/3GKWlLionR6GoIu4fuHHp6/34214123bd471872c650e749045df96d/GettyImages-1339976949.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A programmer explores the Pandas Python library on their computer while working from home.](https://images.ctfassets.net/wp1lcwdav1p1/4b6ej4zDapjKtwbzCb2rzN/eade38c0a4840306ec7c8a7f33c4f1a7/GettyImages-1636704276.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)



![[Featured Image] Two colleagues at a VR company test new technology.](https://images.ctfassets.net/wp1lcwdav1p1/1bKCptLqvMgmF5c6P8mdjN/ad423369582577e38a34d60fee5ead89/GettyImages-1452685443.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A data scientist sits with their laptop, using stemming to simplify data.](https://images.ctfassets.net/wp1lcwdav1p1/4CQcMfr6p60kknEHKvSYO2/e6d3298cbf297a23e4b305b24b3deba9/GettyImages-1343660710.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A machine learning engineer studies a confusion matrix on their laptop.](https://images.ctfassets.net/wp1lcwdav1p1/2Jf3yuSII8GcW5qJM4m779/78eb3fc4661a9bf7ad1d5109908cd9b9/GettyImages-1061636634.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A group of machine learning engineers sit at a computer and talk about tokenization in NLP.](https://images.ctfassets.net/wp1lcwdav1p1/5gVNJlldkgtBRxgmJubHzO/b8dfcb0adad26e2b0eaa9a85fa54d2ba/GettyImages-642394493.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A group of machine learning engineers gather around a desk to talk about regularization in machine learning.](https://images.ctfassets.net/wp1lcwdav1p1/30ZQE5LpmMGYSWGpBCq16c/545768b24b19f84f4008e0f352d63901/GettyImages-1138994226.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A video game developer sits at a desk and incorporates deep reinforcement learning into a project.](https://images.ctfassets.net/wp1lcwdav1p1/3QWr7LHGDDrJjwjANwSv1v/598d9c93c0f9616a08a4192f8593e311/GettyImages-1158895679.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A bioinformatics scientist works in a lab.](https://images.ctfassets.net/wp1lcwdav1p1/7gkmPudDGJbeledmZD7nKu/90c75c6aefb5465b06f578ec7c2c9eda/GettyImages-1422441637.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] A quarry manager looks at a laptop and uses photogrammetry to make important mining decisions.](https://images.ctfassets.net/wp1lcwdav1p1/3aghKGn0xydesXz850vv2d/452b24eae10f3b3a106d80ce1d8a5eb6/GettyImages-735933675.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
![[Featured Image] An algorithm engineer sits outside the office and works on a laptop.](https://images.ctfassets.net/wp1lcwdav1p1/3IHGm8fZo7nCjncpGFzC9/a4aa0905dcdd3ec9ccb411b0528bdd7e/GettyImages-1388227940.jpg?w=330&h=216&q=60&fit=fill&f=faces&fm=jpg&fl=progressive)
