gradient_descent
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| gradient_descent [2025/08/21 16:09] – [Gradient descend] hkimscil | gradient_descent [2025/10/02 11:59] (current) – hkimscil | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Gradient Descent ====== | ====== Gradient Descent ====== | ||
| - | ====== explanation ====== | ||
| - | |||
| ====== R code: Idea ====== | ====== R code: Idea ====== | ||
| < | < | ||
| + | library(tidyverse) | ||
| + | library(data.table) | ||
| library(ggplot2) | library(ggplot2) | ||
| library(ggpmisc) | library(ggpmisc) | ||
| Line 541: | Line 540: | ||
| & = & -2 X_i \sum{(Y_i - (a + bX_i))} \\ | & = & -2 X_i \sum{(Y_i - (a + bX_i))} \\ | ||
| & = & -2 * X_i * \sum{\text{residual}} \\ | & = & -2 * X_i * \sum{\text{residual}} \\ | ||
| - | \\ | + | & .. & -2 * X_i * \frac{\sum{\text{residual}}}{n} \\ |
| + | & = & -2 * \overline{X_i * \text{residual}} \\ | ||
| \end{eqnarray*} | \end{eqnarray*} | ||
| Line 1007: | Line 1008: | ||
| & = & k + \frac{m * x}{\sigma} - \frac{m * \mu}{\sigma} | & = & k + \frac{m * x}{\sigma} - \frac{m * \mu}{\sigma} | ||
| & = & k - \frac{m * \mu}{\sigma} + \frac{m * x}{\sigma} | & = & k - \frac{m * \mu}{\sigma} + \frac{m * x}{\sigma} | ||
| - | & = & \underline{k - \frac{\mu}{\sigma} * m} + \underline{\frac{m}{\sigma}} * x \\ | + | & = & \underbrace{k - \frac{\mu}{\sigma} * m}_\text{ 1 } + \underbrace{\frac{m}{\sigma}}_\text{ 2 } * x \\ |
| & & \text{therefore, | & & \text{therefore, | ||
| a & = & k - \frac{\mu}{\sigma} * m \\ | a & = & k - \frac{\mu}{\sigma} * m \\ | ||
gradient_descent.1755760158.txt.gz · Last modified: by hkimscil