ML Little Practices
models: perceptron, Adaline[Gradient Descent], Adaline[Stochastic Gradient Descent]
(A) LR = 1e-1, [Weights update: Gradient Descent]
(B) LR = 1e-1, [Weights update: Stochastic Gradient Descent]
(A) LR = 1e-2, [Weights update: Gradient Descent]
(B) LR = 1e-2, [Weights update: Stochastic Gradient Descent]
(A) Adaline, LR = 1e-3, [Weights update: Gradient Descent]
(B) Adaline, LR = 1e-3, [Weights update: Stochastic Gradient Descent]
(A) Adaline, LR = 1e-4, [Weights update: Gradient Descent]
(B) Adaline, LR = 1e-4, [Weights update: Stochastic Gradient Descent]
(A) Adaline, LR = 1e-5, [Weights update: Gradient Descent]
(B) Adaline, LR = 1e-5, [Weights update: Stochastic Gradient Descent]