PuGong

Bookworm, Programmer

Legistic Regression and Regularization | ML

10 Feb 2016

Machine Learning Notes

Legistic Regression and Regularization —————-

Reference:

Course Home in Coursera

Course Homepage in Stanford

Course Materials

Legistic Regression

Classification: to map input variables into discrete categories, like 0 and 1, true and fasle, 1/2/3/4/etc.

Logistic Regression (classifcation)

Logistic Regression

Sigmoid function (Logistic function) :

Logistic function

diagram of Logistic function

for mulitple variables

mulitple variables

Decision Boundary

Decision Boundary

Non-linear Decision Boundaries

Non-linear Decision Boundaries

Cost Function

hypethese function

hypethese function

cost function of logistic function

cost function

the cost function could be simplified

Gradient Descent

Regularization