Difference between revisions of "Machine Learning"

From David's Wiki
Jump to navigation Jump to search
Line 1: Line 1:
 
Machine Learning
 
Machine Learning
  
==Loss functisons==
+
==Loss functions==
 
===(Mean) Squared Error===
 
===(Mean) Squared Error===
 
The squared error is:<br>
 
The squared error is:<br>

Revision as of 10:15, 10 November 2019

Machine Learning

Loss functions

(Mean) Squared Error

The squared error is:

If our model is linear regression then this is convex.

Proof


so the hessian is positive semi-definite

Cross Entropy

The cross entropy loss is

Notes
  • If our model is where is the sigmoid function then this is convex
Proof