5,321
edits
Unsupervised Learning: Difference between revisions
→KL Divergence
| Line 186: | Line 186: | ||
* KL is always >= 0 | * KL is always >= 0 | ||
* KL is not symmetric | * KL is not symmetric | ||
* Jensen-Shannon Divergence | |||
** <math>JSD(P \Vert Q) = \frac{1}{2}KL(P \Vert Q) + \frac{1}{2}KL(Q \Vert P)</math> | |||
** This is symmetric | |||
====Model==== | ====Model==== | ||