Probability: Difference between revisions

418 bytes removed ,  4 February 2023
no edit summary
No edit summary
Line 19: Line 19:
The CDF is the prefix sum of the PMF or the integral of the PDF. Likewise, the PDF is the derivative of the CDF.
The CDF is the prefix sum of the PMF or the integral of the PDF. Likewise, the PDF is the derivative of the CDF.


==Expectation, Variance, and Moments==
==Expectation and Variance==
Some definitions and properties.
Some definitions and properties.
===Definitions===
===Definitions===
Line 68: Line 68:
* <math>(n-1)S^2 / \sigma^2 \sim \chi^2(n-1)</math>
* <math>(n-1)S^2 / \sigma^2 \sim \chi^2(n-1)</math>


===Moments===
==Moments and Moment Generating Functions==
===Definitions===
{{main | Wikipedia: Moment (mathematics) | Wikipedia: Central moment | Wikipedia: Moment-generating function}}
{{main | Wikipedia: Moment (mathematics) | Wikipedia: Central moment | Wikipedia: Moment-generating function}}
* <math>E(X^n)</math> the n'th moment
* <math>E(X^n)</math> the n'th moment
Line 76: Line 77:
Additionally, ''skew'' is the third standardized moment and ''kurtosis'' is the fourth standardized moment.
Additionally, ''skew'' is the third standardized moment and ''kurtosis'' is the fourth standardized moment.


===Moment Generating Functions===
To compute moments, we can use a moment generating function (MGF):
To compute moments, we can use a moment generating function (MGF):
<math>M_X(t) = E(e^{tX})</math>
<math>M_X(t) = E(e^{tX})</math>
With the MGF, we can get any order moments by taking n derivatives and setting <math display="inline">t=0</math>.
With the MGF, we can get any order moments by taking n derivatives and setting <math display="inline">t=0</math>.
==Moments and Moment Generating Functions==
===Definitions===
We call <math>E(X^i)</math> the i'th moment of <math>X</math>.<br>
We call <math>E(|X - E(X)|^i)</math> the i'th central moment of <math>X</math>.<br>
Therefore the mean is the first moment and the variance is the second central moment.
===Moment Generating Functions===
<math>E(e^{tX})</math><br>
We call this the moment generating function (mgf).<br>
We can differentiate it with respect to <math>t</math> and set <math>t=0</math> to get the higher moments.
; Notes
; Notes
* The mgf, if it exists, uniquely defines the distribution.
* The MGF, if it exists, uniquely defines the distribution.
* The mgf of <math>X+Y</math> is <math>E(e^{t(X+Y)})=E(e^{t(X)})E(e^{t(Y)})</math>
* The MGF of <math>X+Y</math> is <math>MGF_{X+Y}(t) = E(e^{t(X+Y)})=E(e^{tX})E(e^{tY}) = MGF_X(t) * MGF_Y(t)</math>
===Characteristic function===
===Characteristic function===