Jump to content

Advanced Calculus: Difference between revisions

no edit summary
No edit summary
Line 45: Line 45:
==Implicit Function Theorem==
==Implicit Function Theorem==
==Line and Surface Integrals==
==Line and Surface Integrals==
==Derivatives with respect to vectors and matrices==
Not typically covered in undergraduate analysis and calculus classes but necessary for machine learning.<br>
See [https://www.math.uwaterloo.ca/~hwolkowi/matrixcookbook.pdf The Matrix Cookbook]
* <math>\partial_{x} x^t x = \partial_{x} \operatorname{Tr}(x^t x) = \operatorname{Tr}( (\partial x)^t x + x^t (\partial x)) = 2 * \operatorname{Tr}(x^t (\partial x)) = 2x</math>