Jump to content

Convolutional neural network: Difference between revisions

Line 92: Line 92:
==Other Types of Convolutions==
==Other Types of Convolutions==
===Transpose Convolution===
===Transpose Convolution===
See [https://medium.com/apache-mxnet/transposed-convolutions-explained-with-ms-excel-52d13030c7e8 Medium Post]<br>
See [https://medium.com/apache-mxnet/transposed-convolutions-explained-with-ms-excel-52d13030c7e8 Medium: Transposed convolutions explained]
Instead of your 3x3 kernel taking 9 values as input and returning 1 value (</math>\sum_i \sum_j w_{ij} * i_{i+x,j+y}</math>), the kernel now takes 1 value and returns 9 (</math>w_{ij} * i_{x,y}</math>).
Instead of your 3x3 kernel taking 9 values as input and returning 1 value (<math>\sum_i \sum_j w_{ij} * i_{i+x,j+y}</math>), the kernel now takes 1 value and returns 9 (<math>w_{ij} * i_{x,y}</math>)
This is sometimes misleadingly referred to as deconvolution.
 
Oftentimes, papers apply a 2x bilinear upsampling rather than using transpose convolution layers.


===Gated Convolution===
===Gated Convolution===