5,337
edits
Line 92: | Line 92: | ||
==Other Types of Convolutions== | ==Other Types of Convolutions== | ||
===Transpose Convolution=== | ===Transpose Convolution=== | ||
See [https://medium.com/apache-mxnet/transposed-convolutions-explained-with-ms-excel-52d13030c7e8 Medium | See [https://medium.com/apache-mxnet/transposed-convolutions-explained-with-ms-excel-52d13030c7e8 Medium: Transposed convolutions explained]. | ||
Instead of your 3x3 kernel taking 9 values as input and returning 1 value (< | Instead of your 3x3 kernel taking 9 values as input and returning 1 value (<math>\sum_i \sum_j w_{ij} * i_{i+x,j+y}</math>), the kernel now takes 1 value and returns 9 (<math>w_{ij} * i_{x,y}</math>). | ||
This is sometimes misleadingly referred to as deconvolution. | |||
Oftentimes, papers apply a 2x bilinear upsampling rather than using transpose convolution layers. | |||
===Gated Convolution=== | ===Gated Convolution=== |