Why do dilated convolutions preserve resolution?

前端 未结 1 1193
抹茶落季
抹茶落季 2021-02-04 15:02

The animation is from here. I am wondering why the dilated convolution is claimed to preserve resolution. Apparently the input in blue is 7x7 and the output in green is

相关标签:
1条回答
  • 2021-02-04 15:37

    This is indeed a dilated convolution with a 5x5 filter. If you imagine the blue part of the animation as a 3x3 image that's 0 padded, it preserves resolution.

    With regard to your edit, the emphasis is really in this statement in the post you linked: dilated convolutions support exponential expansion of the receptive field without loss of resolution or coverage

    Padding is done to preserve resolution. That is correct.

    What we really want here is to expand the size of the receptive field. In the post you linked, with 3 3x3 dilated convolutions at an increasing dilation, we already achieve a receptive field of 15x15 in the feature maps.

    To achieve the equivalent with 3x3 convolutions and no loss of coverage and no loss of resolution, we can do it with a stride of 3 (4 would result in loss of coverage) and extremely heavy padding (to the extent where it's like what you said, convolution with mostly padded zeroes). However, we will need 4 3x3 convolutions with stride 3 instead of 3 to achieve a receptive field of 15x15.

    On top of that, the normal convolutions would have even more convolutions that don't make sense, compared to the dilated convolution case.

    0 讨论(0)
提交回复
热议问题