Skip Connections

Zero-padded Shortcut Connection

Introduced by Han et al. in Deep Pyramidal Residual Networks

A Zero-padded Shortcut Connection is a type of residual connection used in the PyramidNet architecture. For PyramidNets, identity mapping alone cannot be used for a shortcut because the feature map dimension differs among individual residual units. Therefore, only a zero-padded shortcut or projection shortcut can be used for all the residual units. However, a projection shortcut can hamper information propagation and lead to optimization problems, especially for very deep networks. On the other hand, the zero-padded shortcut avoids the overfitting problem because no additional parameters exist.

Source: Deep Pyramidal Residual Networks

Papers


Paper Code Results Date Stars

Tasks


Task Papers Share
Image Classification 3 33.33%
General Classification 2 22.22%
Decoder 1 11.11%
Language Modelling 1 11.11%
Classification 1 11.11%
Object Recognition 1 11.11%

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories