Making Convolutional Networks Shift-Invariant Again

max pooling does not provide anti-aliasing capability

• from striding!!
• recall signal processing: blur before max-pooling
  • max pooling -> maxing and subsampling
  • solution: maxing and blurring and subsampling
  • accuracy and shift-equivariance improves at the same time
    • and rotation-equivariance