Momentum Contrast for Unsupervised Visual Representation Learning

contrastive learning

• from a dictionary point of view
• maintain a dictrionary of keys, then matching the current query to elements in the queue
  • degenerating results
• seperate encoder for key and queries
  • gradient update query encoder
  • key encoder: average of key and query -> mometum