FUNCTION CONTRASTIVE LEARNING OF TRANSFERABLE REPRESENTATIONS

idea: two set of examples from same function should share similar latent representations, while from different functions shoule be easily distinguishable

• find an encoder that maps such partial observations to low-dim. representations
• encoder: pointwise transformation(MLP) -> average pooling
  • training: cosine similarity measure with temperature