Cycle-Consistent Generative Rendering for 2D-3D Modality Translation

contributions

• a cyclic gen model on unpaired 2D and 3D data, w/o camera calibration
• adv methods for a strong prior on shape/texture/poses and renders
• cyclegan like training process
  • shape -> latent var -> canonical shape, +random texture/pose -> rendered image
  • image -> latent var( -> canonical shape), pose, texture