Seeing the World in a Bag of Chips

nvs and environment reconstruction

• reconstruct specular reflectance maps: environment map convolve with BRDF
  • given RGBD video: geometry given!!!
• diffuse color using previous methods: approx. min of all values
  • refined using CNN
• predefine some number of basis textures
  • each point is a mixture of different textures
  • each texture has a specific environment map(BRDF conv true envirionment map)
• consider fresnel effect and interreflection
  • only by feeding fresnel coef. and reflection color into a CNN