Ppisp: Cleaner Representations of Gaussian Splats and NeRFs
4 hours ago
- #Computer Vision
- #Photometric Compensation
- #3D Reconstruction
- Multi-view 3D reconstruction is sensitive to photometric inconsistencies caused by camera characteristics and ISP variations.
- Existing methods lack physical grounding and generalize poorly to novel views.
- Proposed PPISP module disentangles camera-intrinsic and capture-dependent effects using physically based transformations.
- PPISP controller predicts ISP parameters for novel views, similar to auto exposure and white balance in real cameras.
- PPISP achieves state-of-the-art performance on benchmarks and supports metadata integration.
- The pipeline includes exposure offset, chromatic vignetting, linear color correction, and non-linear camera response function.
- PPISP improves reconstruction quality by explaining photometric variations as non-geometric artifacts.
- Controller module predicts per-frame parameters for novel views, unlike methods that optimize only on training views.
- Combination of photometric compensation and control enhances the quality and likeness of rendered novel views.