AI NEWS.ccGSFixer
GSFixer is a framework designed to improve the quality of 3D Gaussian Splatting (3DGS) representations reconstructed from sparse inputs. It leverages a reference-guided video restoration model built upon a DiT-based video diffusion model (CogVideoX). Reconstructing 3D scenes using 3D Gaussian Splatting (3DGS) from sparse views often results in noticeable artifacts due to insufficient information. GSFixer addresses this challenge by using a reference-guided video restoration approach. By integrating both 2D semantic features (from DINOv2) and 3D geometric features (from VGGT) of reference views, the model enhances semantic coherence and 3D consistency when fixing novel views rendered from low-quality 3DGS.
GSFixer is a framework designed to improve the quality of 3D Gaussian Splatting (3DGS) representations reconstructed from sparse inputs. It leverages a reference-guided video restoration model built upon a DiT-based video diffusion model (CogVideoX). Reconstructing 3D scenes using 3D Gaussian Splatting (3DGS) from sparse views often results in noticeable artifacts due to insufficient information. GSFixer addresses this challenge by using a reference-guided video restoration approach. By integrating both 2D semantic features (from DINOv2) and 3D geometric features (from VGGT) of reference views, the model enhances semantic coherence and 3D consistency when fixing novel views rendered from low-quality 3DGS.