Add a point cloud option for Record3D #3556
Conversation
nerfstudio/scripts/process_data.py
Outdated
| @@ -101,7 +104,10 @@ def main(self) -> None: | |||
| ) | |||
|
|
|||
| metadata_path = self.data / "metadata.json" | |||
| record3d_utils.record3d_to_json(copied_image_paths, metadata_path, self.output_dir, indices=idx) | |||
| ply_path = self.ply if hasattr(self, "ply") else None | |||
There was a problem hiding this comment.
Not sure this is necessary? I think you can just pass in self.ply into record3d_to_json.
There was a problem hiding this comment.
oh you're right, sorry about that
nerfstudio/scripts/process_data.py
Outdated
| @@ -49,6 +49,9 @@ class ProcessRecord3D(BaseConverterToNerfstudioDataset): | |||
| 2. Converts Record3D poses into the nerfstudio format. | |||
| """ | |||
|
|
|||
| ply: Optional[Path] = None | |||
There was a problem hiding this comment.
Nit: Might want to call this ply_dir instead to emphasize that it's a directory, not a ply file itself.
Is the reason for doing a dir instead of the ply filepath because Record3D can generate multiple ply's?
There was a problem hiding this comment.
yea exactly, when you export Record3D gives a bunch of ply's, ill make the change rn
| pcd = o3d.geometry.PointCloud() | ||
| for ply_filename in ply_dirname.iterdir(): | ||
| temp_pcd = o3d.io.read_point_cloud(str(ply_filename)) | ||
| pcd += temp_pcd.voxel_down_sample(voxel_size=0.8) |
There was a problem hiding this comment.
Should probably make voxel_size an argument, and maybe include it in the ProcessRecord3D settings.
There was a problem hiding this comment.
thats a good idea
docs/quickstart/custom_dataset.md
Outdated
| @@ -268,6 +268,35 @@ ns-process-data record3d --data {data directory} --output-dir {output directory} | |||
| ns-train nerfacto --data {output directory} | |||
| ``` | |||
|
|
|||
| ### Adding a Point Cloud | |||
|
|
|||
| Adding a point cloud is useful for avoiding random initialization | |||
There was a problem hiding this comment.
nit: seems like this was split into multiple lines unnecesarily?
|
Thanks! |
#2681
Added the option to add a point cloud to Record3D. Record3D has an export ply option which gives a dense point cloud for every camera. I just combine them all and downsample to make the point cloud sparse using open3d. I also changed the documentation under Getting Started > Using Custom Data > Record3D.