downloading error when running evaluation

[HeZhao0122]

Hi, when I try to run the evaluation follow the given example and your code, there is a problem on downloading data from github, id there any solutions?

[HeZhao0122]

specifically, fail to run：

return prior.load_dataset(
"procthor-objaverse-internal",
revision="local",
path_to_splits=None,
split_to_path={
k: os.path.join(OBJAVERSE_HOUSES_DIR, f"{k}.jsonl.gz")
for k in ["train", "val", "test"]
},
max_houses_per_split=max_houses_per_split,
)[subset_to_load]

in PoliFormer/online_evaluation/online_evaluator.py

[KuoHaoZeng]

Hello! It requires the user to

1. download asserts, annotations, and objaverse houses using this
2. export the assets and houses dir to environments variable using this

Please find the screenshot for an example.

[HeZhao0122]

Hi, thanks for your reply! I have download the asssets and others and export the path into the environment, then I run your example. It still receives the same error.

[HeZhao0122]

when I tried to change the dataset info as

return prior.load_dataset(
dataset="spoc-data",
entity="spoc-robot",
revision="local-objaverse-procthor-houses",
path_to_splits=None,
split_to_path={
k: os.path.join(OBJAVERSE_HOUSES_DIR, f"{k}.jsonl.gz")
for k in ["train", "val", "test"]
},
max_houses_per_split=max_houses_per_split,
)[subset_to_load]
,which is found in the spoc project
it can run normally. Are the two version the same dataset?

[KuoHaoZeng]

Yes, they should be the same (please see the screenshot)!
Thank you for finding this bug! I believe it is because the prior.load uses my github token to load data from internal storage, but not from the public space, using the way I loaded houses.
I'll update the script.

[HeZhao0122]

thank you!