Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Observing different Edge Completeness metric on the iBims dataset #16

Open
xlDownxl opened this issue Sep 20, 2022 · 0 comments
Open

Observing different Edge Completeness metric on the iBims dataset #16

xlDownxl opened this issue Sep 20, 2022 · 0 comments

Comments

@xlDownxl
Copy link

Dear Authors,

thank you for the great work and excellent code.

I have been trying out your Model with 101 Layers on the iBims benchmark and I got the following results:
rel = 0.18252209
sq_rel = 0.31786942
rms = 1.007896
log10 = 0.09304994
thr1 = 0.6706134
thr2 = 0.8888803
thr3 = 0.953198
dde_0 = 0.8467216
dde_p = 0.014197141
dde_m = 0.13908128
pe_fla = 3.2895006910848283
pe_ori = 9.120579389065199
dbe_acc = 2.3114917
dbe_com = 44.03281

As you can see, most numbers are equal to the ones you report in your paper, but the Edge Completeness metric dbe_com is 44 instead of the reported 6.59 in the paper. I am using the ibims command you provide and the original iBims evaluation scripts. Do you have an idea on why I am observing this wrong value?

I hope you can help me out!
Best Regards
Niclas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant