Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Low validation mIoU despite high validation accuracy on part seg #37

Open
mackenzie-warren opened this issue Feb 22, 2021 · 1 comment

Comments

@mackenzie-warren
Copy link
Contributor

mackenzie-warren commented Feb 22, 2021

I am getting the same error as mention in a previous issue: #34

On the part segmentation, the validation mIoU is only reaching 0.16, although the validation accuracy is about 90%. The was run with the default parameters in the code and using the prepared version of ShapeNet found here: https://drive.google.com/open?id=184MbflF_RbDX9MyML3hid7OxsYJ8oQQ7

I've attached a plot that shows the train and validation losses and accuracy, and the validation mIoU, at every epoch during training.

Screen Shot 2021-02-22 at 9 00 02 AM

@mackenzie-warren mackenzie-warren changed the title Low validation mIoU despite high validation accuracy Low validation mIoU despite high validation accuracy on part seg Feb 22, 2021
@mackenzie-warren
Copy link
Contributor Author

Fix suggested in pull request #38: in calculation of IoU, the tensors need to be converted to int from boolean before adding. E.g. lines 155 in losses.py should be:

intersection = (gt.int() + predict.int()) == 2 union = (gt.int() + predict.int()) >= 1

lijx10 added a commit that referenced this issue Feb 24, 2021
Fixes issue #37: Low validation mIoU despite high validation accuracy on part seg
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant