Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add InternImage-H Results #64

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Add InternImage-H Results #64

wants to merge 10 commits into from

Conversation

praeclarumjj3
Copy link
Member

@praeclarumjj3 praeclarumjj3 commented Jun 8, 2023

This PR enables running OneFormer with the InternImage-H backbone.

TODO

  • Train on ADE20K with 896x896 image resolution and emb_dim=256.
  • Train on Cityscapes with emb_dim=256.
  • Train on COCO with emb_dim=1024.
  • Train on Mapillary with emb_dim=1024.
  • Finetune ADE20K and Cityscapes with emb_dim=1024.

@praeclarumjj3 praeclarumjj3 requested a review from honghuis June 8, 2023 11:21
@jhpauls
Copy link

jhpauls commented Dec 8, 2024

Awesome to see that OneFormer is improved even further! 🤩

When trying it out, I found that the new Mapillary weight file (https://shi-labs.com/projects/oneformer/mapillary/250_16_intern_image_h_oneformer_mapillary_300k_1024.pth) seems to be incomplete. I get the following error when loading it in pytorch:

torch.load('../250_16_intern_image_h_oneformer_mapillary_300k_1024.pth.1')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/pauls/anaconda3/envs/oneformer/lib/python3.8/site-packages/torch/serialization.py", line 600, in load
    with _open_zipfile_reader(opened_file) as opened_zipfile:
  File "/home/pauls/anaconda3/envs/oneformer/lib/python3.8/site-packages/torch/serialization.py", line 242, in __init__
    super(_open_zipfile_reader, self).__init__(torch._C.PyTorchFileReader(name_or_buffer))
RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory

I cross-checked by successfully using the other new weights (COCO, CS). Also, zip is reporting an incomplete file when listing/reparing:

zip -FF 250_16_intern_image_h_oneformer_mapillary_300k_1024.pth --out 250_16_intern_image_h_oneformer_mapillary_300k_1024_repaired.pth
[...]
 copying: archive/data/1236  (10240 bytes)
 copying: archive/data/1237 
	zip warning: no end of stream entry found: archive/data/1237
	zip warning: rewinding and scanning for later entries

Would you mind checking the file and, if necessary, reuploading it? Thanks a lot already!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants