Adding ViT-Adapter as Supported Backbone

[MatCorr]

I've been doing some segmentation tasks using ViTs as backbones. I was getting good results, but once I switched to a ViT-Adapter they got much better.

The thing is, the available implementation of the ViT-Adapter requires older versions of mmcv, mmsegmentation, and others. Ideally, I'd like to use that backbone with the current version of mmsegmentation, not only because I'd like to use some newer features but also because it'd be much easier to manage my Python environments if I could train all my segmentation models with a single version of mmsegmentation.

However, so far I've been unable to make the ViT-Adapter work alongside the current mmsegmentation version.

I know it's a bit of a longshot, but has anyone been able to make that work?