SHI Labs

All

59 repositories

OLA-VLM
Public
OLA-VLM: Elevating Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
Python
•2•41•1•1•Updated Dec 15, 2024Dec 15, 2024
NATTEN
Public
Neighborhood Attention Extension. Bringing attention to a neighborhood near you!
cuda pytorch neighborhood-attention
Cuda
•
Other
•31•388•11•3•Updated Dec 2, 2024Dec 2, 2024
Compact-Transformers
Public
Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)
Python
•
Apache License 2.0
•80•507•8•2•Updated Nov 5, 2024Nov 5, 2024
Diffusion-Driven-Test-Time-Adaptation-via-Synthetic-Domain-Alignment
Public
Everything to the Synthetic: Diffusion-driven Test-time Adaptation via Synthetic-Domain Alignment
diffusion-models test-time-adaptation
Python
•2•21•0•0•Updated Oct 29, 2024Oct 29, 2024
OneFormer
Public
[CVPR 2023] OneFormer: One Transformer to Rule Universal Image Segmentation
transformer coco image-segmentation semantic-segmentation cityscapes instance-segmentation ade20k panoptic-segmentation universal-segmentation oneformer
Jupyter Notebook
•
MIT License
•134•1.5k•34•4•Updated Oct 3, 2024Oct 3, 2024
Smooth-Diffusion
Public
Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models arXiv 2023 / CVPR 2024
Python
•
MIT License
•7•324•11•0•Updated Sep 24, 2024Sep 24, 2024
FineStyle
Public
FineStyle: Fine-grained Controllable Style Personalization for Text-to-image Models
MIT License
•0•5•0•0•Updated Sep 4, 2024Sep 4, 2024
Agriculture-Vision
Public
[CVPR 2020 & 2021 & 2022 & 2023] Agriculture-Vision Dataset, Prize Challenge and Workshop: A joint effort with many great collaborators to bring Agriculture and Computer Vision/AI communities together to benefit humanity!
33•207•2•1•Updated Jul 27, 2024Jul 27, 2024
CuMo
Public
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
Python
•
Apache License 2.0
•10•138•0•0•Updated Jun 8, 2024Jun 8, 2024
StyleNAT
Public
New flexible and efficient image generation framework that sets new SOTA on FFHQ-256 with FID 2.05, 2022
gan image-generation neighborhood-attention
Python
•
MIT License
•12•100•0•0•Updated Jun 4, 2024Jun 4, 2024
Neighborhood-Attention-Transformer
Public
Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022
pytorch neighborhood-attention
Python
•
MIT License
•86•1.1k•4•0•Updated May 15, 2024May 15, 2024
CompactNet
Public
Jupyter Notebook
•0•30•0•0•Updated May 5, 2024May 5, 2024
VCoder
Public
[CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
Python
•
Apache License 2.0
•15•270•4•2•Updated Apr 17, 2024Apr 17, 2024
FcF-Inpainting
Public
[WACV 2023] Keys to Better Image Inpainting: Structure and Texture Go Hand in Hand
pytorch image-inpainting stylegan2 fast-fourier-convolution fcfgan
Jupyter Notebook
•
Other
•13•180•7•0•Updated Apr 3, 2024Apr 3, 2024
Rethinking-Text-Segmentation
Public
[CVPR 2021] Rethinking Text Segmentation: A Novel Dataset and A Text-Specific Refinement Approach
Python
•27•252•10•0•Updated Dec 2, 2023Dec 2, 2023
Matting-Anything
Public
Matting Anything Model (MAM), an efficient and versatile framework for estimating the alpha matte of any instance in an image with flexible and interactive visual or linguistic user prompt guidance.
Python
•
MIT License
•48•630•8•1•Updated Nov 18, 2023Nov 18, 2023
Prompt-Free-Diffusion
Public
Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models, arxiv 2023 / CVPR 2024
Python
•
MIT License
•36•738•15•2•Updated Nov 16, 2023Nov 16, 2023
VIM
Public
Python
•
MIT License
•4•57•4•0•Updated Nov 8, 2023Nov 8, 2023
Versatile-Diffusion
Public
Versatile Diffusion: Text, Images and Variations All in One Diffusion Model, arXiv 2022 / ICCV 2023
Python
•
MIT License
•84•1.3k•9•1•Updated Aug 10, 2023Aug 10, 2023
Forget-Me-Not
Public
Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models, 2023
Python
•
MIT License
•8•122•7•0•Updated Jul 17, 2023Jul 17, 2023
OneFormer-Colab
Public
[Colab Demo Code] OneFormer: One Transformer to Rule Universal Image Segmentation.
transformer coco image-segmentation semantic-segmentation cityscapes instance-segmentation ade20k panoptic-segmentation universal-segmentation oneformer
Python
•
MIT License
•10•13•1•0•Updated May 24, 2023May 24, 2023
PAIR-Diffusion
Public
PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models, 2023
Python
•
MIT License
•22•3•0•0•Updated May 19, 2023May 19, 2023
Text2Video-Zero
Public
a copy of "Text-to-Image Diffusion Models are Zero-Shot Video Generators", ICCV 2023
Python
•
Other
•355•2•0•0•Updated May 6, 2023May 6, 2023
Text2Video-Zero-sd-webui
Public
Python
•
Other
•16•80•6•0•Updated Apr 10, 2023Apr 10, 2023
SH-GAN
Public
[WACV 2023] Image Completion with Heterogeneously Filtered Spectral Hints
Python
•4•63•3•0•Updated Mar 28, 2023Mar 28, 2023
Boosted-Dynamic-Networks
Public
Boosted Dynamic Neural Networks, AAAI 2023
Python
•
MIT License
•3•9•1•0•Updated Dec 1, 2022Dec 1, 2022
VMFormer
Public
[Preprint] VMFormer: End-to-End Video Matting with Transformer
video-matting vision-transformer
Python
•
Other
•10•112•8•0•Updated Nov 30, 2022Nov 30, 2022
Unsupervised-Domain-Adaptation-with-Differential-Treatment
Public
[CVPR 2020] Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation
Python
•13•91•5•2•Updated Nov 22, 2022Nov 22, 2022
Convolutional-MLPs
Public
[Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021
Python
•
Apache License 2.0
•18•165•4•0•Updated Oct 11, 2022Oct 11, 2022
DiSparse-Multitask-Model-Compression
Public
[CVPR 2022] DiSparse: Disentangled Sparsification for Multitask Model Compression
Jupyter Notebook
•3•13•2•0•Updated Sep 6, 2022Sep 6, 2022