[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers

The official repo for [NeurIPS'21] "ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias" and [IJCV'22] "ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond"

Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"

A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling?"

SimpleNetV1 Implementation in Pytorch

[NeurIPS 2024] official code release for our paper "Revisiting the Integration of Convolution and Attention for Vision Backbone".

PONAS: Progressive One-shot Neural Architecture Search for Very Efficient Deployment

Automated cleanup of ImageNet 1k and ImageNetV2 datasets

[PR 2024] Official PyTorch Code for "Dual Teachers for Self-Knowledge Distillation"

The tools for translate the pretrained TensorFlow model checkpoint to the torch model

Training classification model for generating backbone