advance-deep-learning Goto Github PK

mim-depth-estimation

This is an official implementation of our CVPR 2023 paper "Revealing the Dark Secrets of Masked Image Modeling" on Depth Estimation.

retnet

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"

retnet-syncdoth

Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent, and chunkwise forward.

styleswin

[CVPR 2022] StyleSwin: Transformer-based GAN for High-resolution Image Generation

swin-transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

swin-transformer-object-detection

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Object Detection and Instance Segmentation.

swin-transformer-semantic-segmentation

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Semantic Segmentation.

swinbert

Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"

transformer-ssl

This is an official implementation for "Self-Supervised Learning with Swin Transformers".

vanillanet