Temporal Action Detection & Weakly Supervised Temporal Action Detection & Temporal Action Proposal Generation

Contents

• Awesome-Temporal-Action-Detection-Temporal-Action-Proposal-Generation
• about pretrained model
• ActivityNet Challenge
• Papers: Temporal Action Proposal Generation
  • 2021 - 2020 - 2019 - 2018 - 2017 - before
• Papers: Temporal Action Detection
  • 2021 - 2020 - 2019 - 2018 - 2017 - before
• Papers: Weakly Supervised Temporal Action Detection
  • 2021 - 2020 - 2019 - 2018 - 2017
• Papers: Online Action Detection
  • 2021

1. (BSP) Boundary-sensitive Pre-training for Temporal Localization in Videos (ICCV 2021)
2. (TSP) TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks (ICCVW 2021)

1. (2021) AcitvityNet 2021
2. (2021) Transformer在时序行为检测中的应用 & 基于自监督学习的半监督时序行为检测 (DAMO Academy, Alibaba Group)

1. (BSN++) BSN++: Complementary Boundary Regressor with Scale-Balanced RelationModeling for Temporal Action Proposal Generation (AAAI 2021) Author's Zhihu
2. (RTD-Net) Relaxed Transformer Decoders for Direct Action Proposal Generation (ICCV 2021) code Zhihu
3. (TCANet) Temporal Context Aggregation Network for Temporal Action Proposal Refinement (CVPR 2021) Zhihu
4. Augmented Transformer with Adaptive Graph for Temporal Action Proposal Generation (arxiv 2021)
5. Self-Supervised Learning for Semi-Supervised Temporal Action Proposal (CVPR 2021) code
6. (TAPG) Temporal Action Proposal Generation with Transformers (arxiv 2021)
7. (AEN) Agent-Environment Network for Temporal Action Proposal Generation (ICASSP 2021)
8. (AEI) AEI: Actors-Environment Interaction with Adaptive Attention for Temporal Action Proposals Generation (BMVC 2021) code

1. VALSE talk by Tianwei Lin (2020.03.18) link (7y8g)
2. (RapNet) Accurate Temporal Action Proposal Generation with Relation-Aware Pyramid Network (AAAI 2020) pre-paper 2019 ActivityNet task-1 2nd
3. (DBG) Fast Learning of Temporal Action Proposal via Dense Boundary Generator (AAAI 2020) paper code.TensorFlow
4. (BC-GNN) Boundary Content Graph Neural Network for Temporal Action Proposal Generation (ECCV 2020) paper
5. Bottom-Up Temporal Action Localization with Mutual Regularization (ECCV 2020) code.TensorFlow
6. (TSI) TSI: Temporal Scale Invariant Network for Action Proposal Generation (ACCV 2020)

1. (SRG) SRG: Snippet Relatedness-based Temporal Action Proposal Generator (IEEE Trans 2019) paper
2. (DPP) Deep Point-wise Prediction for Action Temporal Proposal (ICONIP 2019) paper code.PyTorch
3. (semi-supervised) Learning Temporal Action Proposals With Fewer Labels (ICCV 2019) paper
4. (BMN) BMN: Boundary-Matching Network for Temporal Action Proposal Generation (ICCV 2019) paper code.PaddlePaddle code.PyTorch_unofficial
5. (MGG) Multi-granularity Generator for Temporal Action Proposal (CVPR 2019) paper
6. Investigation on Combining 3D Convolution of Image Data and Optical Flow to Generate Temporal Action Proposals (2019 CVPR Workshop) paper
7. (CMSN) CMSN: Continuous Multi-stage Network and Variable Margin Cosine Loss for Temporal Action Proposal Generation (arxiv 2019) paper
8. A high performance computing method for accelerating temporal action proposal generation (arxiv 2019) paper
9. Multi-Granularity Fusion Network for Proposal and Activity Localization: Submission to ActivityNet Challenge 2019 Task 1 and Task 2 (ActvityNet challenge 2019) paper
10. Joint Learning of Local and Global Context for Temporal Action Proposal Generation (TCSVT 2019)

1. (CTAP) CTAP: Complementary Temporal Action Proposal Generation (ECCV 2018) paper code.TensorFlow
2. (BSN) BSN: Boundary Sensitive Network for Temporal Action Proposal Generation (ECCV 2018) paper code.TensorFlow code.PyTorch
3. (SAP) SAP: Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning (AAAI 2018) paper code.Torch

1. (TURN TAP) TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals (ICCV 2017) paper code.TensorFlow
2. (SST) SST: Single-Stream Temporal Action Proposals (CVPR 2017) paper code.theano code.TensorFlow
3. YoTube: Searching Action Proposal via Recurrent and Static Regression Networks (IEEE Trans 2017) paper
4. A Pursuit of Temporal Accuracy in General Activity Detection (arxiv 2017) paper code.PyTorch

1. (DAPs) DAPs: Deep Action Proposals for Action Understanding (ECCV 2016) paper code

1. (activity graph transformer) Activity Graph Transformer for Temporal Action Localization (arxiv 2021) project code
2. Coarse-Fine Networks for Temporal Activity Detection in Videos (CVPR 2021) code
3. (MLAD) Modeling Multi-Label Action Dependencies for Temporal Action Localization (CVPR 2021)
4. (PcmNet) PcmNet: Position-Sensitive Context Modeling Network for Temporal Action Localization (Tip 2021)
5. (AFSD) Learning Salient Boundary Feature for Anchor-free Temporal Action Localization (CVPR 2021) code
6. Low-Fidelity End-to-End Video Encoder Pre-training for Temporal Action Localization (arxiv 2021)
7. Read and Attend: Temporal Localisation in Sign Language Videos (CVPR 2021) (Sign Language Videos)
8. Low Pass Filter for Anti-aliasing in Temporal Action Localization (arxiv 2021)
9. FineAction: A Fined Video Dataset for Temporal Action Localization (One track of DeeperAction Workshop@ICCV2021) Homepage
10. (TadTR) End-to-end Temporal Action Detection with Transformer (arxiv 2021) code
11. Three Birds with One Stone: Multi-Task Temporal Action Detection via Recycling Temporal Annotations (CVPR 2021)
12. Proposal Relation Network for Temporal Action Detection (CVPRW 2021)
13. Exploring Stronger Feature for Temporal Action Localization (CVPRW 2021)
14. (SRF-Net) SRF-Net: Selective Receptive Field Network for Anchor-Free Temporal Action Detection (ICASSP 2021)
15. RGB Stream Is Enough for Temporal Action Detection (arxiv 2021)
16. (AVFusion) Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localization (arxiv 2021) Code
17. Transferable Knowledge-Based Multi-Granularity Aggregation Network for Temporal Action Localization: Submission to ActivityNet Challenge 2021 (HACS challenge 2021)
18. Enriching Local and Global Contexts for Temporal Action Localization (ICCV 2021)
19. (CSA) Class Semantics-based Attention for Action Detection (ICCV 2021)
20. (SP-TAD) Towards High-Quality Temporal Action Detection with Sparse Proposals (arxiv 2021) Code
21. Few-Shot Temporal Action Localization with Query Adaptive Transformer (BMVC 2021) code (Few-Shot)

1. (G-TAD) G-TAD: Sub-Graph Localization for Temporal Action Detection (CVPR 2020) paper code.PyTorch video
2. (AGCN-P-3DCNNs) Graph Attention based Proposal 3D ConvNets for Action Detection (AAAI 2020) paper
3. (PBRNet) Progressive Boundary Refinement Network for Temporal Action Detection (AAAI 2020) paper
4. (TsaNet) Scale Matters: Temporal Scale Aggregation Network for Precise Action Localization in Untrimmed Videos (ICME 2020) paper
5. Constraining Temporal Relationship for Action Localization (arxiv 2020) paper
6. (CBR-Net) CBR-Net: Cascade Boundary Refinement Network for Action Detection: Submission to ActivityNet Challenge 2020 (Task 1) (ActivityNet Challenge 2020) paper
7. Temporal Action Localization with Variance-Aware Networks (arxiv 2020)
8. Boundary Uncertainty in a Single-Stage Temporal Action Localization Network (arxiv 2020, Tech report)
9. Revisiting Anchor Mechanisms for Temporal Action Localization (Tip 2020) code.PyTorch
10. (C-TCN) Deep Concept-wise Temporal Convolutional Networks for Action Localization (ACM MM 2020) code.PaddlePaddle
11. (MLTPN) Multi-Level Temporal Pyramid Network for Action Detection (PRCV 2020)
12. (SALAD) SALAD: Self-Assessment Learning for Action Detection (arxiv 2020)
13. Multi-shot Temporal Event Localization: a Benchmark (arxiv 2020) project code dataset

1. (CMS-RC3D) Contextual Multi-Scale Region Convolutional 3D Network for Activity Detection (ICCVBIC 2019) paper
2. (TGM) Temporal Gaussian Mixture Layer for Videos (ICML 2019) paper code.PyTorch
3. (Decouple-SSAD) Decoupling Localization and Classification in Single Shot Temporal Action Detection (ICME 2019) paper code.TensorFlow
4. Exploring Feature Representation and Training strategies in Temporal Action Localization (ICIP 2019) paper
5. (PGCN) Graph Convolutional Networks for Temporal Action Localization (ICCV 2019) paper code.PyTorch
6. (S-2D-TAN) Learning Sparse 2D Temporal Adjacent Networks for Temporal Action Localization (ICCV 2019) (winner solution for the HACS Temporal Action Localization Challenge at ICCV 2019) paper
   • (2D-TAN) Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language (AAAI 2020) paper code.PyTorch
7. (LCDC) Learning Motion in Feature Space: Locally-Consistent Deformable Convolution Networks for Fine-Grained Action Detection (ICCV 2019) paper slide code.TensorFlow
8. (BLP) BLP -- Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization (ICASSP 2019) paper
9. (GTAN) Gaussian Temporal Awareness Networks for Action Localization (CVPR 2019) paper
10. Temporal Action Localization using Long Short-Term Dependency (arxiv 2019) paper
11. Relation Attention for Temporal Action Localization (IEEE Trans TMM 2019) paper
12. (AFO-TAD) AFO-TAD: Anchor-free One-Stage Detector for Temporal Action Detection (arxiv 2019) paper
13. (DBS) Video Imprint Segmentation for Temporal Action Detection in Untrimmed Videos (AAAI 2019) paper

1. Diagnosing Error in Temporal Action Detectors (ECCV 2018) paper
2. (ETP) Precise Temporal Action Localization by Evolving Temporal Proposals (ICMR 2018) paper
3. (Action Search) Action Search: Spotting Actions in Videos and Its Application to Temporal Action Localization (ECCV 2018) paper code.TensorFlow
4. (TAL-Net) Rethinking the Faster R-CNN Architecture for Temporal Action Localization (CVPR 2018) paper
5. One-shot Action Localization by Learning Sequence Matching Network (CVPR 2018) paper
6. Temporal Action Detection by Joint Identification-Verification (arxiv 2018) paper
7. (TPC) Exploring Temporal Preservation Networks for Precise Temporal Action Localization (AAAI 2018) paper
8. (SAP) A Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning (AAAI 2018) paper code.Torch

1. (TCN) Temporal Context Network for Activity Localization in Videos (ICCV 2017) paper code.caffe
2. (SSN) Temporal Action Detection with Structured Segment Networks (ICCV 2017) paper code.PyTorch
3. (R-C3D) R-C3D: Region Convolutional 3D Network for Temporal Activity Detection (ICCV 2017) paper code.caffe code.PyTorch
4. (TCNs) Temporal Convolutional Networks for Action Segmentation and Detection (CVPR 2017) paper code.TensorFlow
5. (SMS) Temporal Action Localization by Structured Maximal Sums (CVPR 2017) paper code
6. (SCC) SCC: Semantic Context Cascade for Efficient Action Detection (CVPR 2017) paper
7. (CDC) CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization in Untrimmed Videos (CVPR 2017) paper code project
8. (SS-TAD) End-to-End, Single-Stream Temporal ActionDetection in Untrimmed Videos (BMVC 2017) paper code.PyTorch
9. (CBR) Cascaded Boundary Regression for Temporal Action Detection (BMVC 2017) paper code.TensorFlow
10. (SSAD) Single Shot Temporal Action Detection (ACM MM 2017) paper

1. (PSDF) Temporal Action Localization with Pyramid of Score Distribution Features (CVPR 2016) paper
2. Temporal Action Detection using a Statistical Language Model (CVPR 2016) paper code
3. (S-CNN) Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs (CVPR 2016) paper code project
4. End-to-end Learning of Action Detection from Frame Glimpses in Videos (CVPR 2016) paper code

1. A Hybrid Attention Mechanism for Weakly-Supervised Temporal Action Localization. (AAAI 2021)
2. Cross-Attentional Audio-Visual Fusion for Weakly-Supervised Action Localization (ICLR 2021)
3. Weakly-supervised Temporal Action Localization by Uncertainty Modeling (AAAI 2021) code
4. (TS-PCA) The Blessings of Unlabeled Background in Untrimmed Videos (CVPR 2021) code
5. (ACSNet) ACSNet: Action-Context Separation Network for Weakly Supervised Temporal Action Localization (AAAI 2021)
6. (CoLA) CoLA: Weakly-Supervised Temporal Action Localization with Snippet Contrastive Learning (CVPR 2021)
7. Weakly Supervised Temporal Action Localization Through Learning Explicit Subspaces for Action and Context (AAAI 2021)
8. Adaptive Mutual Supervision for Weakly-Supervised Temporal Action Localization (arxiv 2021)
9. ACM-Net: Action Context Modeling Network for Weakly-Supervised Temporal Action Localization (arxiv 2021, submitted to Tip) code
10. (AUMN) Action Unit Memory Network for Weakly Supervised Temporal Action Localization (CVPR 2021)
11. (ASL) Weakly Supervised Action Selection Learning in Video (CVPR 2021)
12. (ActShufNet) Action Shuffling for Weakly Supervised Temporal Localization (arxiv 2021)
13. Few-Shot Action Localization without Knowing Boundaries (arxiv 2021)
14. Uncertainty Guided Collaborative Training for Weakly Supervised Temporal Action Detection (CVPR 2021)
15. Two-Stream Consensus Network: Submission to HACS Challenge 2021Weakly-Supervised Learning Track (CVPRW 2021)
16. Weakly-Supervised Temporal Action Localization Through Local-Global Background Modeling (CVPRW 2021)
17. Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization (ACM MM 2021) code
18. Learning Action Completeness from Points for Weakly-supervised Temporal Action Localization (ICCV 2021) code
19. Deep Motion Prior for Weakly-Supervised Temporal Action Localization (submit to Tip 2021) project
20. Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localization (ICCV 2021)

1. (WSGN) Weakly Supervised Gaussian Networks for Action Detection (WACV 2020) paper
2. Weakly Supervised Temporal Action Localization Using Deep Metric Learning (WACV 2020) paper
3. Action Graphs: Weakly-supervised Action Localization with Graph Convolution Networks (WACV 2020) paper
4. (DGAM) Weakly-Supervised Action Localization by Generative Attention Modeling (CVPR 2020) paper code.PyTorch
5. (EM-MIL) Weakly-Supervised Action Localization with Expectation-Maximization Multi-Instance Learning (ECCV 2020) paper
6. Relational Prototypical Network for Weakly Supervised Temporal ActionLocalization (AAAI 2020) paper
7. (BaS-Net) Background Suppression Networkfor Weakly-supervised Temporal Action Localization (AAAI 2020) paper code.PyTorch
8. Background Modeling via Uncertainty Estimation for Weakly-supervised Action Localization (arxiv 2020) paper code.PyTorch
9. (A2CL-PT) Adversarial Background-Aware Loss for Weakly-supervised Temporal Activity Localization (ECCV 2020) paper code.PyTorch
10. Weakly Supervised Temporal Action Localization with Segment-Level Labels (arxiv 2020)
11. (ECM) Equivalent Classification Mapping for Weakly Supervised Temporal Action Localization (arxiv 2020) paper
12. Two-Stream Consensus Network for Weakly-Supervised Temporal Action Localization (ECCV 2020 spotlight)
13. Learning Temporal Co-Attention Models for Unsupervised Video Action Localization (CVPR 2020)
14. Action Completeness Modeling with Background Aware Networks for Weakly-Supervised Temporal Action Localization (ACM MM 2020)
15. (D2-Net) D2-Net: Weakly-Supervised Action Localization via Discriminative Embeddingsand Denoised Activations (arxiv 2020) (THUMOS'14 [email protected]: 35.9)
16. (SF-Net) SF-Net: Single-Frame Supervision for Temporal Action Localization (ECCV 2020) code.PyTorch
17. Point-Level Temporal Action Localization: Bridging Fully-supervised Proposals to Weakly-supervised Losses (arxiv 2020)
18. Transferable Knowledge-Based Multi-Granularity Fusion Network for Weakly Supervised Temporal Action Detection (TMM 2020)
19. ActionBytes: Learning From Trimmed Videos to Localize Actions (CVPR 2020)

1. (AdapNet) AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization (IEEE Transactions on Neural Networks and Learning Systems) paper
2. Breaking Winner-Takes-All: Iterative-Winners-Out Networks for Weakly Supervised Temporal Action Localization (IEEE Transactions on Image Processing) paper
3. Weakly-Supervised Temporal Localization via Occurrence Count Learning (ICML 2019) paper code.TensorFlow
4. (MAAN) Marginalized Average Attentional Network for Weakly-Supervised Learning (ICLR 2019) paper code.PyTorch
5. Weakly-supervised Action Localization with Background Modeling (ICCV 2019) paper
6. (TSM) Temporal Structure Mining for Weakly Supervised Action Detection (ICCV 2019) paper
7. (CleanNet) Weakly Supervised Temporal Action Localization through Contrast basedEvaluation Networks (ICCV 2019) paper
8. (3C-Net) 3C-Net: Category Count and Center Loss for Weakly-Supervised Action Localization (ICCV 2019) paper code.PyTorch
9. (CMCS) Completeness Modeling and Context Separation for Weakly SupervisedTemporal Action Localization (CVPR 2019) paper code.PyTorch
10. (RefineLoc) RefineLoc: Iterative Refinement for Weakly-Supervised Action Localization (arxiv 2019) paper homepage
11. (TTC-Loc) Towards Train-Test Consistency for Semi-supervised Temporal Action Localization (arxiv 2019) (version v3 for LPAT) paper
12. (ASSG) Adversarial Seeded Sequence Growing for Weakly-Supervised Temporal Action Localization (ACM MM 2019) paper
13. (TSRNet) Learning Transferable Self-attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision (AAAI 2019) paper
14. (STAR) Segregated Temporal Assembly Recurrent Networks for Weakly Supervised Multiple Action Detection (AAAI 2019) paper

1. Weakly Supervised Temporal Action Detection with Shot-Based Temporal Pooling Network (ICONIP 2018)
2. (W-TALC) W-TALC: Weakly-supervised Temporal Activity Localization and Classification (ECCV 2018) code.PyTorch
3. (AutoLoc) AutoLoc: Weakly-supervised Temporal Action Localization (ECCV 2018) code
4. (STPN) Weakly Supervised Action Localization by Sparse Temporal Pooling Network (CVPR 2018) code
5. Step-by-step Erasion, One-by-one Collection: A Weakly Supervised Temporal Action Detector (ACM MM 2018)
6. (CPMN) Cascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localization (accv 2018)

1. (Hide-and-Seek) Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization (ICCV 2017)
2. (UntrimmedNets) UntrimmedNets for Weakly Supervised Action Recognition and Detection (CVPR 2017) code

1. (WOAD) WOAD: Weakly Supervised Online Action Detection in Untrimmed Videos (CVPR 2021)
2. (OadTR) OadTR: Online Action Detection with Transformers code (arxiv 2021)
3. (LSTR) Long Short-Term Transformer for Online Action Detection (arxiv 2021)