Members: Dayoung Lee, Kyung-hoon Hur, JongHak Moon, Seungwoo Ryu, Minjae Lee, Eunbyeol Cho, and Sumin Jo
Date | Topic | Published | By. | Note | Reference | |
---|---|---|---|---|---|---|
10th Sep | Setting up an agenda and goal | - | week1 | |||
24th Sep | Transformers are RNNs:Fast Autoregressive Transformers with Linear Attention | ICML 2020 | dylee | week2 | ref.1 | |
1st Oct | REFORMER: THE EFFICIENT TRANSFORMER | ICLR 2020 | khhur | week3 | ||
8th Oct | [CodeReview] REFORMER: THE EFFICIENT TRANSFORMER | ICLR 2020 | dylee | week4 | ||
15th Oct | RETHINKING ATTENTION WITH PERFORMERS | ICLR 2021 | dylee | week5 | ||
29th Oct | [CodeReview] RETHINKING ATTENTION WITH PERFORMERS | ICLR 2021 | dylee | week6 | ||
11th Oct | Linformer: Self-Attention with Linear Complexity | ArXiv 2020 | ebcho | week7 |