Abstractive text summarization with Google PEGASUS using HuggingFace Transformers
Pre-requisites
Python 3.6
Tensorflow 2.3
PyTorch 1.3
Transformers 3.5
Relevant Links:
Pegasus paper : https://arxiv.org/abs/1912.08777
Illustrated Transformer : http://jalammar.github.io/illustrated-transformer/
Illustrated BERT : http://jalammar.github.io/illustrated-bert/
ROGUE1-F1 : https://www.ccs.neu.edu/home/vip/teach/DMcourse/5_topicmodel_summ/notes_slides/What-is-ROUGE.pdf