beomi / infinitransformer Goto Github PK
View Code? Open in Web Editor NEWUnofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Home Page: https://arxiv.org/abs/2404.07143
License: MIT License