MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers

Lili Yu, Dániel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis

MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers: 10 upvotes on Hugging Face Daily Papers, #1 of 11 papers on 2023-05-15. Day-by-day upvote history.

Paper page on Hugging Face · arXiv

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.