This is a Pytorch implementation of Reformer. It includes LSH attention, reversible network, and chunking. It has been validated with an auto-regressive task (enwik8).
Features
- Positional Embeddings
- Masking
- Documentation available
- Examples available
- Reformer Encoder Decoder Architecture
- Product Key Memory
- Customize Feedforward
- Helpers for training auto-regressive models
Categories
Machine LearningLicense
MIT LicenseFollow Reformer PyTorch
Other Useful Business Software
Our Free Plans just got better! | Auth0
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Reformer PyTorch!