Ceshine Lee·Jan 17, 2022[Notes] (Ir)Reproducible Machine Learning: A Case StudyI just read this (draft) paper named “(Ir)Reproducible Machine Learning: A Case Study” ( blog post; paper). It reviewed 15 papers that…
Ceshine Lee·Dec 23, 2021How to Create a Documentation Website for Your Python PackageUse Sphinx to (semi-)automatically generate documentation from docstringsA response icon1A response icon1
InVeritablebyCeshine Lee·Jun 18, 2021[Notes] Gradient Checkpointing with BERTA brief analysis of huggingface’s implementation
InVeritablebyCeshine Lee·Apr 18, 2021[Paper] Adafactor: Adaptive Learning Rates with Sublinear Memory CostEssential for fine-tuning T5 v1.1 and mT5 models
InVeritablebyCeshine Lee·Mar 24, 2021[Paper] Rethinking Cooperative Rationalization: Introspective Extraction and Complement ControlBuilding competitive self-explaining NLP models
InVeritablebyCeshine Lee·Feb 22, 2021Reducing the SentencePiece Vocabulary Size of Pretrained NLP ModelsUseful for fine-tuning on a subset of available languages
InVeritablebyCeshine Lee·Jan 23, 2021[PyTorch Lightning] Log Training Losses when Accumulating GradientsThe global step is not what you think it is
InVeritablebyCeshine Lee·Dec 30, 2020Generating Synthetic Tabular Data Using GANA case study: detecting credit fraud
InVeritablebyCeshine Lee·Dec 9, 2020[Paper] Are We Really Making Much Progress?A Worrying Analysis of Recent Neural Recommendation Approaches
InVeritablebyCeshine Lee·Nov 21, 2020Automatic Testing Your SQLite Database with Great ExpectationsA great tool for eliminating pipeline debts