PinnedInTDS ArchivebyChan Woo Kim·Dec 19, 2021Generalized Attention Mechanism: BigBird’s Theoretical Foundation and General Transformers ModelsAs a little background, BigBird is a model released from Google Research relatively recently that can handle much lengthier sequences of…
InTDS ArchivebyChan Woo Kim·Mar 22, 2022[New Hugging Face Feature] Constrained Beam Search with 🤗 TransformersA new Hugging Face feature allows you customize and guide your language model outputs (like forcing a certain sequence within the output).
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Jul 3, 2021Tutorial: Storing Large A.I. Models with ‘gdrive’ (don’t use Git LFS)Git-LFS is a short-term solution that shouldn’t be used for your AI projects. Learn how to use gdrive to save & export your models.A response icon2A response icon2
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Jun 25, 2021ANCE Contrastive Learning for Dense Retrieval: Sampling Negative Examples & The Variation…Why negative examples are so important in training Neu-IR models and how ANCE obtains the mathematically optimized distribution.
Chan Woo Kim·Jun 23, 2021How to Set up code-server daemon on Ubuntu: Root Access, Docker, systemd, NGINX Reverse-Proxy, and…systemctl code-server + nginx publicly expose. Or use Docker to set it up. How to use Nginx as reverse-proxy to IP white-list.
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Jun 20, 2021Retrieval-Augmented Generation (RAG): Control Your Model’s Knowledge and… Hallucinations!Large LMs are really good today. But they’re known to hallucinate. Maybe we should let it cheat a little with Wikipedia.A response icon1A response icon1
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Jun 18, 2021[Part I] Predicting on Text Pairs with Transformers: Cross-Encoding with BERT[Code Implementation] Make SOTA sentence pair regression using BERT’s Cross-Encoding with SequenceClassification.
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Nov 23, 2018Autoencoders & Power of Mathematical OptimizationsI don’t know if many people agree with this sentiment but I was pretty shocked when I learned how A.I. worked the first time. Growing up, IA response icon3A response icon3
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Apr 15, 2018Overfitting (What They Are & Train, Validation, Test & Regularization)I’ve taken a bit of a hiatus because I’ve been busy with school and other things and I’ve been spending time learning more ML/DL stuff…
InExplained Relentlessly: Deep Learning & Natural Language ProcessingbyChan Woo Kim·Mar 22, 2018Document Classification Part 4: Variations of This Approach (Malware Detection Using Document…In this article I will explain an application of the concepts so far that goes beyond just categorizing text documents.