constanza fierro·Jan 31, 2022About biases in the data and how that affects the factual knowledge language models learnIn this blogpost we’re going to talk about 3 papers presented at EMNLP 2021 [5,6,7] that touch on the subject of biases in the training…
InDAIR.AIbyconstanza fierro·Jun 5, 2020Recipes for building an open-domain chatbotRecipes for building an open-domain chatbot
InDAIR.AIbyconstanza fierro·May 11, 2020A Light Introduction to BERTPre-training of Deep Bidirectional Transformers for Language Understanding.
InDAIR.AIbyconstanza fierro·Apr 25, 2020Attention is all you need, the transformer architectureThis is the paper that first introduced the transformer architecture, which allowed language models to be way bigger and parallelizable.