Dzmitry Bahdanau·Jan 9, 2022The FLOPs Calculus of Language Model TrainingExtremely large language models like the famous GPT-3 by OpenAI are all the rage. Many of us are now trying to get a sense of scale of the…A response icon4A response icon4