PinnedInTDS ArchivebyJesse Vig·Jan 7, 2019Deconstructing BERT, Part 2: Visualizing the Inner Workings of AttentionA new visualization tool shows how BERT forms its distinctive attention patterns.A response icon8A response icon8
InTDS ArchivebyJesse Vig·Mar 5, 2019OpenAI GPT-2: Understanding Language Generation through VisualizationHow the super-sized language model is able to finish your thoughts.A response icon5A response icon5
InTDS ArchivebyJesse Vig·Dec 18, 2018Deconstructing BERT: Distilling 6 Patterns from 100 Million ParametersFrom BERT’s tangled web of attention, some intuitive patterns emerge.A response icon5A response icon5
InTDS ArchivebyJesse Vig·Nov 28, 2018A.I. Plays Mad Libs and the Results are TerrifyingThe year is 1982. Michael Jackson’s Thriller is the best-selling album in the world. Surgeons recently implanted the world’s first…A response icon4A response icon4