Hamza Ahmed·Aug 11Feature Engineering: Foundations, Feature Selection, and Simple TransformsWhat is Feature Engineering?
Eleventh Hour Enthusiast·May 25The Information BottleneckFrom a 1999 compression principle to a contested theory of why deep learning works
InTowards AIbyMariangela Bonghi·Feb 22The Outlier and Feature Selection Dilemma: Preparing Data for ClusteringPart 1: Exploratory Data Analysis, handling outliers, and feature selection using Mutual Information
Juan Camilo Higuera Calderón·Dec 30, 2025¿Qué es una buena medida de dependencia? ¿Por qué Pearson no es suficiente y qué hacer al respecto?Imagina que llevas años monitoreando la salud de un arrecife de coral y la población de peces que lo habita. Calculas la correlación entre…
Apoorva Aggarwal·Dec 9, 2025🧠 Deciphering the Model’s Memory: Mutual Information and the Code-Length of DataIn Part 1, we introduced the idea that language models can “memorize” parts of their training data — sometimes harmlessly, sometimes in…
InData Science ExplainedbyBilly Chan·Nov 28, 2025Mutual Information Explained: Reveals Hidden Relationships in DataMutual information uncovers hidden relationships between variables that correlation can’t see. Here’s how it works.A response icon1A response icon1
Apoorva Aggarwal·Nov 13, 2025Cracking the Model’s Mind: How Much Do Language Models Really Memorize?If you work in ML, LLM development, or are simply curious about AI safety and privacy, this piece unpacks how researchers are now…
Dixon·Oct 5, 2025LongCodeZip: Compress Long Context for Code Language ModelsMaking code LLMs faster, cheaper, and smarter under long contexts.
Bill Giannakopoulos·Jul 26, 2025What Other Theories of Consciousness and Embodied Cognition Miss — and Why They Feel IncompletePreface
Bill Giannakopoulos·Jul 15, 2025The Internal Witness Principle: Why Only Some Universes Survive in the MultiverseProposing a structural selection rule for persistence: only universes with an internal witness function — capable of recursively detecting…A response icon4A response icon4
