Pinned Loading

1. Pytorch Sample code for Linear regre... Pytorch Sample code for Linear regression using Least Squares.

   1

   import torch

   2

   import numpy as np 

   3

   4

   # Generate Synthetic data

   5

   N = 500 # Num of samples

2. LLM vs Information Theory.MD LLM vs Information Theory.MD

   1

   Large Language Models (LLMs) like GPT and others don’t exactly *challenge* information theory in the sense of contradicting it—but they do **raise interesting questions and stretch traditional interpretations**, especially in areas like entropy, compression, meaning, and communication. Here’s a breakdown of how LLMs interact with or challenge the classical concepts of information theory:

   2

   3

   ---

   4

   5

   ### 1. **Meaning vs. Information (Shannon vs. Semantics)**

3. nano-transformer nano-transformer Public

   A very small transformer language model built from scratch

4. word-to-word-autoencoder.ipynb word-to-word-autoencoder.ipynb

   1

   {

   2

     "nbformat": 4,

   3

     "nbformat_minor": 0,

   4

     "metadata": {

   5

       "colab": {

5. notebooks notebooks Public

   Collection of my notebooks

   Jupyter Notebook

6. pytorch_experiments pytorch_experiments Public

   Jupyter Notebook