InPhysicsWallah EngineeringbyVishal Singh·Jun 12Weight tying in language models: when and why LLMs share embeddingsMost transformer models made the same architectural choice for years without questioning it. Then they stopped. This post looks at the data…
InPhysicsWallah EngineeringbyVishal Singh·Jun 3Why your fine-tuned retrieval model isn’t as good as you think it isYour model trains well, evaluates well — then quietly fails in production. The problem isn’t your architecture. It’s what you chose as your…