PinnedShivang Bhatnagar·Oct 8Same cache: 10x faster start on my laptop, bigger bill on ClaudePrompt and retrieval caching cut my local model’s time to first token from about 3 s to 0.3 s. On Claude, the same caching raised cost by…A response icon1A response icon1
Shivang Bhatnagar·Oct 25Lucida | Search That Shows Its WorkDiwali cleaning season, sales on every shopping site, and I dusted off my 2023 hackathon project. This time, I tested it.