Theofilus Arifin·Apr 1, 2025Real-Time LLM Chat with Socket.IO in PythonHave you ever wondered how to build a real-time chat that taps directly into a Large Language Model? Picture this: you type a question, and…
Theofilus Arifin·Nov 16, 2024Prompt Caching with Semantic Search and Named Entity Recognition (NER)Prompt caching is a vital optimization technique for reducing latency and improving the efficiency of Large Language Model (LLM) systems…