Writing

Notes on real-time systems, LLMs in production, and the things that break once real traffic arrives.

  1. When Did You Learn That? Bi-Temporal Memory for LLM Assistants

    Sept 2026 · 8 min read

    A flat store of facts gets corrections, refinements and polite agreement all wrong. Separating when something was true from when the system learned it fixes most of it.

    • LLM
    • Memory
    • Data Modelling
  2. Two Rules for Evaluating LLM Memory Retrieval

    Sept 2026 · 6 min read

    Label blind, and treat contradiction as a gate rather than a term in the score. Recall and precision alone will let a system buy recall with wrong facts.

    • Evaluation
    • LLM
    • Retrieval
  3. Both Folds Chose Zero: Fitting Rank Fusion Weights Instead of Guessing Them

    Sept 2026 · 6 min read

    Hand-tuned boosts and Reciprocal Rank Fusion are the usual answers for combining retrieval branches. Fitted on held-out data, both lost to plain cosine similarity.

    • Retrieval
    • Evaluation
    • LLM
  4. A Pre-Filter Was Capping My Recall at 65%

    Sept 2026 · 7 min read

    No amount of tuning top-k or thresholds moved it, because a third of the right answers were never candidates in the first place. How to tell a candidate-generation failure from a ranking failure.

    • Retrieval
    • LLM
    • Evaluation
  5. Every Call Died at Exactly Ten Minutes

    Sept 2026 · 8 min read

    The dashboards were green because the system was logging its own failure as a user hangup. The cause was one timer, shared where it should have been per-channel.

    • WebRTC
    • Debugging
    • Real-Time
  6. My First Month at Mynaksh: Two Things Nobody Asked Me to Fix

    May 2026 · 10 min read

    I joined as a senior engineer. In my first month I rewrote the data layer and built a versioned deploy system. Neither was on my JD. Here's why I did them anyway.

    • React Native
    • TanStack
    • DevOps
  7. An AI On-Call Engineer: Multi-Phase Triage with Grafana and GitHub MCPs

    May 2026 · 8 min read

    When a microservice goes down at 3am, the slow part isn't fixing it — it's figuring out which service is actually broken. We built an LLM agent that does the triage.

    • Agents
    • MCP
    • On-Call
    • Observability
  8. Wallet Reservations at the Redis Layer: How We Stopped Double-Billing Users

    May 2026 · 7 min read

    When users pay per minute for a call, the wallet is on the critical path. Here's how we used Redis-level reservations and locks to prevent double-billing and negative balances.

    • Redis
    • Distributed Systems
    • Payments
  9. Building an AI Astrologer: Personas, Rolling Summaries, and Tone-Matched Replies

    Apr 2026 · 8 min read

    An LLM that does astrology readings sounds like a gimmick. Building one that feels like a different astrologer for every user is a real engineering problem.

    • LLM
    • Personalization
    • Product
  10. Building a Real-Time Calls Feature on CometChat: What Actually Hurts

    Apr 2026 · 9 min read

    Two React Native apps, one CometChat SDK, and a long list of edge cases. Here's what we learned shipping live consultations between users and astrologers.

    • Real-Time
    • React Native
    • CometChat
  11. Healthcare AI to Consumer AI: What Changes When the Stakes Drop

    Apr 2026 · 7 min read

    Six weeks ago I was building systems where a 2% error rate meant 2,400 patients got denied care. Today I'm building astrology consultations. Here's what that switch actually feels like.

    • Career
    • AI
    • Consumer Tech
  12. Building Healthcare AI at Scale: Lessons from the Trenches

    Mar 2025 · 8 min read

    The messy, complex, and rewarding reality of building AI systems that process 120k+ medical procedures daily.

    • AI/ML
    • Healthcare
    • Engineering
  13. From Startup Founder to Healthcare AI Engineer: My Journey

    Feb 2025 · 6 min read

    How I transitioned from building a freelancing platform to revolutionizing healthcare automation with LLM technologies.

    • Career
    • Entrepreneurship
    • AI
  14. LLM Evaluation in Production: How We Hit 98% Accuracy

    Jan 2025 · 12 min read

    A deep dive into the code and concepts behind our 98% accurate medical data extraction pipeline.

    • LLMs
    • Evaluation
    • Healthcare Tech
  15. Serverless Architecture: The Hard Lessons

    Dec 2024 · 10 min read

    Everyone told us not to use serverless for a production startup. We did it anyway. Here is what broke, and how we fixed it.

    • AWS
    • Serverless
    • Architecture