Writing
Notes on real-time systems, LLMs in production, and the things that break once real traffic arrives.
When Did You Learn That? Bi-Temporal Memory for LLM Assistants
Sept 2026 · 8 min read
A flat store of facts gets corrections, refinements and polite agreement all wrong. Separating when something was true from when the system learned it fixes most of it.
- LLM
- Memory
- Data Modelling
Two Rules for Evaluating LLM Memory Retrieval
Sept 2026 · 6 min read
Label blind, and treat contradiction as a gate rather than a term in the score. Recall and precision alone will let a system buy recall with wrong facts.
- Evaluation
- LLM
- Retrieval
Both Folds Chose Zero: Fitting Rank Fusion Weights Instead of Guessing Them
Sept 2026 · 6 min read
Hand-tuned boosts and Reciprocal Rank Fusion are the usual answers for combining retrieval branches. Fitted on held-out data, both lost to plain cosine similarity.
- Retrieval
- Evaluation
- LLM
A Pre-Filter Was Capping My Recall at 65%
Sept 2026 · 7 min read
No amount of tuning top-k or thresholds moved it, because a third of the right answers were never candidates in the first place. How to tell a candidate-generation failure from a ranking failure.
- Retrieval
- LLM
- Evaluation
Every Call Died at Exactly Ten Minutes
Sept 2026 · 8 min read
The dashboards were green because the system was logging its own failure as a user hangup. The cause was one timer, shared where it should have been per-channel.
- WebRTC
- Debugging
- Real-Time
My First Month at Mynaksh: Two Things Nobody Asked Me to Fix
May 2026 · 10 min read
I joined as a senior engineer. In my first month I rewrote the data layer and built a versioned deploy system. Neither was on my JD. Here's why I did them anyway.
- React Native
- TanStack
- DevOps
An AI On-Call Engineer: Multi-Phase Triage with Grafana and GitHub MCPs
May 2026 · 8 min read
When a microservice goes down at 3am, the slow part isn't fixing it — it's figuring out which service is actually broken. We built an LLM agent that does the triage.
- Agents
- MCP
- On-Call
- Observability
Wallet Reservations at the Redis Layer: How We Stopped Double-Billing Users
May 2026 · 7 min read
When users pay per minute for a call, the wallet is on the critical path. Here's how we used Redis-level reservations and locks to prevent double-billing and negative balances.
- Redis
- Distributed Systems
- Payments
Building an AI Astrologer: Personas, Rolling Summaries, and Tone-Matched Replies
Apr 2026 · 8 min read
An LLM that does astrology readings sounds like a gimmick. Building one that feels like a different astrologer for every user is a real engineering problem.
- LLM
- Personalization
- Product
Building a Real-Time Calls Feature on CometChat: What Actually Hurts
Apr 2026 · 9 min read
Two React Native apps, one CometChat SDK, and a long list of edge cases. Here's what we learned shipping live consultations between users and astrologers.
- Real-Time
- React Native
- CometChat
Healthcare AI to Consumer AI: What Changes When the Stakes Drop
Apr 2026 · 7 min read
Six weeks ago I was building systems where a 2% error rate meant 2,400 patients got denied care. Today I'm building astrology consultations. Here's what that switch actually feels like.
- Career
- AI
- Consumer Tech
Building Healthcare AI at Scale: Lessons from the Trenches
Mar 2025 · 8 min read
The messy, complex, and rewarding reality of building AI systems that process 120k+ medical procedures daily.
- AI/ML
- Healthcare
- Engineering
From Startup Founder to Healthcare AI Engineer: My Journey
Feb 2025 · 6 min read
How I transitioned from building a freelancing platform to revolutionizing healthcare automation with LLM technologies.
- Career
- Entrepreneurship
- AI
LLM Evaluation in Production: How We Hit 98% Accuracy
Jan 2025 · 12 min read
A deep dive into the code and concepts behind our 98% accurate medical data extraction pipeline.
- LLMs
- Evaluation
- Healthcare Tech
Serverless Architecture: The Hard Lessons
Dec 2024 · 10 min read
Everyone told us not to use serverless for a production startup. We did it anyway. Here is what broke, and how we fixed it.
- AWS
- Serverless
- Architecture