Work Experience

My professional journey and experience

MegaLLM

Backend Engineer

Nov 2025 - June 2026
  • Sole engineer on the MegaLLM backend — a production OpenAI/Anthropic-compatible API gateway in front of 70+ LLMs on Hono + Bun + TypeScript with MongoDB, Redis, Kafka, and ClickHouse.
  • Designed a 3-tier cache (in-memory LRU → Redis → MongoDB) hitting >95% L0 hit rate at ~2–4ms, plus intelligent model routing with a MobileBERT classifier and 429/5xx fallback chains.
  • Shipped Stripe + Razorpay + OxaPay billing with idempotent webhooks, organization wallets, and ClickHouse credit-event streaming for usage correlation.
  • Hardened the platform with JWT + Redis blacklist, prefix-lookup API keys, 3-tier admin RBAC, and full Prometheus/OpenTelemetry/Grafana Loki observability.
megallm.io

Surf

Co-Founder & Chief AI Engineer

Dec 2025 - Jan 2026
  • Co-founded and engineered an AI-powered meeting platform with real-time transcription and multilingual translation
  • Designed low-latency AI services using Python, FastAPI, and WebSockets for real-time audio streaming
  • Improved transcription stability through streaming optimizations and async processing pipelines
staging.shonen.live