Varindra Persad Maharaj
Former Amazon SDE & Founding Engineer
Open to contract / fractional engineering workAbout
I specialize in backend and infrastructure systems, like the tooling agents use and the platforms models get deployed and served through. Before that, I was a founding engineer at Octavian Software.
Open to part-time contract / fractional engineering work.
Recent Work
- Designed the core tool-orchestration infrastructure behind an internal agent platform running millions of daily agent runs, automating policy decisions that previously required manual review.
- Built LLM-based infrastructure that took a manual review process from days down to near-instant turnaround across a multi-billion dollar marketplace, working alongside applied scientists.
- Built a unified model evaluation and deployment framework, scaling inference across a product catalog of over a billion items under strict latency and reliability requirements.
- Implemented distributed training internals from scratch, including parameter sharding across GPUs and custom Transformer primitives, to fit large models that wouldn't otherwise fit on available hardware. (personal project)
Technical Focus
LLM Serving & Deployment
Model Context Protocol (MCP)
Agentic Workflows & Tool Orchestration
Model Evaluation & Eval Harnesses
PyTorch
Python
C++
Go
Java
React
AWS
Temporal
Docker
Microservices
Also Exploring
Lately, I've been spending some spare time digging into lower-level ML systems like CUDA kernels and NCCL.
Publications & Patents
- IEEE Access (2025) — co-author, "The AI Cognitive Examination: Multimodal Evaluation." [link]
- Patent pending (USPTO) — a system for on-demand, automated distribution of physical assets.