Hitesh Sharma

Production AI engineering: reliable agents, efficient inference, and research implemented and tested.

I'm a software engineer focused on how AI systems behave beyond the demo. I write about agent execution, inference performance, and the engineering trade-offs behind research ideas.

Currently

Local inference performance, reliable agent execution, and practical implementations of research papers.

Selected writing

Recent writing

All articles

Selected implementation

LLM inference on real hardware

A local benchmark harness for measuring latency, throughput, failures, and goodput.