Vishnu Senthil
Senior ML / AI Platform Engineer ยท Rustacean
MSc Operations Research, The Ohio State University
I build and operate platforms for production AI. That includes the services behind model delivery and agent state, the evaluation work that helps explain their behavior, and the tools other engineers use to build on them.
I started in applied data science, taking models from training into live workflows. That experience still shapes my platform work. I care about what happens after a service ships and how easy it is for the next person to use.
Off the clock, I build software for my own use and run a homelab. Self-hosting gives me room to explore systems from the network up to the applications.
// the feed
Selected Work
A few problems I have worked on across AI infrastructure and production ML.
Reliable AI Access
Shared access to AI models, with attention to failures, usage, and the cost of keeping it running.
- Python
- API design
- Reliability
Low-Latency Feature Serving
Rebuilt a shared feature service in Rust and made it easier for model teams to adopt.
- Rust
- Async systems
- Performance
Durable State for AI Agents
Shared persistence for agent sessions and tasks, with ongoing work on durable memory and retrieval.
- Rust
- Python
- API contracts
Evaluated Knowledge Retrieval
Built a retrieval assistant for technical knowledge and evaluated how well its answers stayed grounded in the source.
- Retrieval
- Evaluation
- Python
Model Lifecycle Modernization
Operated shared model infrastructure and built migration tooling that checks artifacts, metadata, and prediction behavior.
- Python
- Model validation
- Migration tooling
Tool-Using Operations Assistant
Built an operations assistant with guarded actions, persistent state, and traces across the request flow.
- Python
- Tool interfaces
- Evaluation
Off the clock
Personal software and the infrastructure I run at home.
Remora Memory Service
A self-hosted Rust memory service for coding agents and local agents, built because existing OSS memory tools did not fit my namespace and control needs.
- Rust
- MCP
- Axum
- SQLite FTS5
- Qdrant
- ONNX
Lobsterbox + Lobsterfleet
A self-hosted Rust remote-dev stack. Lobsterbox leases Docker or Hetzner runners, and lobsterfleet drives them from the browser with terminals, VNC desktops, and Codex-ready boxes.
- Rust
- Axum
- Yew/WASM
- SQLite
- Hetzner
- Docker
Homelab
A self-hosted experimentation platform where I try bleeding-edge tools and new methodologies on real infrastructure, from the network edge to GPU compute.
- Self-hosted
- Network segmentation
- Clustered compute
- SSO
- LLM gateway
- Remora