Vishnu Senthil
ML / AI Platform Engineer (SR II) ยท Rustacean
MSc Operations Research, The Ohio State University
I'm a Senior Engineer on the AI platform team. I build and look after the platform and AI stack our data scientists and engineers build on, from the LLM gateway and observability to agent memory, evals, and Rust platform services. I came up through Target Last Mile Delivery, where I shipped the first model to automate surge pay for last mile delivery into production and rebuilt the package detection behind proof of delivery.
Off the clock, I'm slowly self-hosting my whole life, from the network at home to an in-house memory service shared by coding agents and local agents. I think hyper-personalized software is where things are headed.
// the feed
Selected Stack
What I ship on the clock, and what I build off it.
Feature Store
The shared feature store our ML services read from. Rewrote it from Python to Rust with HTTP and gRPC, halving latency and making it self-service, so it could scale to wide adoption.
- Rust
- gRPC
- Tokio
- Bigtable
- Snowflake
- Kafka
Remora Memory Service
A self-hosted Rust memory service for coding agents and local agents, built because existing OSS memory tools did not fit my namespace and control needs.
- Rust
- MCP
- Axum
- SQLite FTS5
- Qdrant
- ONNX
Langfuse Eval Observability
The trace and eval plane that turns LLM apps from a black box into something teams can trust. I self-hosted Langfuse on a fault-tolerant ClickHouse cluster, with CI-style quality gates for agents.
- Langfuse
- ClickHouse
- ClickHouse Keeper
- Postgres
- Valkey
- GCS
- FastAPI
- Promptfoo
Agent Memory Platform
The durable memory and task layer for our agent stack. A Rust service that speaks gRPC and HTTP over Postgres, with Python clients that give Google ADK, A2A, and LangGraph agents drop-in durable sessions and tasks.
- Rust
- gRPC
- Protobuf
- Postgres
- Python
- Google ADK
OpsML & Scouter
The ML lifecycle and monitoring stack our teams build on. I own and harden our internal builds of OpsML and Scouter and wire them into the platform.
- Rust
- PyO3
- OpenTelemetry
- Kafka
- Postgres
Surge Pay Automation
The service that put surge pay on autopilot for last mile delivery. A realtime, market-aware Keras model served async over FastAPI, built on the learnings of an earlier offline version.
- Keras + JAX
- Polars
- FastAPI
- Feature store
- GPU
MLflow Registry
The one registry the whole company tracks experiments and ships models on. I run it as production infrastructure, backed by Cloud SQL and GCS, and make the operational calls that keep it boring.
- MLflow
- Cloud SQL
- GCS
- Datadog
- Prometheus
- Harness
Route Agent
A production route operations assistant I designed and built end to end, with 8 validated tool actions and full Datadog and Langfuse traces.
- Google ADK
- AG-UI
- A2A
- MCP
- Langfuse
- Datadog
Speech-to-Text Serving
Self-hosted speech to text in Rust on whisper.cpp. Runs Whisper on our own boxes, faster and lighter than the Python version, with no per-minute bill and no audio leaving our walls.
- Rust
- whisper.cpp
- Symphonia
- Axum
- Tokio
Homelab
A self-hosted experimentation platform where I try bleeding-edge tools and new methodologies on real infrastructure, from the network edge to GPU compute.
- Self-hosted
- Network segmentation
- Clustered compute
- SSO
- LLM gateway
- Remora
Geocode Correction Launch
Helped launch geocode correction for Target Last Mile by showing corrected pins matched delivery evidence and sizing the annual orders exposed to bad source coordinates.
- Geospatial analysis
- PoD validation
- SQL
- Launch analytics
- Target Last Mile
Lobsterbox + Lobsterfleet
A self-hosted Rust remote-dev stack. Lobsterbox leases Docker or Hetzner runners, and lobsterfleet drives them from the browser with terminals, VNC desktops, and Codex-ready boxes.
- Rust
- Axum
- Yew/WASM
- SQLite
- Hetzner
- Docker
Proof of Delivery Vision
Rebuilt the package detection behind proof of delivery: off YOLO onto a recall-first Mask R-CNN, with a SAM2-powered Label Studio pipeline for labeling and evaluation.
- Mask R-CNN
- PyTorch
- SAM2
- Label Studio
- FastAPI
- GPU
Insights Dashboard
The first visual operations platform for Target Last Mile. It gave operators one place to see pay, store coverage, delivery surge, and order density across markets.
- Python
- Streamlit
- Plotly
- Snowflake
- H3
- Redis
- GCP
LLM Gateway
The single door teams use to reach LLMs. I helped grow it from a solid proxy into a platform-grade gateway with audit logging, guardrails, budgets, batch, and multi-modal support.
- LiteLLM
- Python
- Kafka
- Snowflake
- GCS