Skip to content

Work

LLM systems that are measured, gated and safe to ship

Four public repos in the order I'd read them, then paid client work and earlier projects. Each number comes from the repo's README Results table, which links to its source file, and each README keeps a Methodology & limits section.

DocExtract fixture explorer showing stored invoice fields and labeled sample confidence.

01 · Ship it · Measure it

DocExtract

Turns PDFs and scans into validated, searchable records, with an extraction eval that runs as a CI check.

95.5% weighted field-level score on a 28-fixture offline replay; the CI check fails below a 0.85 floor.

FastAPIClaudepgvectorRedis + ARQAgentic RAG

Try it locally, no API key

python scripts/eval_offline_replay.py --floor 0.85
Diagram: untrusted tool output reaches inline XML dispatch and leads to canary exfiltration; substrate_auditor flags the substrate, and typed dispatch is the recommended fix.

02 · Secure it

ai-redteam-notes

Pre-registered research on indirect prompt injection through agent tool output, turned into a CI-ready auditor.

With a content-trust prompt scaffold in place, one payload variant still exfiltrated a canary in 10 of 10 runs on Groq-hosted Llama-3.3-70B (one provider, n=10). The recommended fix is in tool dispatch rather than the prompt; it has not been measured at 70B.

PythonMCP harnessesPre-registrationCI gate

Try it locally, no API key

make repro
Library map: tool logic surrounded by auth, per-caller rate limits, cache, cost attribution and OpenTelemetry.

03 · Secure it

mcp-server-toolkit

A library of opt-in decorators that wrap MCP tool logic with auth, a read-only SQL allowlist, caching, rate limits and tracing.

JWT/JWKS auth, a sqlglot read-only SQL allowlist and OpenTelemetry spans, with 627 collected tests.

PythonMCP SDKPyJWTsqlglotOpenTelemetry

Try it locally, no API key

pip install -e ".[dev]" && python examples/verified_cache.py
Receipt: GOOD passes the eval gate, MUTATION fails it, an unapproved write is denied and a duplicate retry is suppressed.

04 · Measure it

llm-reviewer-path

A 10-minute runnable code sample: eval gates, approval-bound writes and idempotent retries.

36 offline tests, no API key. A mutated label set fails the eval gate, and a duplicate retry is suppressed.

PythonpytestuvGitHub Actions

Try it locally, no API key

uv sync --group dev && uv run pytest
Paid client deployment Jan to Mar 2026

Acuity Real Estate

SMS lead qualification inside GoHighLevel, with Spanish detection and a bilingual human handoff. Client-reported 500+ inbound leads.

FastAPIRedisGoHighLevelHuman handoff
Private client work · 2025 to 2026

EnterpriseHub

Paid AI application work for a confidential client. The repository is private; an authorized walkthrough is available on request.

Request a walkthrough →

Also built

AI Workflow API

YAML-driven workflow automation backend with async job processing and SSE streaming.

FastAPIARQRedisSSE
Code →

Chatbot Widget

Drop-in AI chat widget with a single script tag: RAG over pgvector, WebSocket streaming and Shadow DOM isolation.

FastAPIpgvectorWebSocket
Code →

GraphRAG Demo

Knowledge-graph retrieval for multi-hop questions, with a no-API-key BM25 mode and a side-by-side comparison against basic RAG.

NetworkXspaCyStreamlit
Code →

Contact

Open to full-time AI Engineer roles

US remote. Applied AI, AI backend and LLM platform teams.