Everything here has a run behind it.

scribe-bench: when ROUGE goes up and the notes get worse

An open benchmark for ambient clinical documentation: seven speech recognizers, note generation, a LoRA fine-tune and a claim-level verifier, on open mock consultations.

When the lip-sync score picked the worse take

Measurement gates for AI-generated video: why ranking takes on SyncNet alone rewarded mouth noise, and the tiered suite that now checks every render.

coding-agent-bench

82 scored runs of local models and agent harnesses on a fixed task set, and the grading bugs that had to be fixed before any number meant anything.

From benchmark to a live visit copilot

The scribe-bench pipeline turned into a live copilot that listens to a visit, suggests questions, and drafts a cited note and EHR fields for review. Measured on synthetic visits only.

Synthetic visits only; no real patients.

Serving 100B+ open models on two workstation GPUs

NVFP4 and FP8, expert offload and speculative decoding on 2× RTX PRO 6000 Blackwell and a Mac Studio, with the traps written down. Three public recipe repos.

A game tuned by AI playtesters

A Handful, a VR physics game, went through 21 revisions scored each round by cold-play AI tester panels and scripted bots. The panel plateaued short of its target, and we say so.

Refusal ablation, measured

Refusal-direction ablation on a mixture-of-experts model with a matched benign set and a capability gate, plus an A/B of a community “abliterated” upload.

Confidential Research Platform

A local, encrypted AI assistant with private search over Tor or your own VPN, tested end to end from clean installs with packet captures.

Cue

A mixtape app for iPhone and an open engine that finds where each song starts inside a DJ mix, scored against DJ-published timestamps.

AutoTalent

Agentic recruiting: candidate search agents, MCP integrations, and workflows for outreach and pipeline management, with recruiters in control of decisions.

Dr. Grey AI

An evidence-focused research tool for exploring supplements, clinical studies and health topics, with evidence grading.

ElmoSEO

An SEO service for the age of AI search. Live, with paying customers.

Everdust

A physics-driven music visualizer and playground for Vision Pro, iPhone and Mac, where every world is a live simulation. The Lab pieces live here.

Create

Describe a world, get a playable simulation: a language model writes a recipe from registered physics primitives, and a validator checks it before it runs.