Eight modules of admin control for the responsible AI platform that won a Webby Award.

AI is moving fast, but accountability infrastructure is not. hitl.sh is building the tooling that lets development teams pause AI decisions mid-flight and route them to human reviewers before outputs reach end users. To operate that platform reliably, they needed their own internal control plane — a single authenticated surface where the team could see everything happening across all users, loops, and requests in real time.

The platform serves startups, enterprises, and teams running agents in regulated industries — each on different billing tiers with different data residency requirements. Managing users, their API keys, their subscription status, and per-user storage regions (US and EU) from one coherent admin interface required careful design. A generic dashboard would not reflect the seriousness of the product.

Responsible AI means accountability at the operator level too. Every admin action needed an audit log. Support tickets needed internal-only notes and priority tiers. Customer communications needed to reach segmented audiences with delivery tracking. These modules are unglamorous — but for a platform whose entire value proposition is oversight, skipping them would be a contradiction.

The hitl.sh team can see every AI decision flowing through their platform from a single screen. The live request feed updates every 5 seconds, surfacing pending, processing, completed, failed, and cancelled requests on a card grid — each drillable to its full payload and response. Admins toggle between live auto-refresh and manual review without losing their place. The control plane covers every user, every loop, and every decision that has ever touched the platform.

Account management is granular and immediate. Users and loops are searchable by status and data region. Each API key carries its own permission level, rate limit, and usage counter — and revokes instantly. Billing surfaces each user's Stripe tier, invoice history, and cancellation flags without leaving the control plane. US and EU data regions are per-user, with isolation enforced at the data layer.

Every admin action writes an audit log entry: who did what, from which IP, with which user agent, at what time — nothing undoable without a trace. The email campaign module lets the team compose HTML emails, segment recipients by audience, send through Resend, and track delivery per address (delivered, bounced, opened, clicked) from the same surface. The platform won a 2025 Webby Award for Best Responsible AI.