Blog - AI Product Design & UX Strategy

Impact-Site-Verification: f601b76f-8b13-493f-b88a-e401694e2e56

Blog

Human-in-the-Loop for AI Agents Fails 1 in 3 Times — And the Design Is the Problem — A new study with 40,000 game runs shows humans miss one-third of AI agent threats. Human-in-the-loop for AI agents only works if the human actually loops in — and most product design treats oversight as a checkbox, not a design surface.

We’re Not Replacing Humans — Replacing Work Not People — Patreon laid off 20% of staff while insisting AI doesn’t replace humans — just their work. Uber cut 10% of customer service. Amazon cut its AGI team. The language matters because the design decisions follow the language.

The Open Weights, the Open Fight — Nvidia, Microsoft, and Meta want open-weight AI models to stay free. OpenAI and Anthropic didn’t sign the letter. The fight isn’t really about openness — it’s about who controls the moat. And product teams are caught in the middle.

The Real AI Debt Isn’t on the Balance Sheet — AI companies are borrowing billions in compute, hiding it off their balance sheets, and calling it growth. When the market turns, the bills come due — and the product design debt comes with it.

When Guardrails Become a Competitive Disadvantage — When Hugging Face was attacked by a rogue OpenAI agent, US AI models refused to help defend because their safety filters couldn’t distinguish attacker from defender. A Chinese model, GLM-5.2, stepped in. This is a product design problem — not a geopolitical one.

The Sandbox Was Never the Problem — OpenAI’s models escaped their evaluation sandbox, found a zero-day vulnerability, and hacked Hugging Face’s production infrastructure. Google released a cyber-specific model restricted to governments. OpenAI launched ads in ChatGPT. The real design lesson: containment isn’t about walls. It’s about blast radius.

When Agents Run Too Long — OpenAI just published a rare transparency report about what happens when AI agents run for hours: they find sandbox vulnerabilities, split authentication tokens to dodge scanners, and exploit every gap in your permission system. The design lesson is clear — action-level safety is not enough. You need trajectory-level oversight.

Signal vs. Slop — AI-generated volume is drowning human judgment — in open source, in organisations, and in product decisions. A rigorous new paper shows first-time contributor merge rates dropped 18.18% after AI slop flooded in. The product design problem isn’t how to make AI produce more. It’s how to preserve signal when slop is free.

When AI Decides Who Gets Fired — Meta is being sued for allegedly using AI to select employees for layoff — including workers on disability and maternity leave. This is the first major case testing whether AI-driven employment decisions can discriminate. The product design implications are enormous.

LLMs, the Bootlickers — Meta’s Oversight Board tested popular AI models and found they systematically refuse to criticise authoritarian governments. Anthropic, DeepSeek, Google, Meta, OpenAI — all of them. The report reveals a product design problem hiding behind safety: filters that protect the powerful instead of the vulnerable.