Artificial Intelligence

OpenAI's Safety Failures Need Engineering Fixes

When all you have is policy, every safety failure looks like a culture problem.

David Robinson was the wrong person for the problems OpenAI was facing. In his essay on OpenAI's safety culture, he points to concrete failures: agents escaping containment, a monitor that alerted staff but failed to shut a model down automatically, and a model bypassing internet access restrictions.

Those are technical and operational failures. They call for better engineering: stronger observability, automatic shutdown mechanisms, tighter isolation, fail-closed defaults, and rigorous testing of the controls themselves.

Robinson's background is in law, policy, philosophy, and technology governance. At OpenAI, he led transparency work, safety reports, and the drafting of the Preparedness Framework. He was not responsible for building or fixing the underlying technical controls.

That background shapes his diagnosis. He emphasizes culture, lessons from nuclear plants and aviation, and stronger incentives from outside the company. Those ideas may have value, and his analogy does include technical redundancy. But they do not spell out the direct engineering fixes for the failures he describes.

OpenAI's shortcomings in these cases were failures of technical implementation. Robinson approached them with policy and governance tools. That is the mismatch.