OpenAI CEO Sam Altman announced that his company has reached an agreement with the Department of Defense, allowing the Pentagon to use its AI models in the department's classified network.
According to Altman, the agreement includes protections addressing issues such as domestic mass surveillance and human responsibility for the use of force, including for autonomous weapon systems. OpenAI will build technical safeguards to ensure its models behave as intended.
The deal comes after a high-profile standoff between the DoD and OpenAI's rival, Anthropic, which had sought to draw a red line around mass domestic surveillance and fully autonomous weapons. More than 60 OpenAI employees and 300 Google employees had signed an open letter supporting Anthropic's position.
The Funding Context
While the exact terms of the deal were not disclosed, Altman said that OpenAI will deploy engineers with the Pentagon to help with its models and ensure their safety. He also expressed his desire to see things de-escalate away from legal and governmental actions and towards reasonable agreements.
Fortune's Sharon Goldman reports that Altman told OpenAI employees that the government will allow the company to build its own 'safety stack' to prevent misuse, and that if the model refuses to do a task, the government would not force OpenAI to make it do that task.
Market Implications
The agreement between OpenAI and the Pentagon may have significant implications for the AI industry, particularly in the area of defense contracting. As reported by TechCrunch, Anthropic had previously been designated as a supply-chain risk by the DoD, and the company has vowed to challenge this designation in court.
OpenAI's deal with the Pentagon may set a new precedent for AI companies working with the government, with a focus on building in technical safeguards to prevent misuse. As the AI industry continues to evolve, it will be important to watch how these developments unfold and what they mean for the future of AI in defense and beyond.
