The ongoing feud between Anthropic, an AI startup, and the US Department of Defense has brought to the forefront the ethical implications of using artificial intelligence in warfare. As reported by The Guardian, the dispute revolves around Anthropic's refusal to allow the federal government to use its Claude AI model for domestic mass surveillance or autonomous weapons systems. This feud has significant implications for the tech industry and the government's power to coerce companies to meet its demands.
Sarah Kreps, a professor and director of the Tech Policy Institute at Cornell University, who previously served in the United States air force, shared her insights on the matter. Kreps has worked on problems related to dual-use technology, which refers to consumer technology that also gets used for classified or military purposes. According to Kreps, the challenge for the military is that these technologies are so useful that they cannot wait until a military-grade version is available, but it's not surprising that they ran into cultural differences with Anthropic, which has tried to cultivate a reputation as a safety-forward company.
Anthropic's decision to sign a deal with the military was surprising, given its brand as a safety-conscious company. However, the company drew a red line at domestic mass surveillance and lethal autonomous weapons. Kreps suggests that the feud may be related to relationships between Anthropic and the Trump administration, which led to a downward spiral of distrust. Additionally, the situation in Venezuela and the politics around ICE activities raise questions about what it means to use these technologies lawfully.
The Role of Private Tech Companies in National Security
The Pentagon's argument is that if there's a national defense issue, they shouldn't have to call up Dario Amodei, Anthropic's CEO, to get approval. This raises questions about the role of private tech companies in national security decision-making. The case of the San Bernardino killer's iPhone, where Apple refused to create a backdoor to grant the FBI access, highlights the difference between hardware and software. Once Anthropic's AI is handed over to the military, the company no longer has control over how it's used, and the software can be repurposed in ways that may not have been part of the explicit agreement.
Kreps notes that the difference between hardware and software is crucial. With hardware, like the iPhone, once Apple refused to create a backdoor, the FBI had to seek out an independent third party to hack into the device. However, with software like Anthropic's AI, once it's handed over to the military, Anthropic loses all its leverage, and the software can be used in ways that maybe weren't part of the explicit agreement, justified on the basis of national security.
AI in Warfare: Current Uses and Future Concerns
Kreps has been following the issues of AI use in the military for a long time and finds it interesting that longstanding questions are coming to a head. The CEO of Anthropic has talked about existential risks and the misappropriation of AI for bioterrorism, but Kreps thinks that more mundane cases, like the current feud, are more of a risk. The use of autonomous weapons raises concerns about how to ensure that there's a human in the loop, and the US claims that it will not use AI in a fully autonomous capacity, but it's not clear what that process looks like.
AI is already being used in warfare, particularly in military settings where it can help identify patterns and connect the dots. Kreps notes that AI is good at pattern recognition and can identify targets based on programmed characteristics. However, the use of AI in counter-terrorism strikes raises more concerns, as it can be precarious to identify individuals on the ground, and there's a risk of misidentifying civilians as combatants.
Conclusion: The Future of AI in Warfare
The feud between Anthropic and the US military highlights the ethical implications of using AI in warfare. As the technology becomes more sophisticated, it's likely that we'll see more conflicts like this in the future. The question of what role private tech companies should play in national security decision-making remains unanswered. Kreps' insights provide a nuanced understanding of the complex issues at play, and it's clear that the use of AI in warfare will continue to be a topic of debate and discussion in the years to come.
