Anthropic keeps ethics top of the AI agenda

The advancement of AI into all aspects of our lives is accelerating, throwing up a wide variety of issues – from actors demanding legislation to prevent AI voice cloning, OpenAI’s models going rogue and hacking Hugging Face – who are to be acquired for $12.9Bn by Nvidia, who in turn are predicting revenues of $108Bn next quarter, up 100% from twelve months ago. With around 40% of the US stock market concentrated in ten companies heavily invested in AI, Nvidia’s fortunes matter far beyond Silicon Valley.

Meanwhile, Amazon is facing legal action over its move to train its AI models on videos people broadcast on the streaming platform Twitch, and Thursday saw the US court verdict on one aspect of the the Anthropic v US Government legal dispute. I’ve been tracking this dispute for six months, and here’s why it matters to us all.

In early 2026, Anthropic found itself in a standoff with the Pentagon. The confrontation goes back to contract negotiations with the Department of Defence over the use of its Claude AI models. Anthropic held firm on two conditions it would not waive:

  • It would not permit Claude to be used for mass surveillance of Americans;
  • It would not allow the model to power fully autonomous weapons systems.

Defence Secretary Pete Hegseth pushed back, arguing that the military needed unrestricted access to the tech it was paying for, and that no contractor should be able to dictate how they use their tools. When talks collapsed, the dispute escalated sharply. On February 27, President Trump issued a directive ordering every federal agency to stop using Anthropic’s technology, and the Department of Defence went further, formally designating Anthropic a supply chain risk, a label reserved for firms tied to adversarial foreign governments.

The designation required all defence contractors to certify they did not use Claude in their work with the department, effectively locking Anthropic out of the federal AI market. Anthropic characterised this as retaliation, not a legitimate security judgment, and said the government was trying to punish the company for its public advocacy around AI safety.

Anthropic filed actions in two separate courts because the government had used two different legal authorities against it. A civil complaint went to the District Court in California, challenging the presidential directive, a companion directive from Hegseth, and a related risk designation on constitutional and administrative law grounds. A second, parallel petition went to the D.C. Circuit Court of Appeals, the venue required for challenges to the specific supply-chain designation issued under the Federal Acquisition Supply Chain Security Act (‘FASCSA’).

On March 26, Judge Rita Lin granted Anthropic a preliminary injunction in California, finding the company was likely to succeed on three independent legal theories: 

  • The designation amounted to unlawful First Amendment retaliation;
  • It violated the company’s due-process rights under the Fifth Amendment;
  • The government’s actions were arbitrary and capricious.

During the hearing, Lin was blunt about her read of the government’s motives, remarking that the action looked like an attempt to cripple Anthropic, and she voiced concern that the administration may have been punishing the company for speaking out. The injunction restored the status quo that existed before the February directive, but the government did not accept the loss. It appealed, and separately, asked for emergency relief blocking the FASCSA designation while that case proceeded. 

The action was declined, ruling in April that Anthropic had not met the demanding standard required for a stay, though it acknowledged the company would likely suffer some harm. That left an unusual split: the presidential directive and one designation were blocked in California, while the separate FASCSA designation stayed in place pending the D.C. Circuit’s review of the underlying merits, which it heard in May.

The case reached its most consequential milestone last Thursday, with a 59-page ruling resolving the merits of the California case in a final determination. This removed the supply-chain risk designation outright and found that the Department of Defence had violated both the First Amendment and the Due Process Clause of the Fifth Amendment.

Judge Lin’s opinion was that the government’s stated justification — that it could no longer trust Anthropic — did not hold up. She emphasised that while the military is owed real deference on national security judgments, that deference is not unlimited, and that neither the Constitution nor the statute the government invoked permits penalties imposed principally because a company criticised the administration’s views. 

The government is expected to appeal, and the separate D.C. Circuit case over the FASCSA designation remains pending, meaning the legal saga is not fully closed even after this decisive defeat for the Pentagon. For Anthropic, the ruling removes a cloud that had been hanging over them for six months. The supply-chain risk label did not just cut off direct Pentagon contracts, it created downstream uncertainty for every private company and government contractor that used Claude, since they risked being drawn into scrutiny simply for doing business with a blacklisted vendor. 

With the designation removed, Anthropic can reference a court verdict that validates its safety-driven contracting decisions which clears the way to rebuild its relationship with federal agencies.  The timing is also notable as Anthropic is considering an IPO.

The ruling has impact for the broader AI sector. It establishes a legal precedent that a company’s public safety commitments and its refusal to relax them under government pressure are protected activity, not grounds for retaliatory blacklisting. Other AI companies weighing whether to accept government usage restrictions now have a detailed judicial opinion to point to if they face similar pressure. 

The prolonged uncertainty during the litigation, with one federal court blocking parts of the designation while a different circuit left another part in place, illustrates how unsettled the legal framework is for AI, an ambiguity that is likely to prompt calls for clearer statutory and regulatory guidance.

For the public, the dispute is arguably as significant as the legal outcome. At its core, this was a fight over whether the U.S. military should have unrestricted access to deploy an AI model in fully autonomous weapons systems and in mass surveillance, or whether a company can enforce its own guardrails against those uses. Anthropic’s position effectively preserved a private check on how sophisticated AI systems can be integrated into lethal and surveillance applications, rather than leaving those decisions entirely to government discretion.

The underlying legal questions are likely to keep generating litigation for months to come. For now, the August 27 decision offers a clear legal marker for how far federal agencies can push private AI developers before running into constitutional limits. On a broader perspective, the ethical debate has moved out of philosophical musings into public policy, economic planning, and everyday life.

As AI evolves from passive prediction engines into autonomous agents capable of execution and reasoning, humanity faces an inflection point. The central ethical debate surrounding AI development and adoption centres on five core tension points: 

1. Algorithmic bias: AI models do not generate decisions in a vacuum, they reflect and amplify any historical biases embedded within their training datasets. Biased models deployed in healthcare, criminal justice, or credit allocation for example, disproportionately disadvantage historically marginalized demographics. This creates a ‘black box’ problem, in that when an automated model denies someone a mortgage or misdiagnoses a medical condition, the lack of explainability compromises due process and accountability. Meanwhile, dominant Western-centric datasets threaten to erase indigenous cultural perspectives, imposing a standardised worldview.

2. Economic impact. Unlike previous technological revolutions that automated labour, AI is servicing a broader realm of knowledge work. The speed of AI integration is rapid, and roles across software engineering, legal, finance, customer support, and media are undergoing rapid restructuring, without us having thought through the impact or response to workplace displacement, and more fundamental questions about how societies will define purpose, worth, and economic security.

Economic value is increasingly shifting away from human labour and toward owners of capital, compute infrastructure, and proprietary model weights. Without government intervention, AI risks widening economic inequality across global markets.

3. Truth decay. The democratisation of generative audio, video, and text generation tools has eroded the previous shared reality, hyper-realistic synthetic media enables mass scale disinformation campaigns that can destabilise democracy, manipulate financial markets, and ruin personal reputations. As deepfakes proliferate, bad actors exploit public skepticism by dismissing genuine footage, evidence, or journalism as AI-generated, undermining public trust and confidence.

4. Privacy. The massive data pipelines required to train and refine AI models pose severe challenges to privacy, models scraping personal data, eroding digital privacy and personal consent. The loss of human agency is driven by AI agents executing actions across by APIs without direct human review.

5. Existential safety. As AI approaches frontier-level capabilities, the ethical debate extends to physical safety and national security risks. Concern over cyber security is high, integrating AI decision loops introduces the moral hazard of delegating life-and-death choices to software. As systems gain greater autonomy, ensuring that agents remain aligned with human safety, intent, and welfare stands as an unresolved technical and philosophical challenge.

Summary: The debate over AI adoption pits two philosophies against each other:

  • Risk based regulation: Championed by frameworks like the European Union’s AI Act, establishing clear guardrails, transparency mandates, and bans on unacceptable practices prior to deployment.
  • Innovation first approach: Focused on preserving innovation, this perspective argues that preemptive regulations stifle growth and that ethical risks should be addressed iteratively through market forces and technical patches.

Hopefully the smart people who have the reins and influence can navigate the path forward, but safety cannot be an afterthought. Building ethical AI requires deliberate action: auditing training data for fairness, enforcing transparency standards, establishing public accountability, and prioritising human welfare over pure technology capability scaling. As we await the next instalment of Anthropic v US Government, to say we live in interesting times is an understatement.

get in touch today

Contact us