Skip to content
AI Article

Anthropic Was the Last Chip-Agnostic Lab. Not Anymore

A $485K job listing and exploratory Samsung talks won't dent Nvidia soon, but the inference economics behind them will.

Rachel Goldstein
Rachel Goldstein
Dev Tools Editor · Aug 7, 2026 · 5 min read
Anthropic Was the Last Chip-Agnostic Lab. Not Anymore

For three years, Anthropic ran the most promiscuous compute strategy in frontier AI: TPUs from Google, Trainium from Amazon, GPUs from Nvidia, all serving Claude at once, all bidding against each other. It was the last major lab that designed nothing and bought everything. That era ended on August 5, when the company confirmed to Business Insider that it's assembling a custom silicon team — "We work from the chip level up with our silicon partners, and we are now deepening that investment by building a custom silicon team," in Anthropic's words.

The confirmation arrived as a job listing, not a chip. Anthropic's Silicon Engineer posting ($320,000–$485,000) asks for experience across front-end design, pre-silicon verification, physical design, design-for-test, analog and mixed-signal, foundry technology, and packaging — essentially the entire ASIC discipline stack. When one listing spans everything from RTL to signal integrity, you're looking at a team that barely exists yet. The most concrete asset so far is a person: Clive Chan, the second hardware hire on OpenAI's chip program and a Tesla Dojo alum, who joined Anthropic in June. Add the report from The Information in early July that Anthropic is in exploratory talks with Samsung to manufacture the chip — reportedly eyeing Samsung's 2nm-class process — and the shape of the project is clear, even if the chip itself is years away.

Inference is the part worth owning

The timing isn't mysterious. Six weeks earlier, OpenAI and Broadcom unveiled Jalapeño, an inference-only accelerator that went from design start to tape-out in nine months, with gigawatt-scale deployment planned before the end of 2026. Google has run production inference on TPUs for a decade. Amazon's Annapurna team feeds Trainium. Meta builds MTIA. Anthropic was the only frontier lab left with zero silicon of its own.

The deeper logic is that inference — not training — is where the money leaks. Training is a periodic capital event; serving tokens is the recurring cost of goods sold, and agentic workloads have blown it up. A Claude Code session burns tokens at a rate that would have looked absurd two years ago, and every one of them carries Nvidia's roughly 70-plus-percent gross margin, or a cloud provider's markup, baked into the cost. Inference is also the tractable ASIC problem. Training hardware has to stay flexible because research changes; serving a known model family lets you harden the expensive parts — attention patterns, KV-cache movement, quantization formats, speculative decoding — into silicon. That's the "co-design" Anthropic keeps emphasizing: shape the model for the chip and the chip for the model, and a large chunk of Nvidia's margin becomes your margin.

Anthropic starts late, but not from zero

The obvious critique is that Anthropic is entering a race others started years ago. OpenAI began building its chip team in 2023–24 and still needed Broadcom to carry the physical implementation to get Jalapeño out the door. Google is on its seventh TPU generation. By that clock, Anthropic silicon before 2029 would be a surprise, and the Samsung talks — where, per The Information's reporting, even the target workload isn't defined — don't change that math.

But Anthropic has one structural advantage nobody else in the race does: its serving stack is already hardware-agnostic in production. Claude runs today across Google TPUs (a deal announced last October for up to a million chips and more than a gigawatt in 2026, expanded again in April with Google and Broadcom), Amazon's Trainium fleet in Project Rainier's hundreds of thousands of chips, and Nvidia GPUs via the $30 billion Azure commitment that came with Nvidia's own investment in the company. Dropping a fourth architecture into a stack built for three is an engineering project. Dropping a second architecture into a CUDA-shaped stack is an organ transplant. The multi-vendor strategy everyone read as "Anthropic can't afford to commit" turns out to be the exact substrate an in-house chip needs.

There's also a quieter beneficiary: Samsung Foundry. Its 2nm SF2P node needs an anchor AI customer the way TSMC does not, and an Anthropic win would be its most credible leading-edge logic customer in years. That cuts both ways — Samsung's yield history at 3nm is why the talks deserve skepticism until there's a signed deal and a tape-out.

What this means if you build on Claude

Nothing about the API changes before the end of the decade, so don't wait for it. What matters to developers is the mechanism, not the chip: custom inference silicon is how per-token prices keep falling. Jalapeño's pitch is performance-per-watt; Anthropic's pitch will be the same; and every point of serving-cost reduction is a point that competition converts into cheaper API tiers or bigger context windows. If you're modeling long-term inference costs for an agent-heavy product, the sustained deflation in $/Mtok that made today's products viable now depends on these programs shipping — that's the actual stakes of a job posting.

The second lesson is architectural, and you can apply it now. The biggest buyer of AI compute on earth refuses to depend on a single hardware vendor, to the point of designing its own escape hatch. If you're self-hosting open-weight models, the equivalent move is keeping your serving layer portable — vLLM or similar abstractions rather than anything CUDA-welded — because the cheapest inference hardware in 2028 is unlikely to be the same vendor it is today.

Call it what it is: a genuine strategic shift announced at the earliest possible moment. The near-term function is leverage — every price negotiation with Nvidia, Google, and Amazon now happens against the backdrop of a credible in-house alternative, which is worth real money years before first silicon. The milestones that would make it more than leverage are a confirmed Samsung (or TSMC) deal with a named node, and a tape-out date. Until then, Anthropic hasn't left the buyers' club. It's just stopped being the only member without a plan to.

Sources & further reading

  1. Anthropic co-designing custom AI inference chips to bypass costly Nvidia GPUs — tomshardware.com
  2. Anthropic is hiring an AI chip design team — techcrunch.com
  3. Anthropic is discussing a new custom chip with Samsung — techcrunch.com
  4. Anthropic reportedly in talks with Samsung to manufacture custom AI chip — siliconangle.com
  5. Anthropic poaches OpenAI's second-ever chip engineer — the-decoder.com
  6. OpenAI and Broadcom unveil LLM-optimized inference chip — openai.com
  7. Google and Anthropic announce cloud deal worth tens of billions of dollars — cnbc.com
Rachel Goldstein
Written by
Rachel Goldstein · Dev Tools Editor

Rachel has been embedded in the developer tooling ecosystem for nearly eight years, covering everything from IDE wars and package-manager drama to the quiet rise of AI-assisted coding. She has a soft spot for open-source maintainers and an unhealthy number of terminal emulators installed on a single laptop.

Discussion 0

Join the discussion

Sign in or create an account to comment and vote.

No comments yet

Be the first to weigh in.

Related Reading