Groq

Overview

Groq was founded in 2016 by Jonathan Ross, who had previously worked on Google's original Tensor Processing Unit effort. The company's thesis was that large language model inference — specifically the sequential decode stage — was a fundamentally different problem from training, and that a chip designed around determinism and on-chip memory could serve it far faster than a GPU.

For several years that thesis produced the most striking demonstrations in the market. GroqCloud served open-weight models at token rates that GPU-based providers could not match, and it did so through a conventional developer API, which made the advantage legible to people who had no interest in chip architecture.

In December 2025 Nvidia agreed to license Groq's inference technology on a non-exclusive basis in a deal reported at roughly $20 billion in cash — Nvidia's largest transaction on record. Ross, president Sunny Madra and other senior leaders joined Nvidia. Groq continued as an independent company, and GroqCloud continued to operate, but the company that exists today is a materially different business from the one that raised money as a chip designer.

The LPU architecture

The Language Processing Unit is worth understanding on its own terms, because its design choices explain both the performance results and the commercial difficulty.

The economic difficulty follows directly from the first row. Because SRAM capacity per chip is small relative to HBM, serving a large model requires a substantial number of LPUs working as one unit. That produces excellent latency, but it means the capital cost of a deployment scales with model size in a way that GPU deployments do not. As frontier models grew and reasoning workloads pushed context lengths and generated output lengths up, that arithmetic became progressively harder.

The Nvidia transaction

On 24 December 2025 it was reported that Nvidia would pay approximately $20 billion in cash for rights to Groq's inference technology under a non-exclusive licensing agreement. Groq's own announcement framed it as a licensing arrangement intended to accelerate AI inference at global scale. Jonathan Ross, Sunny Madra and other senior personnel joined Nvidia to advance the licensed technology.

The structure attracted immediate comment. Because it was framed as a licence plus a hiring arrangement rather than an acquisition, Groq continued to exist as a nominally independent competitor. At least one analyst quoted by CNBC described the structure as keeping the "fiction of competition alive," and the transaction drew attention from US lawmakers. Whether licence-and-hire structures of this kind receive sustained antitrust scrutiny is an open question with implications well beyond Groq.

The licensed technology has since become a shipping Nvidia product. At GTC 2026 Nvidia unveiled the Groq 3 LPU, an SRAM-based decode co-processor built by Samsung on a 4nm process and positioned within the Vera Rubin platform, with Rubin GPUs handling prefill and the LPU handling decode. The architecture Groq spent nearly a decade developing is now being manufactured and sold at scale — by Nvidia. Groq itself does not appear to be the commercial beneficiary of that deployment beyond the licensing payment already received.

The effect on Groq's standalone valuation was significant. The company had raised $750 million in September 2025 at approximately $6.9 billion post-money. By August 2026 its valuation was reported at $3.5 billion — roughly half the peak — even though the licensing payment itself was a substantial cash inflow. Investors repriced the business once its founding technical leadership had moved to the dominant chipmaker.

What Groq is now

Groq today is best classified as an inference cloud and neocloud operator rather than a chip designer. Its June 2026 funding announcement described a business serving more than five million developers and thousands of AI-native companies, processing trillions of tokens per week across 13 data centres in North America, Europe, the Middle East and APAC, with a plan to scale toward 200 megawatts of capacity by the end of 2027.

Reporting on the August 2026 round describes a further shift: Groq operating medium and large clusters of Nvidia accelerated computing for training and inference, alongside its existing platform. On that account the company has moved from selling an alternative to the GPU to selling capacity built on it — a considerable change in what the business is, and one that places Groq in a crowded neocloud market rather than a differentiated silicon one.

This shift is the single most important thing to understand about Groq's current position, and it is why this profile is filed under inference cloud rather than inference silicon. Readers encountering older coverage that describes Groq primarily as an LPU chip company should treat that framing as out of date.

Strengths and key questions

Leadership

Jonathan Ross founded Groq in 2016 and led it until December 2025, when he joined Nvidia as part of the licensing arrangement, along with president Sunny Madra. Ross's earlier work on Google's first-generation TPU is the direct intellectual lineage of the LPU.

Succession has been less clearly documented. CNBC reported at the time of the Nvidia deal that finance chief Simon Edwards would become chief executive of the continuing company. Groq's own June 2026 funding announcement identifies Adam Winter as chief executive. Subsequent reporting on the August 2026 round has associated the company's direction closely with lead investor Disruptive. This publication has not been able to reconcile these accounts from primary sources, and the position is recorded here as unresolved rather than stated with false confidence.

Funding history

The August 2026 round is labelled a Series A despite following a Series D. Reporting indicates this reflects a deliberate reset establishing a new valuation for the post-licensing entity, rather than a conventional early-stage round. The relationship between the June and August raises is not fully explained in public sources.

Why this profile matters beyond Groq

Groq is the clearest test case so far for the central question in this market: can a merchant inference-silicon company sustain itself against a vertically integrated incumbent? Groq had the strongest possible version of the argument — a real architectural advantage, demonstrable performance, a developer following and substantial capital — and the outcome was a licensing transaction that transferred the technology and the team to the incumbent.

That does not prove the thesis wrong. It does establish that the exit path for a successful inference architecture may run through Nvidia rather than around it, which is a material consideration for anyone assessing Etched, d-Matrix, or the other specialists tracked on this site.

Sources

1. Groq — Non-exclusive inference technology licensing agreement with Nvidia. Company statement on the December 2025 transaction.
2. CNBC — Nvidia buying Groq's assets for about $20 billion (24 December 2025). Deal value, leadership moves and CEO succession.
3. CNBC — Analyst commentary on the deal structure (26 December 2025). Critique of the licence-and-hire structure.
4. Groq — $650M raise to scale its AI inference cloud (June 2026). Developer count, token volume, data centre footprint, capacity targets and named chief executive.
5. TechCrunch — Groq raises $350M to fuel its pivot from AI chips to neocloud (17 August 2026). Valuation, round framing and strategy shift.
6. Groq — $640M Series D announcement (August 2024). Historical funding reference.
7. Data Center Dynamics — Nvidia to license technology from Groq and hire its leadership. Independent account of the arrangement.
8. Computer Weekly — Nvidia expands Vera Rubin platform, details Groq integration. The Groq 3 LPU as a decode co-processor.

Where public sources conflict — particularly on the identity of the current chief executive and on the relationship between the June and August 2026 raises — this profile records the conflict rather than selecting one account. Corrections with primary-source citations are welcome via the contact page.

Related pages