Groq, Inc. is a private AI inference company in Mountain View, California, founded in 2016 by Jonathan Ross and Douglas Wightman. It designed the Language Processing Unit (LPU) and runs GroqCloud, an API for fast inference on open models.
What does Groq do?
Groq sells AI inference. Developers and companies send requests to GroqCloud and pay per million tokens to run open-weight models. Larger customers buy dedicated capacity or on-premises GroqRack systems. By mid-2026 the company reported 13 data centers across North America, Europe, the Middle East and APAC and more than five million developers.
The LPU
The LPU keeps model weights in on-chip SRAM rather than external HBM and uses a compiler to schedule every operation in advance. That design made GroqCloud one of the fastest providers in public benchmarks after its 2024 launch.
The Nvidia deal
On December 24, 2025, Groq and Nvidia announced a non-exclusive license of Groq's inference technology, reported at about $20 billion. Founder Jonathan Ross, president Sunny Madra and other staff joined Nvidia; Ross is now Nvidia's chief software architect. Nvidia unveiled its Groq 3 LPX inference system at GTC in March 2026.
Leadership and funding
CFO Simon Edwards became CEO after the deal and left for Bloom Energy in April 2026. Co-founder Doug Wightman is now CEO, with Alex Davis of Disruptive as chairman. Groq raised $640 million at $2.8 billion in August 2024, $750 million at $6.9 billion in September 2025, and $650 million in June 2026 at an undisclosed valuation.
Competitors
Groq competes with Nvidia, Cerebras, SambaNova, AMD and hyperscaler chips, and with inference clouds such as Together AI and Fireworks AI.