Groq, Inc. is the category-defining pioneer of deterministic accelerated computing and real-time artificial intelligence inference, fundamentally transforming how software developers and global enterprises run large language models in production. Founded in Mountain View, California in 2016 by legendary Google TPU inventor Jonathan Ross and Douglas Wightman, Groq rejected the graphics-derived architecture of legacy GPUs. Recognizing that production AI inference requires instantaneous, deterministic token generation rather than non-deterministic parallel training bursts, Groq invented the Language Processing Unit (LPU)—the world's first software-scheduled tensor streaming processor. Powered by on-chip SRAM and cycle-accurate compiler scheduling, Groq delivers sustained generation speeds of 500 to 800 tokens per second on open foundation models, operating GroqCloud for over 500,000 developers worldwide. Today, Groq generates over $100 million in annualized run-rate revenue at a $2.8 billion valuation, backed by BlackRock, Neuberger Berman, Cisco, and Samsung under the leadership of CEO Jonathan Ross.
Groq operates a high-margin, scalable semiconductor systems and serverless cloud API consumption business model. Its monetization architecture is divided across three core pillars: First, GroqCloud serverless API consumption: software developers, conversational voice startups, and enterprise applications pay usage-based fees per million tokens processed across leading open foundation models (Llama 3.1 70B, Llama 3.1 8B, Mixtral 8x7B), with enterprise clients paying premium monthly tiers for guaranteed throughput, low-latency SLAs, and private VPC integrations. Second, turnkey GroqRack and GroqNode enterprise hardware sales: regulated corporate enterprises (financial services, healthcare, defense) purchase physical LPU server racks for multi-million-dollar capital investments, accompanied by recurring annual software licensing and maintenance support contracts. Third, global sovereign datacenter infrastructure agreements: multi-million-dollar joint ventures and hardware deployment contracts (such as its landmark partnership with Aramco Digital in Saudi Arabia) to construct national and regional AI computing hubs powered by thousands of interconnected LPUs.