Nvidia începe producția sistemelor Groq, după acordul de 20 miliarde dolari - StartupCafe

Nvidia has begun mass production of Groq 3 LPX systems, aiming for operational status by year-end, following its $20 billion acquisition of Groq. The systems will enhance AI response times in data centers, with initial installations planned at Nebius. Groq specializes in inference chips, crucial for generating AI responses quickly. Each LPX rack contains 256 Groq chips, capable of processing around 3,400 tokens per second. Nvidia emphasizes that these chips complement, rather than replace, GPUs, which are essential for both training and inference tasks. The competition in low-latency AI solutions is intensifying, with AMD also entering the market.