Key points:
- Nvidia has licensed intellectual property from Groq, a company that designs and sells chips optimized for AI inferencing, and hired some of its senior executives.
- The deal could be worth as much as $20 billion and allows Nvidia to diversify its memory sourcing, reducing its dependence on scarce high-bandwidth memory.
- Nvidia has avoided taking on Groq’s service business, GroqCloud, and potentially escaped antitrust scrutiny by structuring the relationship as an IP licensing deal rather than an outright acquisition.
According to sources, Nvidia has made a significant move in the AI market by licensing intellectual property from Groq, a company that designs and sells chips optimized for AI inferencing. This move is important because it allows Nvidia to diversify its memory sourcing, reducing its dependence on scarce high-bandwidth memory. The deal could be worth as much as $20 billion, making it a substantial investment for Nvidia.
Groq’s chips, which are designed for AI inferencing, are lower-powered and lower-priced than Nvidia’s GPUs, which are primarily used for training AI models. As the AI market matures, demand for devices optimized for inferencing is likely to grow, making this deal a strategic move for Nvidia. Groq’s technology is also notable for its use of static RAM, which is faster and less power-hungry than the dynamic RAM used by competing chip technologies.
By structuring the relationship as an IP licensing deal, Nvidia has avoided taking on GroqCloud, Groq’s service business, which could have added complexity to its operations. This move also potentially allows Nvidia to escape antitrust scrutiny, which would have accompanied a full-on acquisition. Nvidia’s CFO had previously reported that some of its chips are "sold out" or "fully utilized," due to a shortage of high-bandwidth memory, making this deal a way for the company to address this issue.
The deal has also led to the hiring of some of Groq’s senior executives, including its founder, Jonathan Ross, who is now chief software architect at Nvidia, and its former president, Sunny Madra, who is now VP of hardware. The remaining parts of Groq will be run by Simon Edwards, who joined the company as CFO just three months ago.
This move is significant for Nvidia, as it allows the company to expand its offerings in the AI market and reduce its dependence on scarce memory chips. It also highlights the growing demand for devices optimized for AI inferencing, and the need for companies to find ways to make their AI operations less dependent on scarce memory chips. Nvidia’s partnership with Groq is a strategic move that could have a major impact on the AI market, and it will be interesting to see how this deal plays out in the coming months. With Microsoft and Azure also investing heavily in AI, this move by Nvidia is likely to have implications for the wider tech industry, particularly in the areas of Windows Server and cloud computing.
Read the rest: Source Link
Don’t forget to check our list of Cheap Windows VPS Hosting providers, How to get Windows Server 2022, Try Windows 11 Pro for Workstations & browse Windows Azure content.
Remember to like our facebook and follow us on twitter @WindowsMode.
Discover more from Windows Mode
Subscribe to get the latest posts sent to your email.