Nvidia raises AI server prices by over 15% as memory costs soar

Nvidia has notified some of its biggest customers that the prices of servers containing its artificial intelligence chips are rising by more than 15% in many cases, according to people familiar with the matter. The increases, driven by soaring memory chip costs, will go into effect on systems shipped early next year and will impact models featuring the flagship Vera Rubin and Grace Blackwell chips.

The price adjustments will vary depending on the generation of Nvidia chips and the memory configurations, the people said. Contract manufacturers for major data centre operators such as Microsoft, Alphabet's Google and Oracle have recently informed their customers of the forthcoming increases. Nvidia representatives did not respond to requests for comment.

Memory makers' leverage

The price hikes highlight the growing influence of memory chipmakers — Samsung Electronics, SK Hynix and Micron Technology — amid a surge in demand for AI infrastructure. Nvidia's inability to hold the line on prices or absorb rising costs reflects the leverage these suppliers have gained as AI infrastructure spending accelerates.

The increased prices are attributed to memory chip costs, which have soared as AI demand boosts the need for high-bandwidth memory and DRAM. Nvidia's accelerator processors, which are the heart of computers that create and run AI software, depend heavily on the amount of dynamic random access memory they are paired with.

Broader cost pressures

Beyond AI servers, Nvidia has also raised prices for gaming-oriented PC graphics cards, according to a report from Tom's Hardware. Major technology companies including Apple and Qualcomm have recently said they have been forced to charge more for their products because of chip shortages, indicating broader cost pressures across the industry.

Nvidia's gross margin stands at roughly 75%, a figure that reflects the company's strong pricing power historically. The upcoming price increases come as Nvidia is scheduled to report fiscal second-quarter earnings next week, which will be closely watched for further details on pricing trends and margin impact.