Elon Musk’s synthetic intelligence startup, xAI, has activated its supercomputer cluster in Memphis, Tennessee, which is comprised of 100,000 Nvidia H100 GPUs. Tesla CEO Elon Musk confirmed the milestone in a submit on social media platform X.
xAI had a busy weekend, with the AI startup asserting a hiring ramp on X. Musk highlighted these efforts on Monday morning, stating that xAI was seeking to improve its human expertise benefit. Curiously sufficient, Musk additionally inspired those that are thinking about AI to use to Tesla and X.
However positively seeking to improve our human expertise benefit, so please apply at @xAI, in addition to @Tesla and @X https://t.co/sf4hMRco9f
— Elon Musk (@elonmusk) July 22, 2024
Musk then talked about {that a} collaboration between groups from xAI, X, and Nvidia has enabled the Memphis Supercomputer cluster to begin coaching at 4:20 a.m. native time. As per Musk, the supercomputer cluster options 100,000 Nvidia H100 GPUs, successfully making it essentially the most highly effective AI coaching cluster out there immediately.
“Good work by xAI group, X group, Nvidia group, and supporting firms getting Memphis Supercluster coaching began at ~4:20 a.m. native time. With 100k liquid-cooled H100s on a single RDMA cloth, it’s essentially the most highly effective AI coaching cluster on the earth! It is a vital benefit in coaching the world’s strongest AI by each metric by December this 12 months,” Musk wrote in a submit on X.
It is a vital benefit in coaching the world’s strongest AI by each metric by December this 12 months
— Elon Musk (@elonmusk) July 22, 2024
xAI’s supercomputer cluster is predicted for use to coach the corporate’s giant language mannequin, Grok, which is presently rolled out as a function for X Premium subscribers. Earlier this month, Musk famous in a submit on X that xAI’s Grok 3 can be educated on 100,000 H100 GPUs so “it needs to be actually one thing particular.”
Earlier reviews from Memphis again in early June instructed that xAI can be constructing a supercomputer cluster informally dubbed the “Gigafactory of Compute” on the 785,000-square-foot former Electrolux Memphis facility. In a press launch, the Higher Memphis Chamber acknowledged that xAI’s supercomputer undertaking represents the town’s largest capital funding by a new-to-market firm in Memphis historical past.
xAI’s funding is substantial. As per a Benzinga report, every Nvidia H100 GPU is estimated to value between $30,000 to $40,000. Contemplating that xAI is utilizing 100,000 Nvidia H100 items, Elon Musk’s AI startup seems to have spent about $3 billion to $4 billion for the undertaking.
Don’t hesitate to contact us with information suggestions. Simply ship a message to [email protected] to provide us a heads up.
