When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
Recently, Elon Musk announced the world’s most powerful training system is officially online.
The system, dubbedColossus supercomputer, is powered by 100,000 NVIDIA H100 GPUs and will be used for training.
Elon Musk
This weekend, the @xAI team brought our Colossus 100k H100 training cluster online.
From start to finish, it was done in 122 days.
Colossus is the most powerful AI training system in the world.
Moreover, it will double in size to 200k (50k H200s) in a few months.
From start to finish, it was done in 122 days.
Colossus is the most powerful AI training system in the world.
Moreover, it will double in size to 200k (50k H200s) in a few months.
Excellent work by the team, Nvidia and our many partners/suppliers."
This closely aligns with the tech mogul’s estimated $34 billion expenditure on sourcing GPUs.
