GROK 4 Released

Grok 4 Released

• I watched the Grok 4 launch event video today.
• Musk said that starting from Grok 2, the amount of pre-training data was increased by 10 times to Grok 3, and the amount of RL reasoning training was increased by 10 times from Grok 3 to Grok 4.
• It can achieve an amazing 44.4% in the challenge of solving the [Human Final Test].
• The XAi team said that the current Grok 4 is using tools to solve problems on the basis of first principles.
• At present, the use of tools has been integrated into the training, so the ability to use tools is very powerful.
• And at present, only relatively preliminary tools are used; Musk mentioned that in the future, advanced tools such as finite element simulation can be used, and can be compared with the real world, which can be achieved later this year.
• Grok 4 HEAVEY automatically generates MOE for collaborative work on the basis of Grok 4.
• At present, for Grok 4 training, the bottleneck is that it is difficult to find good questions to ask. Musk continued: Real-world problems are the best problems, such as how to improve the design of cars and how to get rockets into orbit. When a world model can use finite element software to make predictions and then compare them with experimental results, it should indeed be able to produce practical results.
• Musk believes that Grok 4 will be able to discover useful new technologies by the end of this year, and will discover new laws of physics next year!
• Musk said that the current shortcoming of Grok 4 is that the vision is still relatively weak, and it is currently being trained and improved.
• The price is $300/Mo, it seems that the computing resources are indeed very high.