AsianFin -- Elon Musk has joined a growing consensus among AI experts that there is now a limited amount of real-world data available for training AI models.
"We've now exhausted basically the cumulative sum of human knowledge... in AI training," Musk stated during a live-streamed conversation with Stagwell Chairman Mark Penn on X late Wednesday. "That happened basically last year."
Musk, the owner of AI company xAI, echoed remarks made by former OpenAI chief scientist Ilya Sutskever at the NeurIPS machine learning conference in December. Sutskever had suggested the AI industry has reached "peak data," warning that the scarcity of new training data will drive a shift in how AI models are developed.
Musk proposed that synthetic data—data generated by AI models themselves—could be the way forward. "The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data]," he explained. "With synthetic data... [AI] will sort of grade itself and go through this process of self-learning."
Explore more exclusive insights at nextfin.ai.
