What happens when AI starts building itself?

Richard Socher, founder of You.com, has launched Recursive Superintelligence with $650 million in funding. The startup, joined by AI researchers like Peter Norvig and Tim Shi, is focused on developing a recursively self-improving AI model. This AI would autonomously identify and fix its own weaknesses without human involvement, a long-sought goal in AI research. Socher emphasizes their unique approach using 'open-endedness' to achieve this, drawing parallels to biological evolution and techniques like 'rainbow teaming' where AIs test each other. While acknowledging that true self-improvement might never be 'done,' he believes they are approaching it differently from major labs. Recursive Superintelligence aims to be a viable company with impactful products, with initial product releases expected within quarters, not years. Socher also foresees compute power becoming a critical resource allocation question for humanity as AI advances.

(Source：TechCrunch)