AI Visionary Ilya Sutskever Launches New Venture: Safe Superintelligence!

  • Editor
  • June 20, 2024

Ilya Sutskever, the co-founder and former chief scientist of OpenAI, has announced the launch of Safe Superintelligence Inc. (SSI), a new AI company focused on safety. This announcement follows his departure from OpenAI in May after a period of internal conflict over AI safety practices.

SSI, co-founded with former Y Combinator partner Daniel Gross and ex-OpenAI engineer Daniel Levy, aims to prioritize safety over commercial pressures, addressing a crucial need in the rapidly advancing field of AI.

At OpenAI, Sutskever was instrumental in efforts to improve AI safety, working alongside Jan Leike on the Superalignment team. However, both Sutskever and Leike left the company following disagreements with OpenAI leadership regarding the approach to AI safety.

Sutskever’s new venture, SSI, emerges from these debates with a clear mission to develop safe and powerful AI systems.

The company’s business model is designed to insulate safety, security, and progress from short-term commercial pressures, allowing the team to focus on their mission without distraction from management overhead or product cycles.

Here’s what people have to say about this new startup by Ilya Sutskever!

SSI’s establishment underscores a pivotal moment in the AI industry, where balancing rapid technological advancement with safety is becoming increasingly critical.

Sutskever and his team believe that safety and capabilities should be approached in tandem, viewing them as technical problems to be solved through revolutionary engineering and scientific breakthroughs.

This dual approach aims to advance AI capabilities swiftly while ensuring that safety measures remain ahead, maintaining public trust and ensuring responsible AI development.

Unlike OpenAI, which initially launched as a non-profit organization before restructuring to accommodate the vast sums needed for its computing power, SSI is designed as a for-profit entity from the ground up.

Given the team’s credentials and current interest in AI, this strategic choice reflects the founders’ confidence in raising capital. SSI has already established offices in Palo Alto, California, and Tel Aviv, Israel, and is actively recruiting top engineers and researchers to join its dedicated team.

Sutskever’s commitment to AI safety is long-standing. In a 2023 blog post co-authored with Leike, he predicted that AI with intelligence superior to humans could arrive within the decade and emphasized the need for research into controlling and restricting such AI.

This commitment continues with SSI, whose singular focus on safe superintelligence is reflected in its name, mission, and product roadmap. The company plans to advance capabilities rapidly while ensuring that safety remains paramount, avoiding distractions from management overhead or product cycles.

The formation of SSI comes at a time when AI safety is a hotly debated topic, especially with the increasing capabilities of AI models.

The recent pledge by major AI companies to implement a “kill switch” policy, potentially halting the development of their most advanced AI models if certain risk thresholds are crossed, highlights broader concerns about the potential risks associated with unchecked AI development.

SSI’s mission aligns with this precautionary stance, emphasizing the need for robust safety frameworks.

As SSI forges ahead, it aims to set new standards in the AI industry by prioritizing safety and responsible development.

The company’s singular focus on creating safe superintelligence reflects a broader shift in the AI landscape, where ensuring the safe and ethical development of AI technologies is becoming increasingly crucial.

For more news and trends, visit AI News on our website.

Was this article helpful?
Generic placeholder image

Dave Andre


Digital marketing enthusiast by day, nature wanderer by dusk. Dave Andre blends two decades of AI and SaaS expertise into impactful strategies for SMEs. His weekends? Lost in books on tech trends and rejuvenating on scenic trails.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *