In an exciting development for the fields of artificial intelligence and robotics, OpenAI and Figure, a company renowned for its advanced humanoid robots, have announced a collaboration that promises to transform the landscape of robotic technology.
This partnership revealed just two weeks ago, is already showcasing remarkable progress in robot learning capabilities, signaling a significant leap towards achieving human-like speed and efficiency in robotic actions.
OpenAI + Figure
conversations with humans, on end-to-end neural networks:
→ OpenAI is providing visual reasoning & language understanding
→ Figure’s neural networks are delivering fast, low level, dexterous robot actions(thread below)pic.twitter.com/trOV2xBoax
— Brett Adcock (@adcock_brett) March 13, 2024
Thirteen days since their initial announcement, OpenAI and Figure are thrilled to share a significant update on their collaborative efforts.
A recently released video demonstrates the fruits of their labor – a humanoid robot performing complex tasks with a speed and dexterity that closely mimics human movements.
Remarkably, this demonstration was filmed in real-time, without any speed adjustments, highlighting the advanced capabilities of the robots being developed.
Here’s some background:
Two weeks ago, we announced Figure + OpenAI are joining forces to push the boundaries of robot learning
Together we are developing next generation AI models for our humanoid robots
It’s been 13 days & we’re excited to share today’s update pic.twitter.com/roRfWsA83e
— Brett Adcock (@adcock_brett) March 13, 2024
The backbone of this breakthrough is the integration of OpenAI’s cutting-edge visual reasoning and language understanding technologies with Figure’s sophisticated neural networks.
These neural networks, adept at processing images at 10Hz from the robot’s onboard cameras, are capable of outputting actions across 24 degrees of freedom at an astounding rate of 200Hz. This synergy enables the robots to interpret and interact with their surroundings in a manner that was previously unattainable.
Here’s some background:
Two weeks ago, we announced Figure + OpenAI are joining forces to push the boundaries of robot learning
Together we are developing next generation AI models for our humanoid robots
It’s been 13 days & we’re excited to share today’s update pic.twitter.com/roRfWsA83e
— Brett Adcock (@adcock_brett) March 13, 2024
Figure’s approach to robotics goes beyond software, encompassing the vertical integration of hardware components critical for the robots’ performance.
The company’s team of hardcore engineers has developed proprietary solutions for motors, firmware, thermals, electronics, middleware OS, battery systems, actuator sensors, and the mechanical structures of the robots. This comprehensive approach ensures unparalleled control and efficiency across all aspects of the robots’ operations.
In addition to building leading AI, Figure has also vertically integrated basically everything
We have hardcore engineers designing:
– Motors
– Firmware
– Thermals
– Electronics
– Middleware OS
– Battery Systems
– Actuator Sensors
– Mechanical & Structures pic.twitter.com/wOCsOTuufq— Brett Adcock (@adcock_brett) March 13, 2024
As OpenAI and Figure continue to develop next-generation AI models for humanoid robots, they are also looking to expand their team of innovators. The collaboration between these two powerhouses in AI and robotics is not just a testament to their commitment to advancing technology but also an invitation to others who wish to contribute to this pioneering journey.
However people do have some concerns to raise:
The voice is an actual human voice and not computer generated. It is someone speaking trying to mimic a computer generated voice. Robot may be moving via NN but voice is dubbed.
— TheWombat (@pvs11son) March 13, 2024
The implications of this partnership extend far beyond the technical feats demonstrated. It marks a significant step towards creating robots that can seamlessly integrate into various aspects of human life, offering unprecedented assistance and enhancing the human experience in ways yet to be fully imagined.
As we stand on the brink of a new era in robotics, the collaboration between OpenAI and Figure serves as a beacon of innovation, inviting us all to envision a future where humans and robots collaborate more closely than ever before.
For more of the latest news, visit our AI news at allaboutai.com.