Subtitles section Play video Print subtitles This is NVIDIA project GR00T. A general purpose foundation model for humanoid robot learning. The GR00T model takes multimodal instructions and past interactions as input and produces the next action for the robot to execute. We developed Isaac Lab, a robot learning application to train GR00T on Omniverse Isaac Sim. And we scale out with OSMO, a new compute orchestration service that coordinates workflows across DGX systems for training and OVX systems for simulation. With these tools, we can train GR00T in physically based simulation and transfer zero shot to the real world. The group model will enable a robot to learn from a handful of human demonstrations so it can help with everyday tasks and emulate human movement just by observing us. This is made possible with invidious technologies that can understand humans from videos, train models and simulation and ultimately deploy them directly to physical robots. Connecting group to a large language model even allows it to generate motions by following natural language instructions. Hi, GR-1. Can you give me a high-five? Sure thing! Let's high-five. Can you give us some cool moves? Sure! Check this out! All this incredible intelligence is powered by the new Jetson Thor robotics chips, designed for GR00T built for the future. With Isaac Lab, OSMO and GR00T, we're providing the building blocks for the next generation of AI-powered robotics. About the same size. The soul of NVIDIA, the intersection of computer graphics, physics, artificial intelligence. It all came to bear at this moment. The name of that project, General Robotics 003. I know. Super good, super good. Well, I think we have some special guests, do we? Hey guys. So I understand you guys are powered by Jetson. They're powered by Jetsons. Little Jetson robotics computers inside. They learn to walk in Isaac Sim. Ladies and gentlemen, this is Orange and this is the famous Green. They are the BDX robots of Disney. Amazing Disney research. Come on, you guys, let's wrap up, let's go. Five things. Where are you going? I say right here. Don't be afraid. Come here, Green. Hurry up. What are you saying? No, it's not time to eat. It's not time to eat. I'll give you, I'll give you a snack in a moment. Let me finish up real quick. Come on, Green, hurry up. Stop wasting time. The next generation of robotics will likely be a humanoid robotics. We now have the necessary technology. And as I was describing earlier, the necessary technology to imagine generalized human robotics in a way human robotics is likely easier. And the reason for that is because we have a lot more imitation training data that we can provide the robots because we are constructed in a very similar way. It is very likely that the human and robotics will be much more useful in our world because we created the world to be something that we can interoperate in and work well in. And the way that we set up our workstations and manufacturing and logistics they were designed for, for humans, they were designed for people. And so these human robotics will likely be much more productive to deploy. While we're creating, just like we're doing with the others, the entire stack starting from the top, a foundation model that learns from watching video, human examples. It could be in video form, it could be in virtual reality form. We then created a gym for it called Isaac Reinforcement Learning Gym, which allows the humanoid robot to learn how to adapt to the physical world. And then, an incredible computer—the same computer that's going to go into a robotic car—will run inside a humanoid robot called Thor. It's designed for transformer engines.
B1 robotics isaac robot human nvidia powered Nvidia Revealed Project GROOT and Disney Bots at GTC 16505 145 林宜悉 posted on 2024/03/20 More Share Save Report Video vocabulary