An Agent that Plays, Reasons, and Learns With You in Virtual 3D Worlds. Powered by Gemini, it goes beyond following basic instructions to think, understand, and take actions in interactive environments – meaning you can talk to it through text, voice, or even images.
A step forward for interactive agents the idea of reasoning and acting inside 3D worlds opens up a lot of new possibilities. Excited to see how creators experiment with this.
Cool to see PSYONIC Ability Hands Featured 😎
When will see major lay-offs in film and gaming industries? These 3D AI engines are crazy.
Seeing an agent understand and act inside 3D worlds feels surprisingly natural to me. My curiosity goes straight to how well it handles unfamiliar environments because that is where most tools fall short. I like how it reasons through actions instead of reacting blindly. this could make virtual worlds feel more alive for me
the concept of applying learned skills from one world to another is something I have always wished for. My gameplay habits involve switching genres often, so this kind of memory sounds helpful. I can see myself using it to experiment inside creative environments. It adds a fresh layer to interaction.
A 3D world game-playing agent that acts like a collaborative partner that can explain its intentions and answer questions about its behavior...!
SIMA 2 can now carry out detailed instructions — even in worlds it's never seen before (like those generated by Genie 3).
It can transfer learned concepts like “mining” in one game and apply it to “harvesting” in another – connecting the dots between similar tasks. 🤯
Curious how this compares with Marble.