- The Daily XP
- Posts
- š¤ Meet SIMA - Googleās AI Gamer Baby Who Actually Listens
š¤ Meet SIMA - Googleās AI Gamer Baby Who Actually Listens
... and Figure 01ās Got a Brand New Brain
Hello, fellow nerds š§
If youāre looking to get down and nerdy with some AI, Nvidia is hosting its annual GTC AI conference from March 18th - 21st.
All the big names in the AI space will be speaking, so itāll be hella interesting to hear their thoughts and where they see AI going in the near future. Sure, thereāll probably be a ton of jargon thatāll fly over all our heads, but hey, weāre all learning together. If that sounds like your cup of tea, sign up for free here.
Hereās the daily quests in AI to complete today:
š¤ Meet SIMA - Googleās AI Gamer Baby Who Actually Listens
š§ Figure 01ās Got a Brand New Brain
š®ļø Videogame Stores in 2002 Were Heaven
š„ļø Witness the Most Immersive Gaming Setup Ever
Meet SIMA - Googleās AI Gamer Baby Who Actually Listens
Itās about time an AI is Team Human!! š
Oddly enough, Baby SIMA isnāt being trained to win, itās being trained to listen, aka follow directions.
Just like us, it interacts with virtual worlds through the displayed images (monitor), keyboard and a mouse for control of the gamesā character. No APIs or special code required.
As you can see, SIMA, Scalable Instructable Multiworld Agent, is learning to play games by carrying out simple tasksā¦ but to be blunt, itās still a toddler. It hasnāt been able to string together the tasks into complex requests such as ābuild a camp.ā
Whatās interesting is how training SIMA in one specialized game performed poorly when compared to Baby SIMA trained using 9 different video games (Goat Simulator 3, Satisfactory, Valheim, No Manās Sky, Teardown, Hydroneer, Wobbly Life, and Construction Lab).
Generalized Training > Specialized Training
Gamers, Letās Dream Big:
Goodbye Patience - forget the days of waiting for someone to get home, make food, pee, sleep, or complain you tkād them ever again - companionship when you want, how you want š
Single Player Games Are Now Coop?
Multiplayer Games that are dying now have intelligent, interactive teammates instead of games filled with useless bots.
Farming just got a whole lot easier.
Imagine playing Arma III and leading an army via voice commands and the AI actually listen to your commands.
Advanced AIā¦ Who cares?
With SIMA, weāre another step closer to Artificial General Intelligence, AGI.
AGI is a type of AI that aims to perform at or above human levels across a wide range of general tasks, contrasting with narrow AI designed for specific functions.
True AGI systems is where it can get scaryā¦ self aware, abstract thinking, background knowledge, common sense, cause-and-effect understanding, transfer learning capabilities, creativity, sensory perception, fine motor skills, and natural language understanding.
SIMA demonstrates Generalization with its ability to understand shared concepts and skills that are transferrable between virtual worlds. Oh my.
Did you say, more?
Read the Google Deepmind full in depth paper here.
The Figure 01 Robot is Getting Crazy Good
And to be honest, the progress is happening at light speed.
Just for some reference, this was Figure 01 just one month ago:
Figure 01 is now completing real world tasks
Everything is autonomous:
-Autonomous navigation & force-based manipulation
-Learned vision model for bin detection & prioritization
-Reactive bin manipulation (robust to pose variation)
-Generalizable to other pick/place tasksā Figure (@Figure_robot)
6:33 PM ā¢ Feb 26, 2024
Now, that demo is impressive, sure. But it doesnāt really leave you with that āwowā factor. Toddlers can carry bins better than that. But thenā¦
OpenAI enters chat
So, two weeks ago Figure tapped OpenAI to be their tag team partner. The plan? Slap ChatGPT inside Figure 01 to give it a brain. Turns out, ChatGPT fit like a glove. Here are the results from just two weeks of working together:
We are now having full conversations with Figure 01, thanks to our partnership with OpenAI.
Our robot can:
- describe its visual experience
- plan future actions
- reflect on its memory
- explain its reasoning verbally
Technical deep-dive š§µ:ā Corey Lynch (@coreylynch)
2:54 PM ā¢ Mar 13, 2024
Umm, what?? Figure 01 is having full conversations, memory reflection, explaining logic, and organizing dishes better than I ever could. This is actually mind-bottling. PLUS itāll share its apple with you. His momma mustāve raised him well, look at his manners!
What truly stuck out was how conversational Figure 01 sounded. It almost feltā¦emotional.
āļø Throwback Thursday
A little blast from the past.
Took a trip down memory lane with this one. I basically lived at Gamestop, buying games just because they looked cool. Thatās how I stumbled upon one of my all-time favorites, āTy The Tasmanian Tigerā. If you know it, well, weāre pretty much best friends now. Ah, what simpler times we lived in.
Daily Delight
Just something fun and interesting around the web.
Iām all for physical immersion in video games. So much so that I bought one of the first, albeit, very shitty, vests that would supposedly vibrate whenever you got shot or hit in a game. This was probably 10 years ago if I had to guess. Spoiler alert, it didnāt work.
But check out this guy, Iām taking notes from him. He just gets it.
guy uses robotics to make his gaming setup more immersive
ā All things interesting (@interesting_aIl)
4:19 PM ā¢ Feb 28, 2024
Whatās happening inside the Realm
A list of side quests to explore and more.
The Pentagon is spending $1 billion on drones to stymie a potential Chinese invasion of Taiwan
It looks like Sora wonāt be hitting the streets anytime soon as itās still very much in the research phase
A release date for ChatGPT 4.5 Turbo was potentially spotted on DuckDuckGo, which mentions a launch in June
The EU passed the Artificial Intelligence Act, the worldās first piece of legislation to comprehensively regulate AI
Thatās all the quests we have for today. Check back tomorrow for more!
Looking to become a sponsor?
Was this email forwarded to you? Subscribe here.