• The Daily XP
  • Posts
  • šŸ¤— Meet SIMA - Googleā€™s AI Gamer Baby Who Actually Listens

šŸ¤— Meet SIMA - Googleā€™s AI Gamer Baby Who Actually Listens

... and Figure 01ā€™s Got a Brand New Brain

Hello, fellow nerds šŸ§™

If youā€™re looking to get down and nerdy with some AI, Nvidia is hosting its annual GTC AI conference from March 18th - 21st.

All the big names in the AI space will be speaking, so itā€™ll be hella interesting to hear their thoughts and where they see AI going in the near future. Sure, thereā€™ll probably be a ton of jargon thatā€™ll fly over all our heads, but hey, weā€™re all learning together. If that sounds like your cup of tea, sign up for free here.

Hereā€™s the daily quests in AI to complete today:
  • šŸ¤— Meet SIMA - Googleā€™s AI Gamer Baby Who Actually Listens

  • šŸ§  Figure 01ā€™s Got a Brand New Brain

  • šŸŽ®ļø Videogame Stores in 2002 Were Heaven

  • šŸ–„ļø Witness the Most Immersive Gaming Setup Ever

Meet SIMA - Googleā€™s AI Gamer Baby Who Actually Listens

Itā€™s about time an AI is Team Human!! šŸŽ‰ 

Oddly enough, Baby SIMA isnā€™t being trained to win, itā€™s being trained to listen, aka follow directions.

Just like us, it interacts with virtual worlds through the displayed images (monitor), keyboard and a mouse for control of the gamesā€™ character. No APIs or special code required.

As you can see, SIMA, Scalable Instructable Multiworld Agent, is learning to play games by carrying out simple tasksā€¦ but to be blunt, itā€™s still a toddler. It hasnā€™t been able to string together the tasks into complex requests such as ā€œbuild a camp.ā€

sima_tasks

Whatā€™s interesting is how training SIMA in one specialized game performed poorly when compared to Baby SIMA trained using 9 different video games (Goat Simulator 3, Satisfactory, Valheim, No Manā€™s Sky, Teardown, Hydroneer, Wobbly Life, and Construction Lab).

Generalized Training > Specialized Training

Gamers, Letā€™s Dream Big:

  • Goodbye Patience - forget the days of waiting for someone to get home, make food, pee, sleep, or complain you tkā€™d them ever again - companionship when you want, how you want šŸ˜… 

  • Single Player Games Are Now Coop?

  • Multiplayer Games that are dying now have intelligent, interactive teammates instead of games filled with useless bots.

  • Farming just got a whole lot easier.

  • Imagine playing Arma III and leading an army via voice commands and the AI actually listen to your commands.

Advanced AIā€¦ Who cares?
With SIMA, weā€™re another step closer to Artificial General Intelligence, AGI.

AGI is a type of AI that aims to perform at or above human levels across a wide range of general tasks, contrasting with narrow AI designed for specific functions.

True AGI systems is where it can get scaryā€¦ self aware, abstract thinking, background knowledge, common sense, cause-and-effect understanding, transfer learning capabilities, creativity, sensory perception, fine motor skills, and natural language understanding.

SIMA demonstrates Generalization with its ability to understand shared concepts and skills that are transferrable between virtual worlds. Oh my.

Did you say, more?
Read the Google Deepmind full in depth paper here.

The Figure 01 Robot is Getting Crazy Good

And to be honest, the progress is happening at light speed.

Just for some reference, this was Figure 01 just one month ago:

Now, that demo is impressive, sure. But it doesnā€™t really leave you with that ā€œwowā€ factor. Toddlers can carry bins better than that. But thenā€¦

OpenAI enters chat

So, two weeks ago Figure tapped OpenAI to be their tag team partner. The plan? Slap ChatGPT inside Figure 01 to give it a brain. Turns out, ChatGPT fit like a glove. Here are the results from just two weeks of working together:

Umm, what?? Figure 01 is having full conversations, memory reflection, explaining logic, and organizing dishes better than I ever could. This is actually mind-bottling. PLUS itā€™ll share its apple with you. His momma mustā€™ve raised him well, look at his manners!

What truly stuck out was how conversational Figure 01 sounded. It almost feltā€¦emotional.

āŒ›ļø Throwback Thursday

A little blast from the past.

Took a trip down memory lane with this one. I basically lived at Gamestop, buying games just because they looked cool. Thatā€™s how I stumbled upon one of my all-time favorites, ā€œTy The Tasmanian Tigerā€. If you know it, well, weā€™re pretty much best friends now. Ah, what simpler times we lived in.

video game stores in 2002

Daily Delight

Just something fun and interesting around the web.

Iā€™m all for physical immersion in video games. So much so that I bought one of the first, albeit, very shitty, vests that would supposedly vibrate whenever you got shot or hit in a game. This was probably 10 years ago if I had to guess. Spoiler alert, it didnā€™t work.

But check out this guy, Iā€™m taking notes from him. He just gets it.

Whatā€™s happening inside the Realm

A list of side quests to explore and more.
  • The Pentagon is spending $1 billion on drones to stymie a potential Chinese invasion of Taiwan

  • It looks like Sora wonā€™t be hitting the streets anytime soon as itā€™s still very much in the research phase

  • A release date for ChatGPT 4.5 Turbo was potentially spotted on DuckDuckGo, which mentions a launch in June

  • The EU passed the Artificial Intelligence Act, the worldā€™s first piece of legislation to comprehensively regulate AI

Thatā€™s all the quests we have for today. Check back tomorrow for more!

Looking to become a sponsor?

Was this email forwarded to you? Subscribe here.