• The Daily XP
  • Posts
  • šŸ¤— Meet SIMA - Google’s AI Gamer Baby Who Actually Listens

šŸ¤— Meet SIMA - Google’s AI Gamer Baby Who Actually Listens

... and Figure 01’s Got a Brand New Brain

Hello, fellow nerds šŸ§™

If you’re looking to get down and nerdy with some AI, Nvidia is hosting its annual GTC AI conference from March 18th - 21st.

All the big names in the AI space will be speaking, so it’ll be hella interesting to hear their thoughts and where they see AI going in the near future. Sure, there’ll probably be a ton of jargon that’ll fly over all our heads, but hey, we’re all learning together. If that sounds like your cup of tea, sign up for free here.

Here’s the daily quests in AI to complete today:
  • šŸ¤— Meet SIMA - Google’s AI Gamer Baby Who Actually Listens

  • 🧠 Figure 01’s Got a Brand New Brain

  • šŸŽ®ļø Videogame Stores in 2002 Were Heaven

  • šŸ–„ļø Witness the Most Immersive Gaming Setup Ever

Meet SIMA - Google’s AI Gamer Baby Who Actually Listens

It’s about time an AI is Team Human!! šŸŽ‰ 

Oddly enough, Baby SIMA isn’t being trained to win, it’s being trained to listen, aka follow directions.

Just like us, it interacts with virtual worlds through the displayed images (monitor), keyboard and a mouse for control of the games’ character. No APIs or special code required.

As you can see, SIMA, Scalable Instructable Multiworld Agent, is learning to play games by carrying out simple tasks… but to be blunt, it’s still a toddler. It hasn’t been able to string together the tasks into complex requests such as ā€œbuild a camp.ā€

sima_tasks

What’s interesting is how training SIMA in one specialized game performed poorly when compared to Baby SIMA trained using 9 different video games (Goat Simulator 3, Satisfactory, Valheim, No Man’s Sky, Teardown, Hydroneer, Wobbly Life, and Construction Lab).

Generalized Training > Specialized Training

Gamers, Let’s Dream Big:

  • Goodbye Patience - forget the days of waiting for someone to get home, make food, pee, sleep, or complain you tk’d them ever again - companionship when you want, how you want šŸ˜… 

  • Single Player Games Are Now Coop?

  • Multiplayer Games that are dying now have intelligent, interactive teammates instead of games filled with useless bots.

  • Farming just got a whole lot easier.

  • Imagine playing Arma III and leading an army via voice commands and the AI actually listen to your commands.

Advanced AI… Who cares?
With SIMA, we’re another step closer to Artificial General Intelligence, AGI.

AGI is a type of AI that aims to perform at or above human levels across a wide range of general tasks, contrasting with narrow AI designed for specific functions.

True AGI systems is where it can get scary… self aware, abstract thinking, background knowledge, common sense, cause-and-effect understanding, transfer learning capabilities, creativity, sensory perception, fine motor skills, and natural language understanding.

SIMA demonstrates Generalization with its ability to understand shared concepts and skills that are transferrable between virtual worlds. Oh my.

Did you say, more?
Read the Google Deepmind full in depth paper here.

The Figure 01 Robot is Getting Crazy Good

And to be honest, the progress is happening at light speed.

Just for some reference, this was Figure 01 just one month ago:

Now, that demo is impressive, sure. But it doesn’t really leave you with that ā€œwowā€ factor. Toddlers can carry bins better than that. But then…

OpenAI enters chat

So, two weeks ago Figure tapped OpenAI to be their tag team partner. The plan? Slap ChatGPT inside Figure 01 to give it a brain. Turns out, ChatGPT fit like a glove. Here are the results from just two weeks of working together:

Umm, what?? Figure 01 is having full conversations, memory reflection, explaining logic, and organizing dishes better than I ever could. This is actually mind-bottling. PLUS it’ll share its apple with you. His momma must’ve raised him well, look at his manners!

What truly stuck out was how conversational Figure 01 sounded. It almost felt…emotional.

āŒ›ļø Throwback Thursday

A little blast from the past.

Took a trip down memory lane with this one. I basically lived at Gamestop, buying games just because they looked cool. That’s how I stumbled upon one of my all-time favorites, ā€œTy The Tasmanian Tigerā€. If you know it, well, we’re pretty much best friends now. Ah, what simpler times we lived in.

video game stores in 2002

Daily Delight

Just something fun and interesting around the web.

I’m all for physical immersion in video games. So much so that I bought one of the first, albeit, very shitty, vests that would supposedly vibrate whenever you got shot or hit in a game. This was probably 10 years ago if I had to guess. Spoiler alert, it didn’t work.

But check out this guy, I’m taking notes from him. He just gets it.

What’s happening inside the Realm

A list of side quests to explore and more.
  • The Pentagon is spending $1 billion on drones to stymie a potential Chinese invasion of Taiwan

  • It looks like Sora won’t be hitting the streets anytime soon as it’s still very much in the research phase

  • A release date for ChatGPT 4.5 Turbo was potentially spotted on DuckDuckGo, which mentions a launch in June

  • The EU passed the Artificial Intelligence Act, the world’s first piece of legislation to comprehensively regulate AI

That’s all the quests we have for today. Check back tomorrow for more!

Looking to become a sponsor?

Was this email forwarded to you? Subscribe here.