Google's Gemini Live AI is finally taking mobile apps seriously

When Google introduced theGemini Liveavatar of its AI, it was nothing short of a revelation. The ability to have freewheeling conversations with an AI, which can also see the world around you through the phone’s camera and make sense of it, issomething that still astonishes me. Now, it is getting ready to work seamlessly with the Android apps installed on your phone.

What is changing?

At itsPixel 10Launch event, Google announced that Gemini Live can now work with Calendar, Keep, and Tasks. So, let's say you are talking to the AI, and want to quickly save a note, you can do so by simply speaking the task. And while at it, you no longer have to open the Keep app.

While chatting with Gemini Live, you can directly tell it things like "save a note about picking up cabbage from the store," or "add an entry for a meeting with John at 4pm this Saturday in Calendar."

The idea is to seamlessly connect Gemini Live with apps, just as Gemini has already been deeply integrated within Google tools such as Docs, Gmail, Search, and more. With Gemini Live, you don't have to click or type, or even switch to another app. All you need to do is say the command and it will be seamlessly executed in the background.

The best is yet to come

Gemini already works with Google's own apps as well as third-party software such as WhatsApp using a system of connectors. Google is now focused on bringing that convenience to its mobile apps via Gemini Live for added voice-first convenience.

In addition to Calendar, Keep, and Tasks, Google is also bringing it to the core communication apps. "We're adding the Messages, Phone, and Clock apps and bringing additional capabilities into our Google Maps integration, so Gemini Live will be able to help you in even more ways," the company said in a blog post.

Google says it's updating the underlying models to ensure that Gemini Live conversations sound even more natural. Users will also be able to instruct Gemini Live to speak slowly and match their note-taking speed.

The Latest Tech News, Delivered to Your Inbox