Google Gemini just took another step toward smart home control

Given up on trying to get Google Assistant to dim the lights or pull your drapes? If you’re an Android user, now’s your chance to give Gemini a spin with your smart home. 

Google has just released an extension for the Gemini app that allows Google’s LLM to take charge of a wide range of smart gadgets, from smart lights and thermostats to smart shades and TVs. 

For now, you’ll need the Android version of the Gemini app, and you’ll also need to be enrolled in Google’s Public Preview program. 

Once you’ve enabled the Google Home extension on the Gemini app (this Google support page has all the details), you’ll be able to give smart home commands to Gemini that had previously been executed by Google Assistant. 

For example, you’ll be able to say (or type) things like “Hey Google, it’s too bright in the kitchen,” or “Set the living room for a romantic date night,” and Gemini will take action, whether it means pulling your smart shades or dimming the lights and turning on the TV. 

The new Google Home extension for Gemini doesn’t give the LLM total control of your smart home. For now, only the following categories are supported (according to Google): 

• Lights & power, like lights, outlets, and switches 
• Climate control, like air conditioning units, thermostats, heaters, and fans 
• Window coverings, like curtains, blinds, and shutters 
• Media devices, like TVs and speakers 
• Other smart devices, like washers, coffee makers, and vacuums 

Google warns that Gemini’s smart-home control abilities are (for the moment, anyway) “for convenience only, not safety- or security-critical purposes.” 

Specifically, Gemini can’t do anything with a security device that requires a PIN, stream video feeds from security cams, or perform “some” actions on gates, locks, doors, garage doors, and other security-related devices.

Triggering routines is currently off-limits for Gemini, too.

This actually isn’t the first time that Gemini’s been able to control smart home devices. The smart home-controlling conversation agents for the DIY Home Assistant platform got LLM integrations back in June, including for both ChatGPT and Google Gemini.  

Just plug your Gemini API key into the proper Home Assistant extension, and you’ll be able to ask Gemini to dim the lights, turn on your smart TV, and more. (Give Gemini the right system prompt, and it may even play smart home-related games, like “Guess the number of smart lights that are on!”) 

Google outlined its smart home plans for Gemini back in August, including the ability to describe the happenings in a Nest Cam video event, more “fluid” conversations with Google Assistant, and the ability to make home automation suggestions based on natural-language queries.