OpenAI IPO Preparations: Big Guns Signal Shift in AI Data Analysis Landscape

Gemini for macOS: AI Computer Use

Google has added computer use capabilities to its Gemini desktop application on macOS. This feature enables Gemini to complete multi-step tasks by interacting with native Mac apps, local files, and websites on the user's behalf. Users can observe the…

Google's Gemini desktop application for macOS now allows its AI to perform tasks directly on your computer, navigating apps and browsing the web.

TL;DR

Google has added computer use capabilities to its Gemini desktop application on macOS. This feature enables Gemini to complete multi-step tasks by interacting with native Mac apps, local files, and websites on the user's behalf. Users can observe the AI's actions in a live preview and pause or approve them.

Key facts

  • Maker: Google
  • What's new: AI can take actions directly on a user's Mac
  • Access: Requires Gemini app for Mac and a Google AI Plus, Pro, or Ultra subscription
  • Availability: Initially in English in the U.S.
  • Context: Other AI model makers already offer agentic features
Google logo subtly fused into a Mac computer, symbolizing Google AI on macOS

What is it?

Gemini for macOS now includes a 'computer use' feature. This allows the AI agent to perform actions directly on the user's Mac computer. It can navigate native Mac applications and browse websites in the background.

How does it work?

Users instruct the AI on what they want to achieve. The AI then completes multi-step tasks involving local files, apps, and the web. A live preview shows the agent working, while the user's screen and cursor remain free. Users can pause, stop, and approve the AI's actions.

Why does it matter?

This feature helps automate tedious tasks and workflows. It can handle repetitive actions across files, organize files, create slideshows, and fill out forms. This aims to improve efficiency for users by offloading routine computer operations.

Who is it for?

Users who want to automate repetitive or multi-step tasks on their Mac.

Try it

Available with the Gemini app for Mac and a Google AI Plus, Pro, or Ultra subscription in English in the U.S.

Frequently asked questions

How can Gemini for macOS use my computer?

Gemini can take actions directly on your Mac. It navigates native Mac apps and browses websites in the background to complete tasks on your behalf.

What kind of tasks can Gemini perform on my Mac?

Gemini can complete multi-step tasks across local files, apps, and the web. Examples include filling out forms, repeating tasks across files, organizing files, and creating slideshows.

Is the Gemini computer use feature available everywhere?

The feature is initially available in English in the U.S. Google did not announce when it would expand to other markets or platforms.

What do I need to use Gemini's computer use feature?

You need the Gemini app for Mac and a Google AI Plus, Pro, or Ultra subscription to use this feature.

Sources

  1. TechCrunch

Follow news like this automatically

RAI AI watches news, X, Telegram and Reddit for the topics you choose and sends a short AI summary to the app, email or Telegram. Try RAI AI free for 7 days