Reimagining the mouse pointer for the AI era

 (deepmind.google)

28 points | by devhouse 1 hour ago

8 comments

  • mcookly 1 minute ago
    I wonder what sort of monstrous power would be unleashed if Google used Plan9 as a foundation.
  • loaderchips 25 minutes ago
    It's beautiful how the human mind can take something very obvious but overlooked and make it into this fantastic innovation. Fab stuff.
  • iridione 9 minutes ago
    Interesting! I wonder how UI will evolve in the long-term? If there are browser-use/computer-use and clicky-clones automating pointer actions, do we really need complex UI anymore? If yes, when?
  • AbuAssar 29 minutes ago
    so Google will be monitoring whatever on the screen continuously or only when the user say the magic words (this, that, here, there)?
    [-]
    • EdgeExplorer 4 minutes ago
      Indeed. "AI-enabled pointer" is misdirection. This isn't an AI-enabled pointer; it's sending screen to AI, which yes, includes pointer position. The AI doesn't live in the pointer. The AI lives, apparently, so thoroughly in the system that it can see and do anything, and the pointer is just a way of giving it context.
  • SirFatty 21 minutes ago
    It only took Google and their AI offering to come up with Graffiti.
  • mvdtnz 9 minutes ago
    Both of the text based demos would have been simpler and faster with traditional mouse and keyboard interactions. What is the AI adding?
    [-]
    • slopinthebag 4 minutes ago
      It feels like everything modern is like this. No value added, just the appearance of it.
  • themafia 19 minutes ago
    > We’ve been exploring new AI-powered capabilities to help the pointer not only understand what it’s pointing at, but also why it matters to the user.

    We couldn't quite track you well enough before. So we're fixing that under the guise of "AI powered capabilities."

  • strgrd 25 minutes ago
    No thanks