Ui.Vision Introduces Anthropic Claude Computer Use Integration

Announcements
1

V9.3.8 brings Anthropic Claude Computer Use integration through the new aiComputerUse command.

Ui.Vision has consistently been at the forefront of visual web automation. With Claude’s integration, we’re taking the next step forward. The new aiComputerUse command allows you to automate complex tasks with a single line of code that would traditionally require hundreds of lines of classic Ui.Vision commands (such as XClick, OCRExtractScreenshot, If/then statements, and more). For example, you can now teach Ui.Vision to play TicTacToe (demonstrated in the video below).

This release includes four new AI demo macros that showcase how to use the new aiComputerUse command:

AI Computer Use Tutorial

Watch these two videos demonstrating our Computer Use (CU) demo macros in action:

Video of CU_PlayTicTacToe running:

:arrow_right: Prompt: “Play TicTacToe…”

Video of CU_FillForm running:

:arrow_right: Prompt: “Fill form with artificial data…”

2 Likes
5

I see that Firefox 9.3.8 is already available, but when will we get Computer Use for Chrome?

6

V9.3.8 is available now in the Chrome store :slight_smile:. The auto-updates will roll out over the next days.