None of the makros work in Edge on MacOS (latest), AI Chat also doesnt work. I tried Edge Extension as well as Chrome Extension in Edge. The page doesn’t fill, scroll, noting works. The extension is also not listed in the Privacy & Security tab.
[status]
Playing macro CU_FillForm
[info]
Executing: | XDesktopAutomation | false | |
[info]
Executing: | open | https://ui.vision/contact | |
[info]
Executing: | bringBrowserToForeground | true | s |
[info]
Executing: | aiComputerUse | Fill out this web form with artificial data and submit it.
Two fields have specific content:
For Topic, select 'General Inquiry' from the dropdown (press 'G' when dropdown is open and then ENTER).
For the Subject use 'Test. Ignore this message. Filter me out'.
Fill the Message input box before the Subjext box.
If successful, end with 'SUCCESS'.
If you encounter any errors, end with 'ERROR'.
Tool use instructions:
Saves time: Skip the mouse_move before doing left_click
After scrolling, take a fresh screenshot
| s |
[info]
Computer Use sequence start:
[u]
Fill out this web form with artificial data and submit it.
Two fields have specific content:
For Topic, select 'General Inquiry' from the dropdown (press 'G' when dropdown is open and then ENTER).
For the Subject use 'Test. Ignore this message. Filter me out'.
Fill the Message input box before the Subjext box.
If successful, end with 'SUCCESS'.
If you encounter any errors, end with 'ERROR'.
Tool use instructions:
Saves time: Skip the mouse_move before doing left_click
After scrolling, take a fresh screenshot
[info]
Calling API
[a]
I'll help you fill out the web form with the specified data. Let me start by taking a screenshot to see what we're working with.
[a]
Action: screenshot
[info]
screenshot
[info]
API call complete
[info]
Taking screenshot
[u]
Result: Screenshot taken
[info]
Calling API
[a]
I can see a contact form with several fields. According to the instructions, I need to:
1. Fill the Message box before the Subject box
2. Use specific content for Topic and Subject
3. Fill other fields with artificial data
Let me start by filling out the form. First, I'll fill in the Name field:
[a]
Action: left_click 465, 435
[info]
left_click 465, 435
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 554,518
[info]
Running XClick command target: 554,518
[u]
Result: XClick 554,518 (Scale factor: 0.83949)
[info]
{"x":554,"y":518}
[info]
Calling API
[info]
API call complete
[info]
Running XType command, value: John Smith
[info]
Calling API
[a]
Now I'll fill in the Email field:
[a]
Action: left_click 465, 498
[info]
left_click 465, 498
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 554,593
[info]
Running XClick command target: 554,593
[u]
Result: XClick 554,593 (Scale factor: 0.83949)
[info]
{"x":554,"y":593}
[info]
Calling API
[info]
API call complete
[info]
Running XType command, value: john.smith@example.com
[info]
Calling API
[a]
Now I'll click on the Topic dropdown to select "General Inquiry":
[a]
Action: left_click 353, 561
[info]
left_click 353, 561
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 420,668
[info]
Running XClick command target: 420,668
[u]
Result: XClick 420,668 (Scale factor: 0.83949)
[info]
{"x":420,"y":668}
[info]
Calling API
[info]
API call complete
[info]
Taking screenshot
[u]
Result: Screenshot taken
[info]
Calling API
[a]
The dropdown doesn't appear to be open. Let me click directly on the dropdown arrow:
[a]
Action: left_click 353, 561
[info]
left_click 353, 561
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 420,668
[info]
Running XClick command target: 420,668
[u]
Result: XClick 420,668 (Scale factor: 0.83949)
[info]
{"x":420,"y":668}
[info]
Calling API
[a]
Let me press 'G' to select "General Inquiry" as instructed, then press Enter:
[a]
Action: key
[info]
key
[info]
API call complete
[info]
Running XType command, value: g
[info]
Calling API
[a]
Now I'll press Enter to select it:
[a]
Action: key
[info]
key
[info]
API call complete
[info]
Running XType command, value: ${KEY_ENTER}
[info]
Calling API
[a]
Now I'll fill in the anti-spam field with "899":
[a]
Action: left_click 465, 623
[info]
left_click 465, 623
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 554,742
[info]
Running XClick command target: 554,742
[u]
Result: XClick 554,742 (Scale factor: 0.83949)
[info]
{"x":554,"y":742}
[info]
Calling API
[info]
API call complete
[info]
Running XType command, value: 899
[info]
Calling API
[a]
Now, according to the instructions, I need to fill the Message box BEFORE the Subject box. Let me click on the Message field:
[a]
Action: left_click 465, 779
[info]
left_click 465, 779
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 554,928
[info]
Running XClick command target: 554,928
[u]
Result: XClick 554,928 (Scale factor: 0.83949)
[info]
{"x":554,"y":928}
[info]
Calling API
[a]
Now I'll type a message in the Message field:
[a]
Action: type
[info]
type
[info]
API call complete
[info]
Running XType command, value: This is a test message. Please disregard this automated form submission.
[info]
Calling API
[a]
Now I'll fill in the Subject field with the specified text. Let me click on the Subject field:
[a]
Action: left_click 465, 687
[info]
left_click 465, 687
[info]
API call complete
[info]
Taking screenshot
[info]
Action: XClick target: 554,818
[info]
Running XClick command target: 554,818
[u]
Result: XClick 554,818 (Scale factor: 0.83949)
[info]
{"x":554,"y":818}
[info]
Calling API
[a]
Now I'll type the exact subject text as specified:
[a]
Action: type
[info]
type
[info]
API call complete
[info]
Running XType command, value: Test. Ignore this message. Filter me out
[info]
Macro was stopped manually (Runtime 75.32s)
