XClick awful detection accuracy

UI.Vision RPA Bug Reports
1

Hi. I’m trying to use XClick to click “Sign” button. But I can’t due to low accuracy.

I tried different Vision Search Confidence. Below are results
0.4

Screenshot from 2021-08-23 14-09-18
Screenshot from 2021-08-23 14-09-18960×487 158 KB

0.5

Screenshot from 2021-08-23 14-09-39
Screenshot from 2021-08-23 14-09-39962×494 111 KB

0.6

Screenshot from 2021-08-23 14-10-02
Screenshot from 2021-08-23 14-10-02717×130 11.1 KB

I also tried to expand the click area, but it’s still doesn’t work

I tried to search not buttons but any icons. With no results.

I tried to use selectWindow | title=MetaMask Notification
but got the error ipcPromise: onAsk

My guess is that maybe some computer vision library is broken on my machine. Because I have similar problems using opencv for any recognition. So maybe I can reinstall something? what library are you using inside xmodules?
My XModules status: Personal Edition active .
I’m on Ubuntu 20.04.2 LTS

2

I tried to change the input image from
lq687o_dpi_120

to
kf1xj7_dpi_120

and got this result

Screenshot from 2021-08-23 14-08-35
Screenshot from 2021-08-23 14-08-35965×454 89.8 KB

3

Something goes wrong here. Can you please post the _last_desktop_screenshot.png files here? You find it in the “Screenshots” tab. Plus also post the original “Sign” input images. Then we can test run the image search here locally.

Explanation: Technically what happens is that the XModules take a screenshot (=> _last_desktop_screenshot.png) and then run the image search on this file.

4

The last screenshot is

__last_desktop_screenshot (5)
__last_desktop_screenshot (5)1920×1080 525 KB

I posted “Sign” input images in the comment above.

5

Were you able to check? What external libraries I can check to make sure everything is working fine?

6

We do not use any external libraries. When I tested it here, it worked.

Some suggestions:

  • Did a reboot help?

  • If not: Have you tried on another system, or maybe with another monitor connected?

  • If that fails: Maybe as a workaround, can you run the automation in a virtual machine with Linux (e. g. Oracle VBox).

7
  • Reboot didn’t help.
  • I don’t have another monitor.
  • Of course, it works in the VirtualBox Ubuntu20.04.
    I need to fix it in my current environment. I don’t want to reinstall ubuntu because of this issue.
    Any ideas?
8

Maybe you know why I can’t connect this notification window using selectWindow ?
I get ipcPromise: onAsk error while trying to do it.

9

Any updates on this?