[Issue #557] No ipc available for the playing commands tab

UI.Vision RPA Bug Reports
1

Hi,
I’m new to Kantu and this is my first program.
Xclick, doubleclick,… all that works, but i’m trying to do screen scrape with OCRExtractRelative and gives the following error message for Desktop mode:
[error] No ipc available for the playing commands tab

I even tried restarting browser and also computer, still facing same issue.

Also, exported this same program to html and run on chrome browser gives this error, even though i turned-on the “Allow access to File URLs” and restarted the browser and computer:

Error #204: It seems Kantu is not installed yet - or you need to turn on Allow access to file URLs for Kantu in your browser extension settings

Could you please help!

Thanks,
Rajesh Vagicherla.

2

Hi, can you please add a screencast of the situation? This can help me understand what is going on.

3

Hi Admin,

Here is the screencast link: https://www.loom.com/share/88c780f886bb40f0999085ceaa00a293
Sorry i have to trim part of the video as it contains company’s data.
Please let me know if you need any other details about the issue.

{
“Command”: “OCRExtractRelative”,
“Target”: “sap_delv_lines_relative.png”,
“Value”: “DELV_LINES”
},
{
“Command”: “echo”,
“Target”: “Delv Lines: ${DELV_LINES}”,
“Value”: “”
},

Thanks,
Rajesh.

4

Thanks a lot for the screencast, that helped a lot! => I confirmed the issue and we will be fixing it with the next update.

Meanwhile, you can use this workaround: Add an OPEN command at the top of our macro and have it open any website. This avoids the “[error] No ipc available for the playing commands tab” error.

5

Hi Admin,
Thanks for the quick response.
I added OPEN command as workaround and it solved that error and OCR extract relative works for DELV_LINES.

However i’m using OCR extract relative to extract EMAIL and DELV_SHIP_DETAILS in the later code.
Log shows result received, but couldn’t echo the value, please see log messages below…

  • [info] Executing: | OCRExtractRelative | sap_cust_email_relative.png | EMAIL |
  • [info] OCR (eng) started (1.9 KB)
  • [info] OCR result received (1.0s)
  • [info] Executing: | echo | Cust Email: ${EMAIL} | |
  • [echo] Cust Email:
  • [info] Executing: | XClick | sap_cust_close.png | |
  • [info] Executing: | XClick | sap_delv_doc_flow.png | |
  • [info] Executing: | XClick | sap_delv_shipment.png | |
  • [info] Executing: | OCRExtractRelative | sap_delv_ship_details_relative.png | DELV_SHIP_DETAILS |
  • [info] OCR (eng) started (1004 byte)
  • [info] OCR result received (1.0s)
  • [info] Executing: | echo | Delv Ship Details: ${DELV_SHIP_DETAILS} | |
  • [echo] Delv Ship Details:

Even the last desktop screenshot show values have been captured and no error message.

Here is the JSON script…

{
“Name”: “SAP_Delivery_Extract”,
“CreationDate”: “2019-5-24”,
“Commands”: [
{
“Command”: “open”,
“Target”: “http://google.com”,
“Value”: “”
},
{
“Command”: “store”,
“Target”: “1000671988”,
“Value”: “DELV_NO”
},
{
“Command”: “store”,
“Target”: “”,
“Value”: “DELV_LINES”
},
{
“Command”: “store”,
“Target”: “”,
“Value”: “EMAIL”
},
{
“Command”: “store”,
“Target”: “”,
“Value”: “DELV_SHIP_DETAILS”
},
{
“Command”: “XClick”,
“Target”: “sap_icon.png”,
“Value”: “#doubleclick”
},
{
“Command”: “XClick”,
“Target”: “sap_logon_con.png”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “sap_logon_pr1.png”,
“Value”: “#doubleclick”
},
{
“Command”: “XClick”,
“Target”: “sap_home_command_input.png”,
“Value”: “”
},
{
“Command”: “XType”,
“Target”: “vl03n${KEY_ENTER}”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “sap_delv_input.png”,
“Value”: “”
},
{
“Command”: “XType”,
“Target”: “${DELV_NO}${KEY_ENTER}”,
“Value”: “”
},
{
“Command”: “OCRExtractRelative”,
“Target”: “sap_delv_lines_relative.png”,
“Value”: “DELV_LINES”
},
{
“Command”: “echo”,
“Target”: “Delv Lines: ${DELV_LINES}”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “delv_cust_details.png”,
“Value”: “”
},
{
“Command”: “OCRExtractRelative”,
“Target”: “sap_cust_email_relative.png”,
“Value”: “EMAIL”
},
{
“Command”: “echo”,
“Target”: “Cust Email: ${EMAIL}”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “sap_cust_close.png”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “sap_delv_doc_flow.png”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “sap_delv_shipment.png”,
“Value”: “”
},
{
“Command”: “OCRExtractRelative”,
“Target”: “sap_delv_ship_details_relative.png”,
“Value”: “DELV_SHIP_DETAILS”
},
{
“Command”: “echo”,
“Target”: “Delv Ship Details: ${DELV_SHIP_DETAILS}”,
“Value”: “”
},
{
“Command”: “XClick”,
“Target”: “sap_find_another_delv.png”,
“Value”: “”
}
]
}

Could you please help!

Thanks,
Rajesh.

6

The macro itself looks ok, but maybe something wrong with the input images => Can you please add the images to your post:

  • sap_cust_email_relative.png
  • sap_delv_ship_details_relative.png
8

  • sap_cust_email_relative.png
    sap_cust_email_relative

  • sap_delv_ship_details_relative.png
    sap_delv_ship_details_relative

9

I tested the images on https://ocr.space (same OCR engine that Kantu uses) and the result is ok. At least something should be in these variables. Do all your OCRExtractRelative commands fail (no text returned) or “only” these two?

sap%20automation%20ocr1
sap%20automation%20ocr11215×569 36.5 KB

10

Here is a short screencast that shows some best practices for testing and debugging screen scraping with OCRExtractRelative:

  1. Use Find button => Check OCR overlay
  2. Check _lastscreenshot.png in the “Screenshots” tab. It has the image that was last used as input for OCR.
  3. Output result with echo (like you did)
11

This issue is fixed with the new V5.0 :grin: