Skip to main content

Virtual Element Selectors

The virtual application automation activities needs user to specify the image or position on the screen during process designing. These images could be buttons, input fields, display fields, and others.

Process Designer provides an easy way to user to specify these images or videos on screen so that our Buddies will be able to identify dynamically during run time.

Mouse Input Selector#

To select the UI element on a screen, perform the following steps:

  • Click on the Indicate Image on Screen button available as part of that Activity.
  • This will minimize the Process Designer application and converts the mouse pointer to image selection lens.
  • Mark the region on the screen to specify the UI element
  • Select the position of the element to perform the mouse operation. Following values are supported:
PositionDescription
TopLeftMouse operation is performed on top-left corner of the identified image
TopRightMouse operation is performed on top-right corner of the identified image
BottomLeftMouse operation is performed on the bottom-left corner of the identified image
BottomRightMouse operation is performed on the bottom-right corner of the identified image
CenterMouse operation is performed on the center of the identified image. By default, Center will be selected.
  • Click on OK to complete your selection

Keyboard Input Selector#

To select the UI element on a screen, perform the following steps:

  • Click on the Indicate position on Screen button available as part of that Activity.
  • This will minimize the Process Designer application and converts the mouse pointer to image selection lens.
  • Mark the region on the screen to specify the UI element
  • Once the position is selected, it will bring up Virtual Keyboard from where you can type in the text and any special keys to be sent to the input element or window
  • Click on Save to complete your selection.

Scrape Region Selector#

To select a region on your screen from where you need to extract the text, perform the following steps:

  • Click on the Indicate Images on Screen button available as part of that Activity.
  • This will minimize the Process Designer application and converts the mouse pointer to image selection lens.
  • Mark the region on the screen to specify the Anchor image
  • Click on OK to indicate the relative region to scrape the text
  • Mark the scrape region on the screen