Skip to main content

Selectors

Most of the desktop automation activities need you to select the UI element. These UI elements could be windows, buttons, dropdown lists, and many others.

There are multiple ways to select UI elements on the screen. One of the ways is to identify them based on their position on the screen. However, these methodologies might be unreliable in certain circumstances. Hence, IntelliBuddies captures attributes of UI elements and their parents in the form of XML fragments. Also, IntelliBuddies provides you to select these UI elements through a visual approach enabling faster automation design time.

Element Selector#

To select the UI element within a specified Window, perform the following steps:

  • Click on the Indicate Element on Screen button available as part of that Activity.
  • This will minimize the Process Designer application and brings up the UI element selector dialog window in the foreground
  • It also starts highlighting the UI elements on the screen.
  • You can open the application window, hover the Mouse on the UI element that needs to be selected, and press [F2] to complete the selection process

Note: The selected element's attributes along with its parents are stored in JSON format as part of Search Parameters property of the corresponding Activity.

Group Selector#

UI elements such as Chekboxes and Radio-Buttons might be grouped together to extract single piece of information. However, our Element Selector will not be able to high light the entire group.

For example, if the target application consists of a Radio Button to accept marital status information from the user. Let us say that this Radio Button group contains three buttons: Single, Married, and Divorced. The Element Selector will allow individual radio button selection but not the entire group. Hence, you will have to get the status of all the three separately and then process based on the status.

Instead, you can group these radio buttons or checkboxes as part of design time by selecting the Type property of the corresponding activity to Group. You can select all the needed UI elements using Element Selector and create a Group by saving your selection.

  • Click on the Indicate Element on Screen button available as part of that Activity.
  • This will minimize the Process Designer application and brings up the UI element selector dialog window in the foreground
  • It also starts highlighting the UI elements on the screen.
  • You can open the application window, hover the Mouse on the UI element that needs to be selected, and press [F2] to add the selected element into Group.
  • After adding all the required UI elements into Group, click on Save to save this as a Group selector.

Note: The selected element's attributes along with its parents are stored in JSON format as part of Search Parameters property of the corresponding Activity.

Window Selector#

To select the appropriate application window for automation, IntelliBuddies provides multiple options to find the automation window.

Selection TypeDescription
ElementUse Element Selector to select the window holding this UI element
InstanceSelect the window by the specified window instance.
Note: You can obtain the window instance using Get Window activity
TitleSelect the window by its Title. You can either type-in the title inside Window Title property or select the title from the drop-down.
Note: The drop-down lists all the current windows opened inside the desktop during the design time

Search Parameters#

The Search Parameters property exists under all the activities that need the selection of desktop UI elements. This property holds the attribute collection of the selected UI element and its parents stored in JSON format.

You can view these attributes by clicking on the ellipsis[...] button. Each node, along with its attributes, is displayed in a hierarchical sequence, with the topmost node identifying the root parent and the bottom-most node identifying the selected UI element. Most of the time, the attribute values will be automatically extracted by Element Selector.

Note: In a situation where the target application is opened with elevated privileges or the target application has blocked UI scripting, the element selector might not work.

The attributes that the Element Selector extracted are notified with a checked box. These denoted attributes will be considered for identifying the UI element during the runtime. You can edit the attribute values or select the attributes for element detection from the Search Parameters.