Work with an open desktop web device

Perfecto supports natural language AI commands for creating test steps for desktop web applications. This functionality is available through the AI Scriptless interface, which enables efficient test creation across both mobile and desktop web platforms.

You can use AI Scriptless to:

  • Create tests for desktop web applications using natural language

  • Enhance Selenium automation tests with AI-generated commands

    Enhancing Selenium tests with AI commands does not require additional licensing.

Interface availability based on licensing

The interface displayed in the Perfecto UI depends on your license configuration:

  • The AI Scriptless interface appears for users with both the Perfecto AI license and the Desktop Web license. This interface supports AI-powered testing for mobile and desktop platforms.

  • The Scriptless Mobile interface appears for users without one or both of these licenses. This interface only supports mobile testing as well as AI assistant support for Appium and Selenium testing.

When you open a desktop web device, Perfecto launches the device in the devices area of the interface. You can then use natural language to create and run AI-powered test steps for desktop web applications. Scriptless supports a range of configurations across popular desktop web browsers, operating systems, and screen resolutions.

With the AI Assistant, you can:

  • Describe test steps in plain English

    Generate steps to test different scenarios or verify application flows.

  • Refine prompts until they’re just right

    Iterate on your test logic using natural language.

  • Copy AI-generated steps into your Selenium scripts

    Seamlessly integrate AI-created steps into your existing automation..

To learn how to access, exit, and work with desktop mode, see the instructions later in this section.

00:00: To open a device, click Open Device.

00:03: Click Web.

00:04: Select the desired configuration and click Select.

00:08: To get an expanded devices pane for easier

00:10: interaction, click Expanded.

00:13: You can interact with the web device with the available

00:15: widgets. In the widgets pane, click the Device button.

00:20: To view basic information for a selected device, click Info.

00:24: The DEVICE tab displays the device ID or attributes. To view or

00:28: copy the ID or attributes, click the CAPABILITIES tab.

00:32: You can quickly take screenshots of the current device screen.

00:35: In addition, you can preview, sort, download, and delete the screenshots.

00:40: In the widgets pane, click the Environment button. You can set the device's

00:44: physical location with the IP geolocation widget.

00:48: You can simultaneously close all devices open in the devices pane using

00:52: the Close all open devices button.

00:55: You can change the size of a device to get a better view. To do this,

00:59: use the zoom in, zoom out, and fit buttons.

01:02: To view and modify parameters for a command double.

01:05: Click the command, the parameters are displayed in the parameters, pane below

01:10: the test editor,

01:11: To open an AI assistant pane, click the AI command. The AI

01:16: assistant pane appears below the test editor.

01:19: To execute a test on a web device, click the Execute test button.

01:23: To select a device for test execution, click Select device.

01:28: Click Web.

01:29: To launch the device with the selected configuration, click select.

01:34: You can add non-ai commands to your test.

01:36: While executing these tests, you must use a mobile device for the non-ai

01:40: commands execution, double click a command.

01:43: To add a new variable to the test, click Configure test variables.

01:48: Click Add New Variable.

01:50: Select a variable of type Device.

01:53: To add a value to the variable, click Select device.

01:57: For non-AI commands, you must select a Mobile device.

02:00: Click Select.

02:02: Click Apply. The variable created here is now available for test

02:06: execution.

02:08: You can now create and run AI-driven tests on desktop web devices.

02:11: You can also use widgets to perform various actions using the widgets.

Requirements and limitations

  • Licensing: The AI Scriptless experience requires both the Perfecto AI license and the Desktop Web license. For details, contact Perfecto Support.

  • Interaction model: Desktop web devices are controlled exclusively through AI commands. Scriptless Mobile commands are not supported.

    A Scriptless Mobile test can include commands for both desktop web and mobile devices.

  • Platform support: macOS devices are not supported for desktop web testing.

In this section