Supported actions

This section provides information on basic device interaction during live testing. It specifies:

  • The actions currently supported for mobile, virtual, and desktop web devices, available from the device toolbar.
  • Keyboard options and mouse actions you can use to interact with the device.

Device toolbar

The following table describes the options available on the device toolbar.

Option Description Real device Virtual device Desktop web device

Click to retrieve device information, including OS, device ID (which reflects the real UDID, Unique Device Identifier, here), location, and so on, and generate capabilities. The available information is different for each device type.

Click to copy the session ID. See also Share a session with an IDE script.

Click to add a checkpoint at any point during your test. See Add a checkpoint.

Click to turn on Accessibility mode and perform VoiceOver testing (iOS devices only). See Test accessibility with VoiceOver or TalkBack.

   

Click to draw a frame around the desktop image.



Click to enter full-screen mode. You can take screen shots in full-screen mode. To access other widgets, you need to switch back to regular mode.      

Click to install, run, stop, delete, or look for an application on the device. For details, see Manage apps.

Note that with the exception of secured screen instrumentation, instrumentation is not supported.


Click to start and stop image injection.



Click to inject a fingerprint (iPhone 8 or earlier) or face ID (iPhone X or later). For details, see Inject a fingerprint or face ID.



Click to set a location.



Click to set an IP geolocation. This simulates the physical location of the device to a country of your choice.

 

Click to initiate network virtualization.



Click to initiate an SMS to this device.



Click to initiate a call to this device.



Click to inject an audio file.



Click to enter secure text in a sensitive text field, such as a password field.

On devices running iOS 13 or later, clicking a secure field automatically opens the Enter text dialog box. On Android devices, you need to open this dialog box manually.

   

Click to turn audio on or off for the device. Note that turning on audio when a video is playing on the open device momentarily halts the video while Perfecto retrieves the audio stream.

Unavailable if the device does not support audio.

Android audio streaming is only supported in enterprise clouds, on devices running Android 12 or later. Earlier Android versions may work as well but are not officially supported.

   

Click to restart the device, for example when the device freezes or for a fresh start.

Restriction: Depending on your cloud configuration, only users with admin or lab admin roles can restart a device. To enable this configuration in your cloud, contact Perfecto Support.



Click to connect the device to or disconnect the device from DevTunnel.



Click to rotate the device from portrait to landscape and vice versa. 

On virtual devices, rotation only works if the screen supports it. For example, the Home screen only supports portrait mode. If you launch an app, perform a touch action, or press the Home button, the rotation may change. In addition, a rotated device switches back from landscape mode to portrait mode when you access a screen that does not support rotation, such as the home screen. 


Click to transfer, download, upload, or delete a file.



Click to view the device log.


Click to perform text analysis.



Click to perform visual analysis.



Click to spy objects on the device screen. This opens the Object Spy in the right pane. 



Session persistence

Depending on the device you select, sessions are either alive for a single session only or persist.

*

   

* Public cloud only

Keyboard options

When you type numeric or alphabetic characters on the physical desktop keyboard, Perfecto instantly sends them to the mobile device. In addition, the keys listed in the following table are supported and may be helpful while editing text on a real and virtual mobile devices.

Keyboard key

Command description

Real & virtual device

Up

Moves cursor up

(Android only)

Down

Moves cursor down

(Android only)

Left

Moves cursor left

(Android only)

Right

Moves cursor right

(Android only)

Backspace

Deletes the last character 

(Android only)

Delete

Deletes the next character

(Android only)

Enter

Adds a new line/Submits/Searches

(Android only)

Mouse actions

The table lists the mouse actions currently supported on real and virtual mobile devices.

Mouse action

Command description

Real device

Virtual device

Alt+Wheel forward

Zooms in

Alt+Wheel backward

Zooms out (pinch)

Wheel forward/backward

Scrolls

Click+Pointer move

Swipes (horizontal/vertical)

Left click

Taps

Long left click (> 2 seconds)

Presses long

Alt+Click

Activates 3D Touch

 (Simulator/iOS only)


Shift+Click

Double-tap