This section provides information on basic device interaction during live testing. It specifies:
- The actions currently supported for mobile, virtual, and desktop web devices, available from the device toolbar.
- Keyboard options and mouse actions you can use to interact with the device.
Device toolbar
The following table describes the options available on the device toolbar.
| Option | Description | Real device | Virtual device | Desktop web device |
|---|---|---|---|---|
|
|
Click to retrieve device information, including OS, device ID (which reflects the real UDID, Unique Device Identifier, here), location, and so on, and generate capabilities. The available information is different for each device type. |
|
|
|
|
|
Click to copy the session ID. See also Share a session with an IDE script. |
|
|
|
|
|
Click to add a checkpoint at any point during your test. See Add a checkpoint. |
|
|
|
|
|
Click to turn on Accessibility mode and perform VoiceOver testing (iOS devices only). See Test accessibility with VoiceOver or TalkBack. |
|
||
|
|
Click to draw a frame around the desktop image. |
|
|
|
|
|
Click to install, run, stop, delete, or look for an application on the device. For details, see Manage apps. |
|
Note that with the exception of secured screen instrumentation, instrumentation is not supported. |
|
|
|
Click to start and stop image injection. |
|
|
|
|
|
Click to inject a fingerprint (iPhone 8 or earlier) or face ID (iPhone X or later). For details, see Inject a fingerprint or face ID. |
|
|
|
|
|
Click to set a location. |
|
|
|
|
|
Click to set an IP geolocation. This simulates the physical location of the device to a country of your choice. |
|
|
|
|
|
Click to initiate network virtualization. |
|
|
|
|
|
Click to initiate an SMS to this device. |
|
|
|
|
|
Click to initiate a call to this device. |
|
|
|
|
|
Click to inject an audio file. |
|
|
|
|
|
Click to enter secure text in a sensitive text field, such as a password field. On devices running iOS 13 or later, clicking a secure field automatically opens the Enter text dialog box. On Android devices, you need to open this dialog box manually. |
|
||
|
|
Click to turn audio on or off for the device. Note that turning on audio when a video is playing on the open device momentarily halts the video while Perfecto retrieves the audio stream. Unavailable if the device does not support audio. Android audio streaming is only supported in enterprise clouds, on devices running Android 12 or later. Earlier Android versions may work as well but are not officially supported. |
|
||
|
|
Click to restart the device, for example when the device freezes or for a fresh start. |
|
|
|
|
|
Click to connect the device to or disconnect the device from DevTunnel. |
|
|
|
|
|
Click to rotate the device from portrait to landscape and vice versa. On virtual devices, rotation only works if the screen supports it. For example, the Home screen only supports portrait mode. If you launch an app, perform a touch action, or press the Home button, the rotation may change. In addition, a rotated device switches back from landscape mode to portrait mode when you access a screen that does not support rotation, such as the home screen. |
|
|
|
|
|
|
|
|
|
|
|
Click to view the device log. |
|
|
|
|
|
Click to perform text analysis. |
|
|
|
|
|
Click to perform visual analysis. |
|
|
|
|
|
Click to spy objects on the device screen. This opens the Object Spy in the right pane. |
|
|
|
|
|
|
|
|
|
|
Session persistence |
Depending on the device you select, sessions are either alive for a single session only or persist. |
|
* Public cloud only
Keyboard options
When you type numeric or alphabetic characters on the physical desktop keyboard, Perfecto instantly sends them to the mobile device. In addition, the keys listed in the following table are supported and may be helpful while editing text on a real and virtual mobile devices.
|
Keyboard key |
Command description |
Real & virtual device |
|---|---|---|
|
Up |
Moves cursor up |
|
|
Down |
Moves cursor down |
|
|
Left |
Moves cursor left |
|
|
Right |
Moves cursor right |
|
|
Backspace |
Deletes the last character |
|
|
Delete |
Deletes the next character |
|
|
Enter |
Adds a new line/Submits/Searches |
|
Mouse actions
The table lists the mouse actions currently supported on real and virtual mobile devices.
|
Mouse action |
Command description |
Real device |
Virtual device |
|---|---|---|---|
|
Alt+Wheel forward |
Zooms in |
|
|
|
Alt+Wheel backward |
Zooms out (pinch) |
|
|
|
Wheel forward/backward |
Scrolls |
|
|
|
Click+Pointer move |
Swipes (horizontal/vertical) |
|
|
|
Left click |
Taps |
|
|
|
Long left click (> 2 seconds) |
Presses long |
|
|
|
Alt+Click |
|
|
|
|
Shift+Click |
Double-tap |
|
|
