Running compound tests on Android devices on LambdaTest

You can run compound tests for mobile tests on LambdaTest Cloud so that you can choose devices from a wide range of Android devices that are available for testing.

Before you begin

You must have completed the following tasks:
  • Recorded mobile tests. See Recording mobile tests for Android applications.
  • Created a compound test that contains mobile tests and Web UI tests, see Creating a compound test.
    Note: Each test must end with a close application or close browser step as applicable.
  • Set up your account to access LambdaTest Cloud. You must have valid credentials such as the username, either the hostname or the URL of the LambdaTest Cloud instance, and an API key to authenticate the connection. This key is available under ACCESS KEY in the LambdaTest dashboard.
  • Uploaded the .apk file of the Android application to the LambdaTest server for testing. For more information, refer to Live Testing in the LambdaTest documentation.
  • Installed the Android application that you want to test on the Android device.
  • Verified that the device you want to test is in the list of active devices. The list displays the devices that are in the Released state on LambdaTest Cloud at the time of selection for a test run.
Note: If you run a compound test that requires Test UI to open the same browser multiple times because of multiple Web UI tests, LambdaTest Cloud might allocate a different device of the selected model for each test run. This allocation depends on the available devices in the released state and might result in test runs on browsers of different versions.

About this task

When you run mobile tests, you can enable Test UI to collect metrics for certain parameters of the resources used by the mobile applications or devices. You can select the Resource Monitoring option and set the time intervals for the collection of the metrics during the test run.
Important: The collection of Resource Monitoring metrics and display of the data graphically is supported only when you run a compound test on a single device.

Procedure

  1. Open the UI Test perspective in Test UI if it is not already open.
  2. Select the compound test that contains the mobile tests from the Test Navigator pane.
    The test window is displayed.
  3. Click Window > Preferences > Test > Test Execution > UI Test Playback.

    The UI Test Playback pane is displayed.

  4. Perform the following steps in the UI Test Playback pane:
    1. Click the Mobile Device Cloud tab.
    2. Select the LambdaTest host checkbox to enable the options on the LambdaTest Device Cloud Environment panel.
    3. Perform the actions as listed in the following table:
      Option Action
      Required
      LambdaTest host Enter the URL of the LambdaTest Cloud instance.
      User Name Enter the user name of your LambdaTest Cloud account.
      API key

      Enter the API key of your LambdaTest Cloud account to authenticate the connection.
      Project Select the LambdaTest project from the drop-down list or enter an appropriate name for the project with which you can identify the test run on the LambdaTest Cloud dashboard.
    4. Click Apply and Close.
      Note: When the connection with the LambdaTest Cloud instance is successful, the mobile devices that are on LambdaTest Cloud are displayed in the Run using drop-down list.
  5. Click the Run Compound Test icon.

    The Run Configuration dialog is displayed.

    You must choose one of the following options:
    • Go to step 6 to run each mobile test that is in the compound test on a specific device.
    • Go to step 7 to simultaneously run all the tests that are in the compound test on the same set of devices.
  6. Clear the Run on several devices and browsers in parallel option, if selected, and then perform the following actions:
    1. Click the Run using option for each test, to view the mobile devices or emulators that are connected to LambdaTest Cloud.
    2. Select a device from the list.
    3. Repeat steps 6.a and 6.b, for each of the tests in the compound test.
    4. Click Next.

      The Advanced Playback Options dialog is displayed. Go to step 8.

  7. Select the Run on several devices and browsers in parallel option, if not selected.
    All the mobile devices and emulators that are connected to LambdaTest Cloud are displayed.

    You must perform the following steps:

    1. Select the devices on which you want to run the test.
    2. Click Next.

      The Advanced Playback Options dialog is displayed. Go to step 8.

  8. Select the advanced playback options as required for the test run.
    The options are described in the following table:
    Option Action
    Global steps delay in milliseconds Select this checkbox and specify the duration of delay in milliseconds to set the delay between all the steps in the test.
    LambdaTest Project Select the LambdaTest project from the drop-down list or enter an appropriate name for the project with which you can identify the test run on the LambdaTest Cloud dashboard.

    When you select or specify a project in this drop-down list, the value overrides the project selected in Windows > Preferences > Test > Test Execution > UI Test Playback. Also, the selected value continues to display for the subsequent test runs.
  9. Click Next.

    The Performance Measurement dialog is displayed.

    Note: There is no action to be performed by you for mobile tests.
  10. Click Finish.
    Note: The LambdaTest Cloud platform displays the name of the individual tests instead of the name of the compound test that you selected for the test run.

Results

You have run the compound test on multiple Android devices that are available on LambdaTest Cloud.

What to do next

You can view the unified report for the mobile tests and choose to export the unified report. See Unified reports.

If you opted to collect the Resource Monitoring metrics, you can view the metrics displayed graphically in the UI Test Statistical report. You can analyze the Resource Monitoring metrics to manage the resources of the device or the mobile application under test. See UI Test Statistical report.