Running compound tests on Android devices on BitBar Cloud

You can run compound tests that contain mobile tests on Android mobile devices that are connected to the BitBar Cloud.

Before you begin

You must have completed the following tasks:
  • Recorded mobile tests. See Recording mobile tests for Android applications.
  • Created a compound test that contains mobile tests, see Creating a compound test.
  • Set up your account to access the BitBar Cloud. You must have valid credentials such as the host name or the URL of the BitBar Cloud instance, and an API key to authenticate the connection.
  • Uploaded the .apk file of the Android application that you want to test on an Android device in the BitBar Cloud. For information, refer to Live Testing in the BitBar documentation.
  • Installed the Android application that you want to test on the Android device.

About this task

When you run mobile tests, you can enable Test UI to collect metrics for certain parameters of the resources used by the mobile applications or devices. You can select the Resource Monitoring option and set the time intervals for the collection of the metrics during the test run.
Important: The collection of Resource Monitoring metrics and display of the data graphically is supported only when you run a compound test on a single device.

Procedure

  1. Open the UI Test perspective in Test UI if it is not already open.
  2. Select the compound test that contains the mobile tests from the Test Navigator pane.
    The test window is displayed.
  3. Click Window > Preferences > Test > Test Execution > UI Test Playback.

    The UI Test Playback pane is displayed.

  4. Perform the following steps in the UI Test Playback pane:
    1. Click the Mobile Device Cloud tab.
    2. Select the BitBar host checkbox to enable the options on the BitBar Device Cloud Environment panel.
    3. Perform the actions as listed in the following table:

      Option

      Action

      BitBar host

      Enter the host name of the BitBar Cloud instance.

      API Key
      Enter the API key of your BitBar Cloud account to authenticate the connection, and then click the Refresh projects and device groups Image of the refresh icon..
      Note: Clicking the Refresh projects and device groups Image of the refresh icon. enables the Project and Device Group fields.

      Project

      Select the BitBar project from the drop-down list or an enter an appropriate name for the project with which you can identify the test run on the BitBar Cloud dashboard.

      Device Group

      Select the mobile device group that you want to use in the BitBar cloud.
      Test Run

      Enter an appropriate name for the test with which you can identify the test run on the BitBar Cloud dashboard.
    4. Click Apply and Close.
      Note: When the connection with the BitBar Cloud instance is successful, the mobile devices that you have configured on the BitBar Cloud are displayed in the Run using drop-down list.
  5. Click the Run Compound Test icon.

    The Run Configuration dialog is displayed.

    Perform any of the following actions:
    • To run each mobile test that are in the compound test on a specific device, go to step 6.
    • To simultaneously run all the tests that are in the compound test on the same set of devices, go to step 7.
  6. Clear the Run on several devices and browsers in parallel option, if selected, and then perform the following actions:
    1. Click the Run using option for each test, to view the mobile devices or emulators that are connected to the BitBar Cloud.
    2. Select a device from the list.
    3. Repeat steps 6.a and 6.b, for each of the tests in the Compound test.
    4. Click Next.

      The Advanced Playback Options dialog is displayed. Go to step 8.

  7. Select the Run on several devices and browsers in parallel option, if not selected.
    All the mobile devices and emulators that are connected to the BitBar Cloud are displayed.

    You must perform the following steps:

    1. Select the devices on which you want to run the test.
    2. Click Next.

      The Advanced Playback Options dialog is displayed. Go to step 8.

  8. Select the advanced playback options as required for the test run.
    The options are described in the following table:
    Option Action
    Global steps delay in milliseconds Select this checkbox and specify the duration of delay in milliseconds to set the delay between all the steps in the test.
    BitBar Project Select the BitBar project from the drop-down list or enter an appropriate name for the project with which you can identify the test run on the BitBar Cloud dashboard.

    When you select or specify a project in this drop-down list, the value overrides the project selected in Windows > Preferences > Test > Test Execution > UI Test Playback. Also, the selected value continues to display for the subsequent test runs.
  9. Click Next.

    The Performance Measurement dialog is displayed.

  10. Perform the following steps if you want Test UI to collect the Resource Monitoring metrics during the test run:
    1. Select the Resource Monitoring option.
    2. Set the interval to collect the metrics by entering a number in the Polling interval field.
      Note: The minimum value that you can enter in the Polling interval field is 1000 milliseconds.
  11. Click Finish.

Results

The test runs on the selected mobile devices or emulators. The test result is displayed as a unified report in Test UI.

What to do next

You can view the unified report for the mobile tests and choose to export the unified report. See Unified reports.

If you opted to collect the Resource Monitoring metrics, you can view the metrics displayed graphically in the UI Test Statistical report. You can analyze the Resource Monitoring metrics to manage the resources of the device or the mobile application under test. See UI Test Statistical report.