Test creation by Test Genie - Tech Preview

Disclaimer:

This release contains access to the Test Genie feature in HCL DevOps Test Hub (Test Hub) as a Tech Preview. The Tech Preview is intended for you to view the capabilities of Test Genie offered by HCL Test Hub, and to provide your feedback to the product team. You are permitted to use the information only for evaluation purposes and not for use in a production environment. HCL provides the information without obligation of support and "as is" without warranty of any kind.

You can initiate the testing phase early in the web application development cycle with test creation by using Test Genie. Test Genie is a dynamic feature that leverages machine learning and AI capabilities to create tests by using the designs of web applications under development.

Instead of waiting for a fully deployed application, you can create Web UI tests with wireframes or screen captures by using Test Genie.

Here is the task flow of tests generated by Test Genie for web applications:

  1. Adding designs: You can provide design images of a web application (such as wireframes or mockups) rather than a live URL. You can upload multiple designs and generate mutliple tests for each of the design.
  2. Selecting an AI provider: You can specify the AI provider to be used for test generation. Currently, Test Hub supports OpenAI, Ollama, and IBM watsonx. You must have access to these AI providers and you must have configured the credentials Test Hub before you generate a test.
  3. Providing prompt: You can provide a prompt that defines the screen or the task involved. This is an optional step for a generic test flow. However, you must follow these guidelines for a specific test flow generation:
    • Define the objective of the prompt.
    • Frame a clear and focused prompt to include or exclude any specific action. For example, you can use instructions such as "Generate only the login flow test for this image" or "Don’t include a verification step for the login flow test".
    • Refine the prompt if the result is not satisfactory.
  4. Generating a test flow: Test Genie automatically detects UI elements within the image and generates the test flow.
  5. Viewing and refining the test flow: You can review the generated test flow, and if not satisfied with the results, modify the prompt and re-generate the test flow to refine it.
  6. Generating the test: Test Genie generates a test based on the flow that it has displayed. Also, the generated test is listed in the test navigator panel.
  7. Modifying the test: You can open the test in Test Editor and modify the step details as required. If any of the controls are not part of the flow, in the test, you can manually add steps for such controls.
  8. Running tests on the deployed application: When the actual application is deployed, you can update the URL and run the tests, ensuring consistency between the design and the final product. After you run the test, you must replace the smartshots for failed steps with the latest screens of the application that is captured during the previous test run. See Viewing step-level results and updating tests.