What's New

You can find information about the features introduced, enhancements, or other changes made in HCL DevOps Test Performance (Test Performance). You can also find the features that were introduced in previous versions of Test Performance. DevOps Test Performance is the new name of HCL OneTest Performance from 11.0.0 onwards.

What's New in DevOps Test Performance 2024.03 (11.0.1)

The following section lists the features, enhancements, or other changes made in Test Performance.

Feature title Description

Enhanced the UI for dataset editing

The CSV Editor, which is used for editing datasets in Test Performance, currently features an improved user interface. You can now experience changes in the presentation of pages and the methods to configure and edit datasets in the UI.

You can find information about the features introduced in previous versions of Test Performance in the following sections.

What's New in 11.0.0

The following section lists the features, enhancements, or other changes made in Test Performance.

Feature title Description

Renaming of OneTest products

The following OneTest products have new names starting from 11.0.0:

  • HCL OneTest Performance is now HCL DevOps Test Performance.
  • HCL OneTest API is now HCL DevOps Test Integrations and APIs.
  • HCL OneTest Server is now HCL DevOps Test Hub.
  • HCL® OneTest Embedded is now HCL DevOps Test Embedded.
  • HCL OneTest Virtualization is now HCL DevOps Test Virtualization.
  • HCL OneTest Studio is now HCL DevOps Test Workbench.

Changes to the Licensing environment variables

With the renaming of HCL OneTest Products to HCL DevOps Test Products in 11.0.0, the HCL Licensing environment variables that contained "ONETEST" are changed to be used without "ONETEST". For example, the HCL_ONETEST_LICENSING_URL environment variable now must be called HCL_LICENSING_URL.

Note that the old environment variable names are still supported.

What's New in 10.5.4

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.

Feature title Description

Support for JSONPath in data correlation rules

You can now use data correlation rules to create references by using JSONPath, in addition to using regular expressions.

Support for Citrix Workspace App 23.03

HCL OneTest Performance now supports Citrix Workspace App 23.03. Recording a Citrix test

What's New in 10.5.3

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Support to control test runs for error handling

A new error condition Test Verdict Failed is added to Error handling to manage the test when the overall verdict of the test is failed. The error condition can control the behavior of the test and can contribute to the health of the test. See Error conditions.

Support to delete any row or all rows in datasets

You can now use new two methods to delete rows in a dataset. When you use IDatasetController in a custom code, you can use the following two methods to delete rows:

IDatasetController.deleteRows(fromIndex, toIndex) - You can use this method to specify a range of rows to delete. The index starts at 1.

IDatasetController.deleteAllRows() - You can use this method to delete all the rows in the dataset.

See Deleting rows in a dataset.

Customizing names of exported statistical reports

You can now specify a pattern that defines the file names of the exported statistical reports when you run tests from the command line. See Command-line parameters

Support for Revenera 2022.12

With Revenera 2018.02 (LLS 1.0) reaching EOS, you can now use Revenera 2022.12 (LLS 3.0) as a local license server to host licenses for HCL OneTest Performance.

.

What's New in 10.5.2

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Error reports for dropped connections

Previously, during test runs or schedules, the system under test occasionally dropped the connection, however, the error was reported as a server timeout. HCL OneTest Performance now reports the error condition for a dropped connection separately. See Error conditions.

Support to view the type of correlation for Test References

You can now view the type of correlation that is configured for Test References from the Type column on the Test Editor -Test References page for HTTP tests. You can also view the reference type in the Details tab on the Test Element properties page. (Data Correlation > Show References > Test Editor- Test References > Properties > Test Element Properties > Details).

The types of correlation are Auto, User, or Rule.

See Viewing references.

Changed the assets.xml to assets.yaml

HCL OneTest Performance now writes details of the assets to the assets.yaml file, which was previously written to the assets.xml file. You can view the assets.xml file is deleted and new assets.yaml file is added. You can now easily check in and merge the assets.yaml file when there is a conflict.

Support for Instana integration

You can now integrate Instana with HCL OneTest Performance to enhance data collection in performance tests. When you select the Enable Instana option, HCL OneTest Performance filters the HTTP headers and adds them to the request in tests to collate data about the pages and transactions.

See Using Application Performance Management in a schedule

Enhancement to an IF condition comparison

HCL OneTest Performance is now enhanced to perform a digit comparison when you apply an IF condition to a test or a schedule. If the digit comparison in the IF condition is successful, the result is displayed as true. Otherwise, it is displayed as false. See Adding conditional logic.

Enhancement to the command line option

Previously, to run all the test assets from the specified folder path, you created a batch file and ran the test from the command line. The command line option is now enhanced so that you can run multiple test assets at a time by using the wildcard character * enclosed in quotes. You can use * in different combinations to specify any or all test assets that are in a folder. See Running multiple tests from the command line.

Support for TLS 1.3

HCL OneTest Performance now supports TLS 1.3. You can record websites that support TLS 1.3 and play back the recorded test.

What's New in 10.5.1

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Removed option to discard time measurements for unhealthy transactions from preferences

Previously, you were able to select the option to discard time measurements for unhealthy transactions in the Test Execution Preferences (Windows > Preferences > Preferences > Test > Test Execution). You can now select the option in the Details tab of a schedule. See Schedule properties.

Enhancements to address the reporting of failed requests

Previously, HCL OneTest Performance did not include the response times in the performance reports when the primary requests failed, and this might have caused the reports to be misinterpreted. HCL OneTest Performance is now enhanced as follows:

  • The response codes are included in the response code verification points as the default option. You can disable the default option from the preferences, if you want the response codes to be ignored.
  • The option to discard the response times for the pages that fail is now provided for a schedule. HCL OneTest Performance reports the response time for unhealthy pages as the default option.
  • The Performance report summary displays the healthy pages recorded as a percentage.

Viewing the Page Details and Page Element Details report

You can now view two new reports namely, Page Details and Page Element Details. These reports are added to the HTTP Performance report. In the Page Details report, you can view the summarized statistics of every page. In the Page Elements Details report, you can view the summarized statistics of page elements. See Performance report.

What's New in 10.5.0

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Support to run tests or resources as a GitHub Action

You can now run tests that are contained in HCL OneTest Performance as a GitHub Action from a Git repository. See Configuration of test runs as a GitHub Actions Workflow.

.

Enhancements to the Jenkins plugin

You can now define the build parameters during the configuration of either Freestyle or Pipeline projects in Jenkins. You can then use those build parameters to run the Jenkins job. See Build parameters for Jenkins.

Support to show or hide SAP GUI during the test runtime

You can now change the behavior of the display of SAP GUI during the test run time irrespective of preferences that you configured in GUI on execution section. See Changing preferences for SAP test generation.

Support to modify regular expressions for SAP Object Identifier

You can now modify the identifier of an SAP script object by updating the regular expression in the SAP GUI Object Information section. See SAP set details.

Enhancement to test reports

You can now copy the contents of the table, which is in the HTML format, from the web analytics reports by using the Copy icon copy_icon. See HTTP performance test reports.

Support for the Application Performance Management (APM) in a schedule

You can now use AppDynamics application with HCL OneTest Performance to enhance the data collection by adding filters based on HTTP headers that you used in tests. See Using Application Performance Management in a schedule.

What's New in 10.2.3

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Enhancements to integration plugins

The following table lists the parameters added in HCL OneTest Performance 10.2.3 with the checkmark icon for each of the integration plugins:

Parameters Integration plugins
Azure DevOps IBM® UrbanCode Deploy and HCL® Launch MicroFocus ALM Ant Jenkins

Duration

Exportlog

Publish

Publish_for

Publishreports

Rate

History

Exportstatsformat

Labels

Exportstatshtml

Exportstatreportlist

Exportstats

Overwrite

Configfile

Results

Usercomments

Users

The following topics provide more information about parameters for each of the integration plugins:

Viewing test run results on the Azure Test Plans dashboard

When you use the HCL OneTest Studio extension in Azure DevOps pipelines to run performance test assets, you can now view the results of the test runs on the Test Plans dashboard of Azure DevOps.

See Running tests from Azure DevOps as a Pipeline job.

Support to auto-save the load test profile details of test assets

HCL OneTest Performance now automatically saves the load test profile details of tests, compound tests, vu schedules, and rate schedules.

What's New in 10.2.2

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Support to run tests from the Jenkins pipeline projects

You can now use the HCL OneTest Performance Jenkins plugin to run the test assets from the Jenkins Pipeline projects. See Integration with Jenkins.

Support to add labels from Jenkins

You can now add labels to test results when you run test assets from Jenkins by specifying a value in the Labels field. See Configuring the Freestyle project or Creating a pipeline script from Jenkins.

Support to add labels from Ant

You can now add labels to test results when you run test assets from Ant by specifying a value for the labels parameter. See Running tests by using Ant.

Access to properties of a dataset through a custom code

You can now get the properties of the dataset through custom code. When a test asset is associated with a dataset by using a custom code, you can write the properties of the dataset to the test logs. See Getting the properties of a dataset.

Support to extract the JSON value from a Reference

Based on the JSON Path expression that you entered in the Regular Expression field, you can now extract the Reference value. See Selecting a Reference in a response.

Enhancements to the performance report

The Errors page of the performance report now displays a graph to show errors against the time that occurred during the playback of the test or schedule. See Performance reports.

Enhancements to HTTP requests

You can now provide a name for individual HTTP requests from the HTTP Requests Details pane to use the short or meaningful name for requests. You can view the same name from the Page Elements Performance Report and thus you can sort or trace Requests efficiently. See HTTP request details.

Support to display response codes in Statistics Session Viewer

If the test includes requests with various response codes, you can now view those response codes from the Statistics Session Viewer window. You can right-click the test result and select Open With > Statistics Session Viewer > Run > HTTP Detailed Status Code to access response codes.

Automatic creation of environment variables

If you use HCL OneTest API extension to run integration tests from HCL OneTest Performance, then the INTEGRATION_TESTER_HOME and INTEGRATION_TESTER_AGENT_HOME environment variables are now automatically created when you install HCL OneTest API 10.2.2 or later.

Support to record tests by using the Microsoft Edge browser
After you install HCL OneTest Performance on Linux operating system, you can now choose the Chromium-based Microsoft Edge browser to record the following tests:
  • HTTP tests

  • Service tests when recorded from a browser

What's New in 10.2.1

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Support to add labels from the command-line interface

You can now add labels by using a new parameter called -labels to test results when you run test assets from the command-line interface. See Running a test or schedule from a command line.

The execution agent is now renamed as the UI Test Agent

The execution agent that was delivered along with HCL OneTest Performance Agent 10.2.0 is now renamed as the UI Test Agent.

What's New in 10.2.0

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Support to install and use the product in different languages

You can now use the stand-alone installer and the product in your preferred language. You can select the preferred language for the stand-alone installer and the product by selecting the language during the installation of the product. See Installation of DevOps Test Performance.

Introducing the new execution agent as part of HCL OneTest Performance Agent installation

An execution agent is now delivered as part of HCL OneTest Performance Agent. You can use this execution agent to perform the automation testing of the Windows desktop applications, mobile web, hybrid applications on iOS and Android devices. During the installation of HCL OneTest Performance Agent, the execution agent is installed automatically. See Installation of the Agent on Windows systems.

Support for application performance management tools

You can now use AppDynamics or Dynatrace applications with HCL OneTest Performance to enhance the data collection by adding filters based on HTTP headers that you used in tests. See Using Application Performance Management in a schedule.

Using a JSON notation in a reference for an HTTP test

If a request or a response contains the JSON data, then the test editor displays a value in a more readable JSON format. If you create a reference in the JSON data, you can now use the JSON notation instead of a regular expression to locate the JSON value at run time. See Creating a Reference or a Field Reference.

Support to record tests by using the Microsoft Edge browser
After you install HCL OneTest Performance either on Windows systems or Mac operating systems, you can now choose the Chromium-based Microsoft Edge browser to record the following tests:
  • HTTP tests

  • Citrix tests from the Citrix Web Interface

  • SAP tests when initiated from HTTP SAP-portal

  • Service tests when recorded from a browser

See Recording an HTTP test.
Support to the latest version of the SAP GUI client

You can now record and play back tests of SAP applications built with the SAP GUI client 7.7.

What's New in 10.1.3

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Sorting the HTTP pages in a performance report

In a performance report, you can now sort the order of the HTTP pages that are captured in a test or schedule either by alphabetical order or order of execution of the HTTP pages. See HTTP performance test reports.

Separate installation of JDK or JRE is not required

The HCL OneTest Performance stand-alone installer now uses the embedded JRE for execution and it no longer requires a separate JRE or JDK to be present to run the stand-alone installer.

What's New in 10.1.2

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Documentation

You can now quickly add your comments to provide your feedback about the documentation for HCL OneTest Performance by posting to a product forum. To add your comments as feedback, you must first register at HCL Support. Your login information along with your comments are governed by the privacy policy of HCL. By commenting, you accept the terms of use of HCL.

Exporting test results to JSON

When you want to analyze test results in a text format, you can now export all test results or a specific test result that you captured during a test run to a JSON file. See Methods to export test results into a JSON file.

Importing a CSV file with a separator character

You can now import a CSV file that has a separator character into the dataset and configure the required separator values in the CSV Editor. See Editing datasets.

Adding a Verification point to an SAP object

You can now add a verification point to an SAP object in the SAP GUI Grid View to verify the state of the SAP object after the SAP recording is complete. See Adding a verification point to an SAP GUI Grid View object.

Recording an SAP transaction from a running SAP GUI

You can now record certain SAP transactions from a running SAP GUI session to create a test that contains some specific part of an SAP session. See Recording a specific SAP transaction from a running SAP session.

SAP extension on Windows 64-bit operating system

You can now choose SAP extension when you install HCL OneTest Performance on Windows 64-bit operating systems.

Enhancements to reports and counters
  • The title of the page in a performance report is now updated with the filter value that you specified in the View Settings pane. See Filtering data in test results.

  • In a Transaction report, you can now view the number of transactions that are active during the schedule run and the number of virtual users that execute certain transactions simultaneously. See Transaction report.

  • You can now publish large test results from HCL OneTest Performance to HCL OneTest Server. See Publishing test results to the server.

  • When you want to analyze the additional counters on a quick view reports, you can now add percentile counters to the counter tree. See Adding additional counters on a separate page.

  • You can now define a percentile value as decimal numbers for a counter. See Modifying counters in a graph.

Access to a dataset from a custom code

You can now access datasets from a custom code. When a test is associated with a dataset, you can read or write the dataset values from the custom code. See Reading and writing data from a dataset.

Access to the actual name of the schedule

When you use the custom code, you can now access the actual name of the schedule in the test log. See Accessing the actual schedule name from the custom code.

Brotli encoding format

HTTP tests now automatically decompress data that were compressed, by using the Brotli encoding format.

What's New in 10.1.1

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

HCL Launch integration

You can now integrate HCL OneTest Performance with HCL Launch by using the HCL OneTest Performance Launch plugin to run tests. See Integration with HCL DevOps Deploy.

Enhancements to HCL OneTest Performance integrations

  • You can now use the Resource Monitoring Override Labels parameter when you choose to run tests from other applications such as Jenkins, Ant, Maven, Micro Focus Application Lifecycle Management (ALM), Azure DevOps, and UrbanCode Deploy (UCD). See Integration with other applications.

  • After you configure the HCL OneTest Server URL and if the Publish result after execution field is set to Always, then when you run tests from other applications, you can now view hyperlinks that point to the corresponding test reports as follows:

    Applications Location of the report
    Jenkins Console page
    Ant Log file
    Maven Console page
    Micro Focus Application Lifecycle Management Output window
    Azure DevOps Task page
    UrbanCode Deploy Output log

What's New in 10.1.0

The following section lists the features, enhancements, or other changes made in HCL OneTest Performance.
Feature title Description

Microsoft Azure DevOps integration

You can now integrate HCL OneTest Performance with Azure DevOps by using the HCL OneTest Studio extension to run tests as tasks in Azure DevOps pipelines. See Integration with Azure DevOps.

Support for console mode installation by using the stand-alone installer

You can now install HCL OneTest Performance and HCL OneTest Performance Agent by using the stand-alone installer on Ubuntu and Red Hat Enterprise Linux (RHEL) operating systems in console mode where GUI mode is not supported. See Installing the product in the console mode on Linux and Installing Agent in the console mode on Linux.

Support for Jaeger traces view

You can now use the Jaeger to view test logs of tests or schedules that you run from the command-line interface to analyze traces of transactions between distributed services. See Integration of Jaeger with the product.

A quick view in reports

You can now add the additional counters on a separate page without editing an existing report to investigate performance issues in detail. See Adding additional counters on a separate page.

Updates to Dataset CSV Editor

The browser-based CSV Editor provides additional options that include Find and Replace, Undo, and Redo to organize your data in the dataset in a better way. See Editing datasets.

Labels for Resource Monitoring sources

In HCL OneTest Performance, you can now select the data sources in a schedule based on the labels that you added for the data sources in HCL OneTest Server. See Enablement of Resource Monitoring services for a schedule.

Environment variables for Jenkins

You can now set environment variables on the Jenkins server as inputs to the text fields that are available for HCL OneTest Performance test in a Jenkins build step. See Integration with Jenkins.

Enhancement to performance reports

  • The Overall page of the performance report is updated to show the Page VPs, Page Element VPs, Page Status Codes, Page Element Status Codes, and Page Health information in an individual chart and the information about the overall verification point in a pie chart. See Overall page.

  • The Resources page of the performance report is updated to show the resource counters information in front of their Resource Monitoring source name. The Performance Summary table now shows the Type of the source and Name of the resource counter in two different columns. See Resources page.

  • You can now view and monitor the counter information generated by the custom code on a graph when the custom code starts in the test run. See Adding custom counters to reports.

Enhancements to SAP GUI

Most of the steps are automated now when you record SAP tests by using an SAP batch input test recording wizard. See Recording a SAP batch input test.

Properties Verification Points in Service Test

You can now add verification points for the properties in a test response when you record a service test or after you record the service test. See Adding properties verification points to a test response.

Support for Text message in WebSphere MQ protocol configuration

After you create a WebSphere MQ protocol configuration, now you can change the message format by selecting the Text Message check box in the Message Structure. See Creating a WebSphere MQ protocol configuration.