What's New
You can find information about the features introduced, enhancements, or other changes made in HCL DevOps Test Performance (Test Performance). You can also find the features that were introduced in previous versions of Test Performance. DevOps Test Performance is the new name of HCL OneTest™ Performance from 11.0.0 onwards.
What's New in DevOps Test Performance 2024.03 (11.0.1)
The following section lists the features, enhancements, or other changes made in Test Performance.
Feature title | Description |
---|---|
Enhanced the UI for dataset editing |
The CSV Editor, which is used for editing datasets in Test Performance, currently features an improved user interface. You can now experience changes in the presentation of pages and the methods to configure and edit datasets in the UI. |
You can find information about the features introduced in previous versions of Test Performance in the following sections.
What's New in 11.0.0
The following section lists the features, enhancements, or other changes made in Test Performance.
Feature title | Description |
---|---|
Renaming of OneTest products |
The following OneTest products have new names starting from 11.0.0:
|
Changes to the Licensing environment variables |
With the renaming of HCL OneTest Products to HCL DevOps Test Products in 11.0.0, the HCL Licensing environment variables that contained "ONETEST" are changed to be used without "ONETEST". For example, the HCL_ONETEST_LICENSING_URL environment variable now must be called HCL_LICENSING_URL. Note that the old environment variable names are still supported. |
What's New in 10.5.4
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.
Feature title | Description |
---|---|
Support for JSONPath in data correlation rules |
You can now use data correlation rules to create references by using JSONPath, in addition to using regular expressions. |
Support for Citrix Workspace App 23.03 |
HCL OneTest™ Performance now supports Citrix Workspace App 23.03. Recording a Citrix test |
What's New in 10.5.3
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Support to control test runs for error handling |
A new error condition Test Verdict Failed is added to Error handling to manage the test when the overall verdict of the test is failed. The error condition can control the behavior of the test and can contribute to the health of the test. See Error conditions. |
Support to delete any row or all rows in datasets |
You can now use new two methods to delete rows in a dataset. When you use IDatasetController in a custom code, you can use the following two methods to delete rows: IDatasetController.deleteRows(fromIndex, toIndex) - You can use this method to specify a range of rows to delete. The index starts at 1. IDatasetController.deleteAllRows() - You can use this method to delete all the rows in the dataset. |
Customizing names of exported statistical reports |
You can now specify a pattern that defines the file names of the exported statistical reports when you run tests from the command line. See Command-line parameters |
Support for Revenera 2022.12 |
With Revenera 2018.02 (LLS 1.0)
reaching EOS, you can now use Revenera 2022.12 (LLS 3.0) as a local
license server to host licenses for HCL OneTest™ Performance. . |
What's New in 10.5.2
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Error reports for dropped connections |
Previously, during test runs or schedules, the system under test occasionally dropped the connection, however, the error was reported as a server timeout. HCL OneTest™ Performance now reports the error condition for a dropped connection separately. See Error conditions. |
Support to view the type of correlation for Test References |
You can now view the type of correlation that is configured for Test References from the Type column on the Test Editor -Test References page for HTTP tests. You can also view the reference type in the Details tab on the Test Element properties page. ( ). The types of correlation are Auto, User, or Rule. See Viewing references. |
Changed the assets.xml to assets.yaml |
HCL OneTest™ Performance now writes details of the assets to the assets.yaml file, which was previously written to the assets.xml file. You can view the assets.xml file is deleted and new assets.yaml file is added. You can now easily check in and merge the assets.yaml file when there is a conflict. |
Support for Instana integration | You can now integrate Instana with HCL OneTest™ Performance to enhance data collection in performance tests. When you select the Enable Instana option, HCL OneTest™ Performance filters the HTTP headers and adds them to the request in tests to collate data about the pages and transactions. See Using Application Performance Management in a schedule |
Enhancement to an IF condition comparison |
HCL OneTest™ Performance is now enhanced to perform a digit comparison when you apply an IF condition to a test or a schedule. If the digit comparison in the IF condition is successful, the result is displayed as true. Otherwise, it is displayed as false. See Adding conditional logic. |
Enhancement to the command line option |
Previously, to run all the test assets from the specified folder path, you created a batch file and ran the test from the command line. The command line option is now enhanced so that you can run multiple test assets at a time by using the wildcard character * enclosed in quotes. You can use * in different combinations to specify any or all test assets that are in a folder. See Running multiple tests from the command line. |
Support for TLS 1.3 |
HCL OneTest™ Performance now supports TLS 1.3. You can record websites that support TLS 1.3 and play back the recorded test. |
What's New in 10.5.1
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Removed option to discard time measurements for unhealthy transactions from preferences |
Previously, you were able to select the option to discard time measurements for unhealthy transactions in the Test Execution Preferences (Schedule properties. ). You can now select the option in the Details tab of a schedule. See |
Enhancements to address the reporting of failed requests |
Previously, HCL OneTest™ Performance did not include the response times in the performance reports when the primary requests failed, and this might have caused the reports to be misinterpreted. HCL OneTest™ Performance is now enhanced as follows:
|
Viewing the Page Details and Page Element Details report |
You can now view two new reports namely, Page Details and Page Element Details. These reports are added to the HTTP Performance report. In the Page Details report, you can view the summarized statistics of every page. In the Page Elements Details report, you can view the summarized statistics of page elements. See Performance report. |
What's New in 10.5.0
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Support to run tests or resources as a GitHub Action |
You can now run tests that are
contained in HCL OneTest™ Performance as
a GitHub Action from a Git repository. See Configuration of test runs as a GitHub Actions Workflow. . |
Enhancements to the Jenkins plugin |
You can now define the build parameters during the configuration of either Freestyle or Pipeline projects in Jenkins. You can then use those build parameters to run the Jenkins job. See Build parameters for Jenkins. |
Support to show or hide SAP GUI during the test runtime |
You can now change the behavior of the display of SAP GUI during the test run time irrespective of preferences that you configured in GUI on execution section. See Changing preferences for SAP test generation. |
Support to modify regular expressions for SAP Object Identifier |
You can now modify the identifier of an SAP script object by updating the regular expression in the SAP GUI Object Information section. See SAP set details. |
Enhancement to test reports |
You can now copy the contents of the table, which is in the HTML format, from the web analytics reports by using the Copy icon . See HTTP performance test reports. |
Support for the Application Performance Management (APM) in a schedule |
You can now use AppDynamics application with HCL OneTest™ Performance to enhance the data collection by adding filters based on HTTP headers that you used in tests. See Using Application Performance Management in a schedule. |
What's New in 10.2.3
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Enhancements to integration plugins |
The following table lists the parameters added in HCL OneTest™ Performance 10.2.3 with the checkmark icon for each of the integration plugins:
The following topics provide more information about parameters for each of the integration plugins: |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Viewing test run results on the Azure Test Plans dashboard |
When you use the HCL OneTest Studio extension in Azure DevOps pipelines to run performance test assets, you can now view the results of the test runs on the Test Plans dashboard of Azure DevOps. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Support to auto-save the load test profile details of test assets |
HCL OneTest™ Performance now automatically saves the load test profile details of tests, compound tests, vu schedules, and rate schedules. |
What's New in 10.2.2
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Support to run tests from the Jenkins pipeline projects |
You can now use the HCL OneTest™ Performance Jenkins plugin to run the test assets from the Jenkins Pipeline projects. See Integration with Jenkins. |
Support to add labels from Jenkins |
You can now add labels to test results when you run test assets from Jenkins by specifying a value in the Labels field. See Configuring the Freestyle project or Creating a pipeline script from Jenkins. |
Support to add labels from Ant |
You can now add labels to test results when you run test assets from Ant by specifying a value for the labels parameter. See Running tests by using Ant. |
Access to properties of a dataset through a custom code |
You can now get the properties of the dataset through custom code. When a test asset is associated with a dataset by using a custom code, you can write the properties of the dataset to the test logs. See Getting the properties of a dataset. |
Support to extract the JSON value from a Reference |
Based on the JSON Path expression that you entered in the Regular Expression field, you can now extract the Reference value. See Selecting a Reference in a response. |
Enhancements to the performance report |
The Errors page of the performance report now displays a graph to show errors against the time that occurred during the playback of the test or schedule. See Performance reports. |
Enhancements to HTTP requests |
You can now provide a name for individual HTTP requests from the HTTP Requests Details pane to use the short or meaningful name for requests. You can view the same name from the Page Elements Performance Report and thus you can sort or trace Requests efficiently. See HTTP request details. |
Support to display response codes in Statistics Session Viewer |
If the test includes requests with various response codes, you can now view those response codes from the Statistics Session Viewer window. You can right-click the test result and select to access response codes. |
Automatic creation of environment variables |
If you use HCL OneTest™ API extension to run integration tests from HCL OneTest™ Performance, then the INTEGRATION_TESTER_HOME and INTEGRATION_TESTER_AGENT_HOME environment variables are now automatically created when you install HCL OneTest™ API 10.2.2 or later. |
Support to record tests by using the Microsoft Edge browser |
After you install HCL OneTest™ Performance
on Linux operating system, you can now choose the Chromium-based
Microsoft Edge browser to record the following tests:
|
What's New in 10.2.1
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Support to add labels from the command-line interface |
You can now add labels by using a new parameter called -labels to test results when you run test assets from the command-line interface. See Running a test or schedule from a command line. |
The execution agent is now renamed as the UI Test Agent |
The execution agent that was delivered along with HCL OneTest™ Performance Agent 10.2.0 is now renamed as the UI Test Agent. |
What's New in 10.2.0
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Support to install and use the product in different languages |
You can now use the stand-alone installer and the product in your preferred language. You can select the preferred language for the stand-alone installer and the product by selecting the language during the installation of the product. See Installation of DevOps Test Performance. |
Introducing the new execution agent as part of HCL OneTest™ Performance Agent installation |
An execution agent is now delivered as part of HCL OneTest™ Performance Agent. You can use this execution agent to perform the automation testing of the Windows desktop applications, mobile web, hybrid applications on iOS and Android devices. During the installation of HCL OneTest™ Performance Agent, the execution agent is installed automatically. See Installation of the Agent on Windows systems. |
Support for application performance management tools |
You can now use AppDynamics or Dynatrace applications with HCL OneTest™ Performance to enhance the data collection by adding filters based on HTTP headers that you used in tests. See Using Application Performance Management in a schedule. |
Using a JSON notation in a reference for an HTTP test |
If a request or a response contains the JSON data, then the test editor displays a value in a more readable JSON format. If you create a reference in the JSON data, you can now use the JSON notation instead of a regular expression to locate the JSON value at run time. See Creating a Reference or a Field Reference. |
Support to record tests by using the Microsoft Edge browser |
After you install HCL OneTest™ Performance
either on Windows systems or Mac operating systems, you can now
choose the Chromium-based Microsoft Edge browser to record the
following tests:
|
Support to the latest version of the SAP GUI client |
You can now record and play back tests of SAP applications built with the SAP GUI client 7.7. |
What's New in 10.1.3
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Sorting the HTTP pages in a performance report |
In a performance report, you can now sort the order of the HTTP pages that are captured in a test or schedule either by alphabetical order or order of execution of the HTTP pages. See HTTP performance test reports. |
Separate installation of JDK or JRE is not required |
The HCL OneTest™ Performance stand-alone installer now uses the embedded JRE for execution and it no longer requires a separate JRE or JDK to be present to run the stand-alone installer. |
What's New in 10.1.2
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Documentation |
You can now quickly add your comments to provide your feedback about the documentation for HCL OneTest™ Performance by posting to a product forum. To add your comments as feedback, you must first register at HCL Support. Your login information along with your comments are governed by the privacy policy of HCL. By commenting, you accept the terms of use of HCL. |
Exporting test results to JSON |
When you want to analyze test results in a text format, you can now export all test results or a specific test result that you captured during a test run to a JSON file. See Methods to export test results into a JSON file. |
Importing a CSV file with a separator character |
You can now import a CSV file that has a separator character into the dataset and configure the required separator values in the CSV Editor. See Editing datasets. |
Adding a Verification point to an SAP object |
You can now add a verification point to an SAP object in the SAP GUI Grid View to verify the state of the SAP object after the SAP recording is complete. See Adding a verification point to an SAP GUI Grid View object. |
Recording an SAP transaction from a running SAP GUI |
You can now record certain SAP transactions from a running SAP GUI session to create a test that contains some specific part of an SAP session. See Recording a specific SAP transaction from a running SAP session. |
SAP extension on Windows 64-bit operating system |
You can now choose SAP extension when you install HCL OneTest™ Performance on Windows 64-bit operating systems. |
Enhancements to reports and counters |
|
Access to a dataset from a custom code |
You can now access datasets from a custom code. When a test is associated with a dataset, you can read or write the dataset values from the custom code. See Reading and writing data from a dataset. |
Access to the actual name of the schedule |
When you use the custom code, you can now access the actual name of the schedule in the test log. See Accessing the actual schedule name from the custom code. |
Brotli encoding format |
HTTP tests now automatically decompress data that were compressed, by using the Brotli encoding format. |
What's New in 10.1.1
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
HCL Launch integration |
You can now integrate HCL OneTest™ Performance with HCL Launch by using the HCL OneTest™ Performance Launch plugin to run tests. See Integration with HCL DevOps Deploy. |
||||||||||||||
Enhancements to HCL OneTest™ Performance integrations |
|
What's New in 10.1.0
The following section lists the features, enhancements, or other changes made in HCL OneTest™ Performance.Feature title | Description |
---|---|
Microsoft Azure DevOps integration |
You can now integrate HCL OneTest™ Performance with Azure DevOps by using the HCL OneTest Studio extension to run tests as tasks in Azure DevOps pipelines. See Integration with Azure DevOps. |
Support for console mode installation by using the stand-alone installer |
You can now install HCL OneTest™ Performance and HCL OneTest™ Performance Agent by using the stand-alone installer on Ubuntu and Red Hat Enterprise Linux (RHEL) operating systems in console mode where GUI mode is not supported. See Installing the product in the console mode on Linux and Installing Agent in the console mode on Linux. |
Support for Jaeger traces view |
You can now use the Jaeger to view test logs of tests or schedules that you run from the command-line interface to analyze traces of transactions between distributed services. See Integration of Jaeger with the product. |
A quick view in reports |
You can now add the additional counters on a separate page without editing an existing report to investigate performance issues in detail. See Adding additional counters on a separate page. |
Updates to Dataset CSV Editor |
The browser-based CSV Editor provides additional options that include Find and Replace, Undo, and Redo to organize your data in the dataset in a better way. See Editing datasets. |
Labels for Resource Monitoring sources |
In HCL OneTest™ Performance, you can now select the data sources in a schedule based on the labels that you added for the data sources in HCL OneTest™ Server. See Enablement of Resource Monitoring services for a schedule. |
Environment variables for Jenkins |
You can now set environment variables on the Jenkins server as inputs to the text fields that are available for HCL OneTest™ Performance test in a Jenkins build step. See Integration with Jenkins. |
Enhancement to performance reports |
|
Enhancements to SAP GUI |
Most of the steps are automated now when you record SAP tests by using an SAP batch input test recording wizard. See Recording a SAP batch input test. |
Properties Verification Points in Service Test |
You can now add verification points for the properties in a test response when you record a service test or after you record the service test. See Adding properties verification points to a test response. |
Support for Text message in WebSphere MQ protocol configuration |
After you create a WebSphere MQ protocol configuration, now you can change the message format by selecting the Text Message check box in the Message Structure. See Creating a WebSphere MQ protocol configuration. |