Known issues
You can find the known issues that are identified, if any, in this version of HCL DevOps Test Performance (Test Performance). You can also find the known issues identified in the earlier versions of Test Performance. DevOps Test Performance is the new name of HCL OneTest™ Performance from 11.0.0 onwards.
Known issues in DevOps Test Performance 2024.03 (11.0.1)
The known issues identified in Test Performance 2024.03 (11.0.1) are as follows:
ID |
Description |
---|---|
TP-88114 |
In the Test Editor panel, the Response Content field might intermittently appear empty on Windows system when the data size is between 30 KB and 40 KB. You can resolve the issue by restarting the application or by adding the following line to the configuration file located in <workspace>/.metadata/.plugins/org.eclipse.core.runtime/.settings/com.ibm.rational.test.common.editor.framework.prefs: |
TP-91484 |
When you select the Load option from My Repository workspace for a component to load all the test assets available in the stream to be pushed to Engineering Workflow Management, the assets created by the other users fail to load and display an error message. |
Known issues from earlier versions
The known issues identified in the earlier versions of Test Performance that are still applicable are as follows:
ID |
Description |
Identified in version |
Applicable in and until version |
---|---|---|---|
TP-90515 |
The single shell-shared package, DevOps-Test-UI-and-Performance-Windows-x86, is not available anymore. To install DevOps Test UI and DevOps Test Performance in the shell-shared mode on the 32-bit platform, you must use DevOps-Test-UI-Windows-x86 and DevOps-Test-Performance-Windows-x86 packages by using Installation Manager. |
11.0.0 |
|
TP-88149 |
When you record a Citrix test by using the on-server or published application options on Citrix Workspace App 23.03, the recording fails with a client error. Citrix Workspace App 23.03 only supports recording by using Web Interface and ICA file options. |
10.5.4 |
|
TP-88120 |
When you import projects from Git, tests run from the command line fail if you use wildcards to identify tests or if you use the option -testType. The workaround for this limitation is that you can avoid using assets from Git. Alternatively, you can export or import test assets with dependencies into a different workspace. |
10.5.4 |
|
TP-88193 |
You cannot use Git Actions to run tests when HCL OneTest™ Performance is installed on MacOS Ventura 13. |
10.5.3 |
10.5.4 |
TP-88149 |
When you run HCL OneTest™ Performance on MacOS Ventura, the "Preferences" option in the Rational Performance Tester menu is displayed as "Settings". |
10.5.3 |
|
TP-85460 |
When you install HCL OneTest™ Performance
10.5.1 or later on a Windows Server 2022 computer, and open
the Web Analytics reports for editing, the icons are not
displayed. To work around the problem, you can perform the
following steps on browsers other than Internet Explorer:
|
10.5.1 |
|
TP-84021 |
When you start the HCL OneTest™ Performance adapter for IBM Rational Quality Manager as a Windows service, the schedule run fails with license errors. To work around this problem, you must add the License Server ID and License Server URL as System Environment variables by performing the following steps:
|
10.5.0 |
|
TP-83770 |
When you install HCL OneTest™ Performance on Windows systems, and then open a performance test report by using an internal browser, the icons are not displayed in the performance report. To work around this problem, you must perform the following steps:
|
10.5.0 |
|
TP-84064 |
The Browser tab in the Protocol Data pane does not display the recorded web pages when you perform the following tasks:
|
10.5.0 |
10.5.1 |
TP-82960 |
When you want to install HCL OneTest™ UI, HCL OneTest™ API, or HCL OneTest™ Performance on Mac OS Big Sur (11.x), you must download all of the product offerings that are contained in the HCL OneTest™ Studio package to prevent installation errors. |
10.5.0 |
|
TP-79188 |
When you use the double quotation
marks ("") for the Labels or User comments options
to run the test by using integration plugins, then the labels in
the test result or the User Comments row of a report do not
include the double quotation marks.The integration plugins that
do not support double quotation marks ("") for the Labels
or User comments options are as follows:
|
10.2.3 |
|
TP-81353 |
When you use the double quotation marks ("") for the labels or usercomments parameters and then run tests from the command-line interface, the command-line interface does not accept values for these parameters. To work around this problem, you must perform the following actions based on the operating system that you used to install HCL OneTest™ Performance: On the Windows operating system: 1. Open the command-line interface. 2. Change the directory to a location that contains the CommandLine.exe file. You can locate the directory in the following location: <installation_directory>\IBM\IBMIMShared\plugins\com.ibm.rational.test.lt.cmdlineexecute<time_stamp> 3. Run the test by using valid parameters. On Windows, Linux, and Mac operating systems: 1. Create a command-line config file by using HCL OneTest™ Performance. 2. Run the test by using the -configfile parameter. |
10.2.3 |
|
TP-82527 |
When you run the performance schedule by enabling Resource Monitoring sources, the quick view report shows the following issues:
To work around this problem, you can perform the following steps:
|
10.2.3 |
10.5.0 |
TP-51357 |
When you playback a Citrix test asset with Citrix Receiver 4.11 or later, the test asset fails to run.To work around this problem, you must install Citrix Receiver 4.9. |
10.2.1 |
|
TP-76892 |
If your computer restarts due to any reason, you might not be able to uninstall or open the product at times. To work around this problem, you must always clear the files from the Temp directory before you install or after you uninstall the product. While performing the uninstallation, if your computer prompted for a restart, perform the following steps:
In a scenario where you are unable to open the product due to your computer restart, then you can perform the following steps to do a fresh installation of the product:
|
10.2.0 |
|
TP-76105 |
If your application uses TLS1.1 or TLS1, then HCL OneTest™ Performance cannot record or run those test assets until you modify the java.security file. This issue is because TLS 1.1 and TLS1 are not supported by Java. To work around this problem, you must perform the following steps:
|
10.2.0 |
|
TP-73401 |
When you install the product by using the stand-alone installer on macOS Catalina 10.15.7, the product installation fails with an error message. To work around this problem, you must set the Appearance option to Light under System preference before you install the product. |
10.1.3 |
|
TP-72726 |
When you use a calendar dialog box to select a value in an SAP transaction session and record the SAP test in your product, the Test Generation page and the Error Log page display a warning message.The warning message states that the SAP calendar object has an unpredictable behavior when you play back the test and you must set the date in the value fields by using the string format.Therefore, when you select the Hide GUI during the execution option from the SAP Options tab in the Test Details section to play back the SAP test, the product is unable to create a calendar object. Hence the test run fails. To work around this problem, you must perform the following
steps:
|
10.1.3 |
|
TP-70696 |
When you record an SAP test by
selecting the Record from a running session started with the SAP
logon option, then the schedule run fails with the following
error message on the Test Log page or Execution Event Console
log page:
To work around this problem, you must perform the following steps:
Note: The session created by the
first test is considered as the current
session. |
10.1.2 |
|
TP-69141 |
You must decrypt and encrypt each dataset by using the CSV Editor to apply the strongest encryption on each dataset that you used in the earlier version of the product. |
10.1.2 |
|
TP-62667 |
When you install HCL OneTest™ Performance 10.1.0 on Red Hat Linux Enterprise 8.0 or later, the installation fails with an error message. To work around this problem, you must first install libnsl.so.1 on your computer for a successful installation of the product. Alternatively, you can create a soft link from libnsl.so.2 by running the following command on the command-line interface:sudo ln -s /usr/lib64/libnsl.so.2 /usr/lib64/libnsl.so.1 |
10.1.0 |
|
TP-66551 |
When you record a Citrix test by using an ICA file, the recording fails with an error message. You must first verify the values for the parameters DesiredHRES and DesiredVRES in the ICA file because the values for these parameters are set to 0 instead of a valid number. To resolve this issue, you must first set a value for the parameters to record the Citrix test by using the ICA file. |
10.1.0 |
|
TP-66806 |
On Windows Server operating systems, when you use HCL OneTest™ Performance to run a VU schedule that has Citrix test, sometimes the playback fails because an action from the test is incorrectly played back by the Citrix receiver. To resolve this issue, you must install HCL OneTest™ Performance and HCL OneTest™ Performance Agent on Windows 10 operating systems when you want to run the VU schedule that has Citrix test. |
10.1.0 |
|
TP-67053 |
On Windows, there is an incompatibility between the version of Java packaged with the product (OpenJDK OpenJ9 V1.8.0_252) and AdoptOpenJDK14 when Symantec Endpoint Protection is installed. To work around this problem, uninstall the AdoptOpenJDK14 product or remove it from the PATH before using the product. |
10.1.0 |
|
TP-67514 |
When you run tests or schedules that have a file name with non-English characters from the command-line interface, then the test run fails with an error message. To work around this problem, you must use CommandLine.exe to run tests or schedules from the command-line interface. You can locate CommandLine.exe in the following folder path: IBM\IBMIMShared\plugins\-com.ibm.rational.test.lt.cmdlineexecute_7.2.3200.v<YYYYMMDD_HHMM> |
||
TP-57089 |
In HCL OneTest™ Performance 10.0.0 and later, when you set the environment variable, JAVA_HOME, to the bundled JDK that is shipped with the product, tests that run from Jenkins show a java.lang.OutOfMemoryError: Java heap space error after completion of the test run. With 10.0.0 and later, you might expect a reduction in the number of Virtual Users (VUs) supported by HCL OneTest™ Performance Agent depending upon workload characteristics. This variation is the result of the product shipping with OpenJDK 8 with OpenJ9 instead of IBM JRE. OpenJDK 8 with OpenJ9 JRE exhibits a higher utilization of CPU for the workload. Up to 30% or more decrease in the supported VUs capacity may be expected for CPU-bound workloads. However, for memory-bound workloads, a much smaller, if any reduction in VUs capacity may be expected. If you need higher performance and have access to IBM JRE 8.0.5.35 or later which contains the latest security fixes, you can switch from OpenJDK 8 with OpenJ9 to IBM JRE. For more information, see http://www.ibm.com/support/docview.wss?uid=ibm10956413. When you do performance monitoring of the resources of a remote Windows computer, you specify the credentials of that computer in HCL OneTest™ Performance. The credentials are stored in a Windows file. If the credentials of the remote computer change and you updated the credentials from HCL OneTest™ Performance, the test run with Windows Performance Monitoring will still fail. You must restart the workbench computer and then change the credentials from HCL OneTest™ Performance. When you playback a test remotely such as from the command line or Jenkins, the log file in the workspace displays IllegalStateException: Workbench has not been created yet. error message. The test will execute successfully. On Mac OS X, if you have HCL OneTest™ Performance configured for a floating license or Authorized User License, you will get a com.ibm.rational.test.lt.licensing.RPTLicenseExceptionerror the first time you run a schedule. The exception forces the schedule to stop the execution with a failure. After the initial failure, all subsequent runs of schedules would pass without the above-mentioned error. |
10.0.0 |
|
Permanent known issues |
|||
When you do performance monitoring of the resources of a remote Windows computer, you specify the credentials of that computer in HCL OneTest™ Performance. The credentials are stored in a Windows file. If the credentials of the remote computer changes and you updated the credentials from HCL OneTest™ Performance, the test run with Windows Performance Monitoring will still fail. You must restart the workbench computer and then change the credentials from HCL OneTest™ Performance. |
|||
You cannot install HCL OneTest™ Performance and Rational® Performance Tester on the same computer or package group. Also, you cannot install or shell-share HCL OneTest Performance with another Rational testing product such as Rational Test Workbench. | |||
Running tests with Chrome while logged in as root on Linux computers is not supported. |
|||
When you start an information center for the first time, you might see an error "Unable to acquire PluginConverter service during generation for error messages". You can safely ignore the error. Stop the information center and then restart it. |
|||
There are a bunch of issues related to Eclipse GTK 3. If you face any of such issues, you can switch to using GTK 2. See the list of issues. |
|||
To run SAP GUI tests with 20 or more virtual users on Oracle JDK, you can use the Long Run Mode option. Otherwise, the SAP GUI tests would fail. |
|||
After starting the product, a message such as the following
appears in the product console: The IBM Class Sharing
Adaptor will not work in this configuration. You are not
running on a J9 Java VM. This message is displayed because
the version of Eclipse that is used in the IDE is from IBM
and has the IBM Java optimizations enabled. To resolve the
issue:
|