Testing teams can often be unhappy with their existing framework due to daily instabilities in execution, resulting in tests hanging or producing false-positive outcomes, leading to significant manual effort post-execution.
In 2018, for example, the Workload Automation test team began to prepare for its 9.5 release the following year. This major release brought about a complete redesign of the primary user interfaces. And, such radical change meant that none of the existing test automation assets was usable and that the effort to re-engineer them was significant.
The team evaluated updates to their existing Selenium Robot framework, while also looking at Katalon and HCL OneTest, primarily focusing on effort, ease of use and maintainability as the success criteria.
Katalon was carefully considered due to its strong out of the box capabilities. However, the team noticed several problems when creating scripts while finding the maintenance effort to be high.
Support provided by the community and even third-party vendors, was not enough to satisfy the business-critical requirement for the automation.
Hence, HCL OneTest was selected for a pilot program due to its offering of a codeless solution with the added benefits of simple script maintenance and the ability to leverage API and database actions in test scripts.
At the conclusion of the pilot program, there were several key findings, including, intelligent object recognition during playback made scripts resilient to changes and easy to maintain.
Additionally, the Workload Test Automation team saw a 35% increase in coverage with new tests, and the ability to bridge front and back end components of the application.
Download the Workload Automation case study to see all the key findings and benefits.