Case Studies

Sports betting Application testing

Zeus Testing Solutions was entrusted with this sports betting application by one of their clients for software testing. Upon Zeus's request for our Staff Augmentation Services to assess this B2B sports betting application, Testvox's software testers conducted the comprehensive testing. Users can place bets on sports such as football, cricket, tennis, and more.
Product

Sport betting

Country

UK

Duration

2.5 Years

Type of Testing

UI Automation

Type of Testing

API Automation

Type of Testing

End-to-End

CHALLENGES FACED BY THE CLIENT

This B2B betting application has a basic framework that permits customization by adding or removing features as required. The app isn't given directly to individual users by the client; rather, businesses obtain it from them after their developers tailor it for regional requirements. These customized versions of the application need to be tested meticulously before they are made accessible to users within a particular region.

Need to automate

Need to automate

Due to the absence of an in-house testing team, the client sought both manual and automation testers to evaluate this application. While customized versions of the application were tailored for specific regions based on user requirements, the core features remained consistent. Implementing automation using the fundamental framework would enable the efficient testing of various customized versions of the application, with minor modifications applied to the shared framework. This led the client to seek independent software testing companies with software testers possessing substantial experience and skill in automation.

Need of a common framework

Need of a common framework

API Testing and UI Testing both needed to be conducted. For API Testing, the tool "Postman" was utilized which has its own limitations and offers several built-in options that they were compelled to use. Initially, there were only 5 customized versions to manage. This prompted the client to configure Postman for these 5 projects, which was manageable. As the number of customized versions of the application increased significantly, the client faced challenges in managing configurations using Postman. Consequently, the transition to a more robust framework that allows logic-based coding became necessary. This could replace API activities accomplished through coding, enabling both UI Testing and API Testing to be conducted using a common framework.

Lack of documents

Lack of documents

No documents detailing the functionalities and operations of the application were available. As a result, sourcing knowledge related to various application functionalities and operations for the required team members proved challenging. This posed difficulties in providing training for new hires, whether they were software developers or software testers. They struggled to comprehend the application's functioning, as well as its different features and facilities.

SOLUTIONS BY TESTVOX

Given that the code for UI operations and Postman for API Testing were situated in separate locations, we embarked on an innovative task: integrating both UI testing and API testing into a unified framework utilizing common technology and a shared programming language.

Implemented Automation

Implemented Automation

To reduce manual intervention across various customized versions of the project, automation was implemented. A daily automation run was executed to perform End-to-end testing, encompassing validations to cover a broad range of workflow scenarios. This achieved a 70% completion rate within just one hour. Any failures encountered during this process were logged as defects. Concurrently, manual testing was conducted to uncover a higher number of bugs and subsequently report them. For enhanced efficiency and defect identification, the identical scripts were executed twice daily.

Set up an unified framework

Set up an unified framework

We consolidated our UI and API testing efforts into a unified framework called "Supertest." Within this framework, UI coding and API coding were amalgamated. The API validations that had been configured and maintained in Postman were systematically transformed into code, ready to be integrated into the Supertest framework. A comprehensive understanding of the logic behind each API validation was essential for its successful conversion into code and integration with Supertest. Transitioning UI-related test cases to the new framework was relatively straightforward, as they were already in a coded state. However, the challenge lay in incorporating new test cases and validations within the UI context. Through diligent coding, we managed to migrate approximately 4000 test cases, solely related to Postman validations, from Postman to the Supertest framework.

Completed Documentation

Completed Documentation

We meticulously documented all the functionalities and features offered by the application while concurrently conducting tests. Our diligent efforts were focused on discerning the various functionalities and features inherent within the application. To achieve this, we engaged in numerous discussions with software developers and officials from the client side and conducted extensive testing on the application. Furthermore, any issues or challenges that arose during the automation process underwent thorough root cause analysis, and the solutions were also documented. Our framework was also meticulously documented, providing a detailed guide for any new automation tester, offering a comprehensive understanding of the application's functionalities and features right from the initial stages.

OUTCOME

Testvox took the innovative approach of integrating both UI and API testing into a unified framework named "Supertest." Automation by us played a crucial role, enhancing efficiency and enabling daily automated runs for comprehensive testing. The documentation process was thorough, covering functionalities, testing strategies, and solutions, thus aiding new software developers and testers.

4K+

Test Cases

By employing diligent coding, we successfully transferred around 4000 test cases exclusively focused on Postman validations from the Postman platform to the Supertest framework.

10X

Increase in the speed of testing the application

Automation combined with the innovative approach of integrating both UI and API testing into a unified framework increased testing speed many times.

When I joined the project, we were using Postman for API testing and a basic framework in WebdriverIO with Cucumber for automation. We faced numerous challenges in automation, such as difficulties in configuring a larger number of projects in the API, which included detailed validation and script maintenance for both API and UI automation. To address these issues, we developed a solution by creating a unified framework (Super Test) for conducting both UI and API testing.
ANJANA PRAKASH | Team Leader, Automation Testing
UPDATES

Chime in on some Testing updates here