Case Studies

OTT Platform Crowded Testing

India鈥檚 largest premium streaming platform provides an extensive selection of over 4,000 movies in 17 languages, alongside live TV shows, catch-up TV, and exclusive content, earning a 4.5-star rating on the Google Play Store. It delivers a high-quality video experience with advanced streaming technology, featuring seamless playback, crystal-clear sound, intuitive language navigation, smart content search, and customizable video quality options, making it a top destination for OTT viewers both in India and worldwide.
Product

OTT Platform

DOWNLOAD

25M+

TYPE OF TESTING

Crowd Testing, Compatibility Testing, Android TV app Testing, Localization Testing

COUNTRY

India

Challenges Faced by the Client

The client required functional and usability testers across major Indian cities with diverse real devices and network types. They needed regular functionality checks and specific feature testing to ensure seamless operation and address potential UI/UX issues.

Crowded Testing Across Major Cities in India

Crowded Testing Across Major Cities in India

To ensure thorough testing across all major cities in India, the client required qualified functional and usability test engineers with expertise in both mobile and web application testing. The challenge involved managing a diverse pool of testers equipped with a wide range of real device models popular in India, such as OnePlus Nord, Xiaomi (Redmi, Poco, Mi), Samsung Galaxy, Oppo, Vivo, Realme, Motorola, and Infinix. Additionally, testing needed to cover various network types, including Wi-Fi and mobile data connections from major Indian telecom operators like Jio, Airtel, Vodafone/Idea, and BSNL.

Ensuring Comprehensive Testing Coverage

Ensuring Comprehensive Testing Coverage

The client required regular, thorough functionality testing to ensure that core features such as video playback, in-app purchases, and login/registration worked as intended. This testing needed to be conducted at specified intervals, such as bi-weekly, to maintain high quality. Additionally, the client required the ability to request specific feature testing with detailed behavior and test cases. Usability testing was also an option to identify potential UI and UX issues through user feedback and task completion assessments.

SOLUTIONS BY TESTVOX

Testvox optimizes testing with short-duration engineer placements, effective crowd management, and clear communication. We ensure broad coverage by using real devices, various networks, and Android TV.

Crowd Resource Management.

Crowd Resource Management.

To efficiently manage the diverse pool of testers, Testvox deployed engineers for short-duration placements to address immediate testing needs. Utilizing a well-structured crowd testing methodology, Testvox ensures effective hierarchy management, streamlined task allocation, and robust communication channels. Our approach includes meticulous tracking of tasks and progress to guarantee timely and accurate testing outcomes, ensuring that each aspect of the platform receives comprehensive coverage across different devices and network conditions

Network, Real Device, and Location Coverage

Network, Real Device, and Location Coverage

To efficiently manage the diverse pool of testers, Testvox deployed engineers for short-duration placements to address immediate testing needs. Utilizing a well-structured crowd testing methodology, Testvox ensures effective hierarchy management, streamlined task allocation, and robust communication channels. Our approach includes meticulous tracking of tasks and progress to guarantee timely and accurate testing outcomes, ensuring that each aspect of the platform receives comprehensive coverage across different devices and network conditions. Additionally, we include testing on Android TV to assess compatibility and performance across all platforms and locations.

Test Case Execution

Test Case Execution

Testvox ensures precise test case execution by distributing detailed test cases to qualified testers equipped with the necessary devices and network connections as per the project plan. Testers methodically follow each test case, documenting their actions and observations. Any encountered bugs, usability issues, or performance bottlenecks are promptly reported, enabling efficient issue resolution and enhancing overall application quality.

OUTCOME

Improved efficiency and faster issue detection led to quicker feature delivery and a better user experience.

Improved Feature Delivery and User Experience

The improvements in test coverage and execution led to a faster detection of issues, reduced time-to-market for new features, and a more reliable user experience across diverse devices and networks.

Enhanced Testing Efficiency and Accuracy

The integration of efficient crowd resource management, extensive network, device, and location coverage, and precise test case execution significantly enhanced the testing process.

Leading this project was an exciting challenge. Our team ensured comprehensive testing across multiple cities, real devices, and network conditions, delivering accurate results and faster issue detection. By managing a diverse group of testers and maintaining clear communication, we improved feature delivery and overall product quality.
ANJANA PRAKASH Test Automation engineer at Testvox
UPDATES

Chime in on some Testing updates here