Case Studies

IOT Product Testing of Smart Nursery App

Babysense Connect monitors a baby鈥檚 movements, and generates alerts if movement stops or becomes irregularly slow. The Babysense Dreamer is a smart sound and light machine which helps little ones fall asleep, stay asleep and wake-up in a great mood. The BabysenseSee HD app helps to monitor a baby in real time, remotely adjust the camera, record, snap photos, play back moments and much more.
Country

ISRAEL

Type of Testing1

Device Testing

Type of Testing2

Integration Testing

Product

Smart Nursery Monitoring System

Duration

Long Term

Project Management

Jira, Microsoft Teams

CHALLENGES FACED BY HISENSE

The Babysense Smart Nursery App encompasses three devices, each equipped with associated hardware. These devices were seamlessly paired with the app through Bluetooth technology. The integrated hardware components encompass sensors, light and sound generation facilities, and a camera, all controllable through the application. Hisense sought an adept testing team with experience in IoT product testing to help in validating the functioning of the application along with the connected hardware devices within the IoT system.

Lack of in-house testing team:

Lack of in-house testing team:

Hisense lacked an internal QA team for effectively managing testing efforts. Software developers executed software testing without the perspective of an effective testing approach, that only proficient and experienced software testing professionals could provide. Hisense sought software testers with experience in IoT product testing to conduct comprehensive end-to-end product testing of their in-house developed IoT product and to validate the connectivity and the subsequent functioning of the devices and the software within the IoT system.

Hardware-Software Integration Testing:

Hardware-Software Integration Testing:

Hisense was in search of expert software testers experienced in testing mobile apps integrated with hardware devices on both Android and IOS platforms. The application was integrated with three different devices using bluetooth technology: Babysense Connect, Babysense Dreamer, and BabysenseSee HD. The application testing was to be carried out for all these integrations on both Android and IOS-based mobile devices.

Required Standard QA Documentation:

Required Standard QA Documentation:

The lack of timely updates to project documents following changes in various functionalities and features of the application posed a challenge for Hisense's software developers during testing. Many functionalities and features present in the application were absent from the existing project documents. Additionally, the functioning of some features did not align with the specifications outlined in the documents.

SOLUTIONS BY TESTVOX

As the application became integrated with hardware devices, our software testers adopted an integrated testing approach to assess the functionality of both the application and the connected devices, including their connectivity. Thorough examination and documentation of the various features associated with the connected devices were conducted to formulate test cases that comprehensively evaluated the connectivity.

Planning and documentation:

Planning and documentation:

Initially, test plans were created based on the design document provided by Hisense. Test cases were then developed and executed according to the scenarios outlined in the design document. During testing, our testers identified mismatches between the operations of certain application functionalities and their descriptions in the design document. Some functionalities present in the application were found to be missing from the design document. Following the testing phase, our software testers collaborated with Hisense to update the design document based on their findings. This collaborative effort resulted in the creation of a comprehensive document, encompassing all the functionalities present in the application. The finalized document proved to be highly beneficial for the client in later stages.

Diverse Testing Methodologies:

Diverse Testing Methodologies:

Software Testers from Testvox carried out Functional testing, Smoke testing, Sanity testing and Regression testing on the application. Our software testers conducted End-to-End IoT testing on the application integrated with the hardware components of the three connected products on both IOS and Android based mobile devices through Bluetooth pairing , uncovering defects in the application during test case execution. This also included testing the variety of features associated with the connected devices like temperature display, time display, light and sound settings, ambience settings, etc. The testing process also included execution on the production environment to ensure thorough evaluation and good user experience.

Comprehensive Testing and Issue Reporting:

Comprehensive Testing and Issue Reporting:

Testvox conducted comprehensive testing of the application according to the refined document, verifying various functionalities through their associated connectivity with the IoT hardware devices using bluetooth. For IOT testing on the application, a variety of mobile devices using both IOS and Android platforms, predominantly used by end users, were carefully selected. Real-time scenarios were simulated by employing the application and the three connected devices to assess the control functionality of these devices through the application. Any issues identified during testing were promptly reported to the development team to ensure swift resolution. Bug reporting and tracking were facilitated through Jira, while daily communications were seamlessly conducted using Microsoft Teams.

OUTCOME

The initial assignment was for a period of 2 months. During this short duration, Testvox, with its team of software testers, executed testing services that left Hisense greatly impressed. In light of the positive outcomes and as additional functionalities were incorporated into the system, Hisense has been continuously engaged in testing which persists to date.

300

Test Cases

Software Testers from Testvox created and executed more than 300 test cases to conduct a comprehensive testing of the application.

2X

SDLC

The timely testing and feedback provided by Testvox's software testers significantly contributed to a substantial reduction in the time required to complete the product development.

5X

Increase in efficiency

The application's efficiency increased fivefold after the successful completion of its testing.

Testvox Team work since Feb. 2023 has significantly increased our mobile app release cycles, and also assisting in detecting hardware bugs in all Babysense products. Our R&D future roadmap includes expanding the manual testing to our Backoffice website, and moreover, adding REST API automation. We are confident in the capabilities of Testvox to help us, as a team, continue and grow the Babysense brand in the future.
Itsik Binyamini | CTO Hisense Ltd
UPDATES

Chime in on some Testing updates here