Touchscreen testing in the Automotive industry — the age of the robots

Manual and automated testing and the role robots can play

rinf.tech
3 min readNov 29, 2019

As cars’ touch-screen infotainment systems are evolving and enhancing the driver’s experience with features such as voice recognition, seat controls and connectivity, the necessity of developing tests for both the software and the hardware makes more complex and time consuming the release process. Moreover, software testers must often be engaged in repetitive tasks.

Automation — old challenges, new solutions

When the software is tested manually, the software tester performs an interaction with the device where the software is run, searching for errors and, when the process is complete, repeat the steps over and over again.

That’s when automation can step into the game. The work of automated testers consists in improving, adjusting and optimizing the process, being able to recycle the test that can be reiterated. Engineers are so liberated from repetitive tasks and can spend their time in more important activities involving the software they are working on.

Automated software testing is both time and costs saving.

Touch-screen devices, as infotainment systems and smartphones, come with the challenge of providing a pleasant screen-user experience: we all know how frustrating it can be to use a tool that does not respond accurately to our manual inputs.

Physical interaction

The best way to achieve the goal of offering a flawless interaction to the end-user involving automation is to replicate, instead of merely simulating, the user experience. Test Automation Robots, as MATT, can come to the aid.

The Robot

MATT is a complete testing solution for devices that incorporate any physical input such as touchscreens or buttons.

With a custom end effector that emulates any multi-touch gesture, like tapping, pinching, swiping and rotating, two high-resolution cameras and an included computer vision API, alongside powerful electronics and robust structure, MATT can perform full test cycles for both hardware and software, thus relieving manual testers of repetitive tasks.

When it comes to Automotive, MATT can be successfully employed to test touch-screen tools.

A new use case for MATT

We run a demo test on a luxury car’s infotainment system, and the features we focused on are:

· Radio network

Typing the name of a radio station, checking the accuracy of the touch-screen response and the correctness of the output.

· Bluetooth-smartphone connectivity

Testing the interaction between the dashboard and the phone paired with it by Bluetooth. Searching for a contact in the list and verifying that the call is successful.

· Seat controls

Test featured various commands for the seats position, inclination, etc.

MATT interacts with the device thanks to its computer vision system, records the test and takes a picture when one of them fails, logging the outcome for verification, evaluation and solution.

Stay tuned, the video of the test will come soon on RINF TECH’s platforms!

MATT is entirely developed in house by RINF TECH to help all companies who need to test software on touch-screen devices achieve consistent results and increase productivity, running tests continuously with maximum accuracy.

You can find us on LinkedIn, feel free to get in touch with us, we are looking forward to tell you more about our solution and meet for a customized demo test.

www.mattrobot.ai to learn more!

--

--