Modern cars offer more and more networking opportunities. But who has the best concept of functionality and usability to offer? To answer this question, the ADAC and connect teamed up and conducted a joint test on eleven models in the compact class.
The results were partially sobering, because while some of the manufacturers are delivering the test, the majority are still in their infancy. Find out here who was allowed to wear the car connectivity crown at the end.
Overview: The 11 compact ones in the large connectivity test
So we test
Networking in the car has recently developed rapidly. We take this into account with our car connectivity test. We explain the connect and umlaut test procedure, which was expanded in the course of a cooperation project with the ADAC.
There are probably only a few areas that have developed as rapidly in the recent past as networking in vehicles. However, the manufacturers are also under pressure – after all, drivers already know many amenities from home, such as natural voice control with Amazon Alexa, Apple Siri or Google Assistant. Even the smartphone with all its advantages has become an integral part of everyday life. That is why car buyers today have completely new expectations of modern infotainment systems in vehicles.
In order to take this development into account, we brought together umlaut, ADAC and connect, the experts in the field of user experience, autotests and connectivity, in order to further develop our test procedure for car connectivity solutions.
Test in four categories
Our test is divided into four categories: While the connect and ADAC testers investigate the three disciplines “infotainment” (user interface and entertainment), “navigation” and “connectivity”, the “user experience”, that is, checks the user experience.
The cars are tested by various experts over several days under everyday conditions. The number of displays, size and resolution as well as the entertainment equipment play an important role in evaluating the infotainment. The user interface also influences the scoring.
For a positive evaluation of the navigation, not only the equipment and the presentation of the system must be at the highest level, but also the route calculation and the visual and acoustic route guidance for different use cases. The route calculations from Google Maps serve as a reference for the test drives. They are very familiar with the testers and can also deal reliably with traffic jams.
The connectivity assessment takes into account the numerous interfaces of the vehicle, a smartphone app, if any, but also productivity tools such as the processing of emails and the hands-free system. The latter also has to prove itself in practice during several conversations.
Connected Car Services (CCS) tests are carried out by four umlaut experts. These testers are all characterized by several years of professional experience in the area of connected car services and user experience.
In the first part of our test, the experts carry out predefined use cases. In order to have a reference value for the evaluation of each use case, the experts previously identified and evaluated reference systems. After each use case, the expert has to answer an After Scenario Questionnaire (ASQ).
In the second part, the user experience assessment, each expert evaluates the usability, as well as the perception of the connected car app and the vehicle HMI using the questionnaires UMUX (Usability Metric for User Experience) or me-Cue. After the survey, the data is consolidated in an expert focus group. The three questionnaires are evaluated using a six-level Likert scale. The mean of each use case is formed from the results of all experts. The overall UX score is calculated from the respective total score of the task-related and the object-related part.