Automatic Test Assessment and Verdict Generation by CAN Monitoring

Sammanfattning: In this thesis the author presents an investigation on how to automate and streamline in-vehicle testing by developing a novel automated in-vehicle testing tool. The developed software architecture aims to reduce the amount of manual labor in order to decrease the time necessary to perform the manual in-vehicle tests. This is realized by a software tool with a client-server architecture, where the server monitors the Controller Area Network (CAN) traffic on one of the vehicle's CAN buses and the clients are test steps to be performed on the System Under Test (SUT). The test steps can be written in the Python programming language and bolted on individually. Through the use of Independent Guarded Assertions (IGAs) multiple tests are allowed to execute continuously and in parallel. The thesis, written at Scania CV AB, investigates the field of automotive testing by literature study, to identify the State Of The Art (SOTA) in the field; interviews, to capture the Scania CV AB's needs and requirements; and a case study, to verify and analyze the implemented testing tool. The result of the literature study shows that there already exist many possible solutions, but they focus mostly on virtual environments and software based systems, thus not directly compatible with the invehicle environment. From the interviews a number of requirements are identified, both regarding tool functionality and safety related aspects e.g. intrusiveness of in-vehicle tools. Results from the case study shows that the in-vehicle testing environment is more intricate than initially perceived, both in terms of the factors that dictates the time necessary to perform it and technical complexity. In conclusion, this thesis shows that there is a great potential to improve the manual in-vehicle testing by adding more automated support and tools. It is also evident that the execution time is not the only prospect that can be positively affected. Reproducibility, formal test specifications, and the possibility to produce richer test cases are some of the advantages discovered.