KoSiNuS: Development of Key Components and Safety Architectures for use in Autonomous Mobile Work Machines and Systems

Reliable perception for mobile machines

A key component of the safe and efficient use of autonomous mobile machinery, such as agricultural robots or construction machinery, is the reliability of their perception systems. Currently, there are only a few suppliers who offer the required technology because these solutions often only exist as research concepts, inaccessible solutions at large internet corporations, or specific components within the automotive industry. 

This is where the KoSiNuS project comes in. Within it, suppliers from Saxony and Fraunhofer IVI collaborate to develop key components and security architectures designed specifically for use in autonomous mobile work machines. The goal is to improve the security and reliability of key technologies such as environment perception and person recognition, robust computing and image processing hardware, and modular autonomy control software so that they work reliably even under challenging conditions.

Special attention is paid to the secure use of artificial intelligence and machine learning in environment perception – that is, the question how AI-based systems can make reliable and comprehensible decisions even under uncertain conditions.

In the long term, KoSiNuS is supposed to grow into a network of regional suppliers that supports manufacturers of agricultural and construction machinery by offering safe and practical solutions for autonomous systems.

KoSiNuS overview image
© Fraunhofer IVI
Roles of the partners within the KoSiNuS project.

Subproject 1

Subproject 1 serves to establish the general feasibility of the components to be researched and to narrow down the solution space. The aim here is a proof of concept for all components.

Subproject 2

Within subproject 2, component prototypes are developed and tested as a system. The research work carried out focuses on:

  • the image processing software,
  • fundamental software modules for ML-/AI-based sensor data processing,
  • a safety framework for GPU-/TPU-based standard hardware,
  • the autonomy control framework, and
  • the modular security framework.

The technologies to be developed by the project partners within the KoSiNuS projectare designed to allow for direct operation in neighboring fields such as mobile construction vehicles, mobile open-pit mining equipment, or other mobilen machinery for outdoor use. 

The consortium

The KoSiNuS consortium at their kick-off event at Fraunhofer IVI
© Fraunhofer IVI
The KoSiNuS consortium at their kick-off event at Fraunhofer IVI.

The KoSiNuS project combines applied research with the broad expertise of Saxon suppliers. The project partners are:

  • Hydrive Engineering GmbH 
  • SIListra Systems GmbH
  • Grünspecht Vision Labs GmbH
  • FusionSystems GmbH
  • Fraunhofer IVI