Skip to page content
Back to overview

Dec 5, 2023

Sensor-Independent Autonomous Mobility

Physical Sciences, Automotive, IT and Communication

  • Less need for retraining with new data as sensors evolve and are replaced
  • Simpler and faster implementation of new sensor models at reduced development costs
  • Factoring in field of view, mounting angle, resolution, and sensor nonlinearity
  • Successfully tested with both camera and LiDAR images

Your contact

Dr. Sindre W. Haugland

+49 (0) 89 5480177 - 17
Reference Number:


Sensor characteristics like the resolution and field of view affect the resulting pixel-by-pixel representation of a given object like a car or a pedestrian. Thus, a neural network trained to distinguish these features in the images from a specific camera will often not perform as well on images from a different one. When implementing a new sensor, training must therefore start from scratch with images from that sensor, which in turn also implies the costly real-world recording and annotation of these images


The invention defines a deflection metric whereby every pixel of an image is assigned an angle with respect to the axis of projection (see image on the left). Geometric properties of the sensor such as its field of view and nonlinear distortion are thereby encoded into the image in the form of an additional channel and taken into account by a neural network trained on images from sensors with differing properties. This in turn improves performance on images from any sensors with geometric properties within the ranges of the training set. Moreover, ambiguity in scale and distortion of objects recorded by any given sensor are also resolved.

Commercial Opportunities

The invention makes the perception system of an autonomous vehicle less dependent on the specific sensors providing the data about the environment. This means new sensors can be launched without collecting extensive amounts of new training data first. In a competitive market, where new and improved sensors are continuously developed, this provides a significant competitive advantage, both in terms of costs and time.

Development Status

Technology Readiness Level 3-4: Experimental proof of concept & Technology validated in lab


Interested? Get in touch!

Contact a specific team member via the Team section or simply use our contact form for your request.

Privacy settings

This website uses cookies. Cookies improve its usage and help make this website better.
Privacy policy