Reactive Projection Mapping on Moving 3D Objects from 7thSense entered into the blooloop Innovation Awards 2022

Reactive Projection Mapping on Moving 3D Objects

  • 2nd place

Project creator(s)

Entered into the following categories

Awards

  • Second place, Blue Sky

7thSense has developed a system that allows media to be projected onto moving 3D objects, updating the position of the media at a very high frame rate, using low latency camera position tracking.

We can track and projection map at up to 240 frames per second, using multiple projectors – keeping the media locked to the object as it moves around freely in a 3D space.

The system calculates the position of where each pixel should be on which output using a combination of:

• Actor® – the next generation 7thSense media server due for release in Q1 2023.
• R-Series 10 – the new 7thSense hardware platform.
• Compere® – the new 7thSense workflow interface.
• high-speed tracking cameras.

Based on position and rotation data from the tracking cameras, Compere updates the position of a corresponding model (or “digital twin”) of the object in its 3D environment, up to 240 times per second. The Actor render engine draws the appropriate pixels at the correct position within each projector’s output, again updating up to 240 times per second, regardless of the frame rate of the media. It works equally well with moving images, stills, and real-time generative content.

Not only can we choose what to projection map onto, but we can define what we don’t projection map onto. Within a dark ride experience, for example, a ride vehicle moving through a scene with projected environmental content can have the vehicle be projected upon, but not the guests inside it, all from the same projectors.

As a truly unique solution for projection mapping ‘on-the fly’ onto dynamic 3D objects, the opportunities are vast for highly immersive, engaging and interactive applications.

Your web browser is out of date. Update your browser for more security, speed and the best experience on this site.

Find out how to update