Environment Reconstruction Service

What is it?

An important component that helps realise 3D-LIVE’s shared experience is the capture and virtual reconstruction of the outdoor environment conditions for remotely connected indoor players to experience – in near real-time. During the 3D-LIVE game play, a range of atmospheric and ground-level effects (such as sunshine and cloud cover, wind, rain or snow, temperature and humidity) will be continuously updated within the virtual environment, based on real-world sensor data gathered from the venue and surrounding areas. The result is a virtual environment that dynamically adapts its appearance and behaviour so that avatars’ interactions in the simulated environment are affected in similar ways to what might happen outside. Wind will blow golfing shots off course and rustle trees. Snow quality will impact skiing control. Cloud and lighting will change the appearance of the player’s view. Our expectation is that the combination of these effects with the other 3D-LIVE reconstruction capabilities will produce a compelling ‘twilight’ experience where virtual and augmented worlds seamlessly integrate.

How do we do it?

To get a representative and up-to-date reconstruction of the real world environment, we have developed a system called the ‘Environment Reconstruction Service’ (ERS) which listens for environmental data from a number of different sources and continuously updates an internal model of effects that is queried by the 3D-LIVE rendering engines at run-time. We gather, fuse and interpolate environment data from the ‘wide area’ (from weather stations) and from local and mobile sensors (using portable sensors such as the Kestel 4000 and Sensordrone). Because our outdoor player will carry mobile environment sensors with them during game play, the ERS is able to provide near real-time updates that are highly localised – increasingly the connectedness between our 3D-LIVE players.





Image credits

[1] Golf course weather, Jerry W Lewis (2008)

[2] Weather Icons, Akhter (2012)

[3] Schladming Mountain, Ján Sokoly (2010)

[4] Weather Station, Akhter (2012)

[5] Sensordrone Device, Copyright www.sensordone.com (2013)

[6] Kestrel 4000 Device, Copyright www.kestrel-direct.com (2013)