Created at CIID by Arvind Sanjeev, Lumen is a mixed reality storytelling device that lets users explore AR/VR content without being confined to headsets or mobile devices. It uses machine learning and projection mapping to provide interactive media in the physical world by overlaying a layer of digital content on top of it.
The project explores the future implications of media without screens to see how people may interact with the environment around them. Lumen consists of a laser projector in combination with a camera and depth sensors and relies on the yolo darknet machine learning platform to classify objects which is then processed by the onboard algorithm that generates stories on top of the classified objects through projection mapping.
By Filip Visnjic
Source: http://www.creativeapplications.net/environment/lumen-mixed-reality-storytelling-device/