Mixed reality: a new way to look at infrastructure

Cambridge University is partnering with Trimble and Microsoft to combine physical infrastructure data – such as design, construction and operational data – that is currently stored in separate archives. The goal is to make them available to civil engineers and other construction professionals through the latest mixed reality technologies.

While civil engineers have built millions of physical assets over many centuries, they have done relatively little to create digital data repositories with integrated geometry, design, construction and operation data. This is not surprising given most existing physical assets started their lifecycle well before modern digital engineering technologies existed.

Digital asset data

As such digital data for infrastructure assets is only partially available, rarely up-to-date and almost never integrated into a single platform so that informed decisions can be made. Building information modelling (BIM) technology is changing that by delivering a 'digital copy' of an asset, bringing all types of data together for use over the asset's lifetime.

The objective is to provide civil engineers, facilities managers and other asset stakeholders with the information they need to make informed decisions and better manage the assets throughout their lifecycle. Enabling them to engage with the digital asset models through mixed reality will also greatly improve productivity and sustainability.

Construction monitoring

For example, monitoring construction site progress is a laborious, time-consuming and error-prone task. Research at Cambridge has led to a Microsoft Hololens application which will help to automate progress inspections.

The application, which will be transferred to practice through Trimble, allows inspectors wearing Hololens headsets to see a three-dimensional (3D) as-planned digital model of the works overlaid on the as-built works as he or she walks around it. Once aligned, the model remains fixed relative to the scene, remains stable and has no occlusions.

The application then automatically compares the as-built status with the as-planned data to provide instant progress information as the inspector moves around the site. This information allows inspectors to detect any schedule or specification discrepancies at the earliest opportunity, enabling early corrective action to be taken.

Bridge inspection

Another example is the visual inspection of bridges, which usually has to take place annually or biennially. These inspections are laborious, require traffic control and pose a health and safety risk for the inspector.

Cambridge University is working on methods to build fully textured, data-rich and geometrically accurate models of existing bridges which can then be used for remote off-site inspections. Data are collected during on-site maintenance operations or with drones and automatically converted to an as-is model.

Element surface texture is extracted from high-resolution images and defects are automatically identified. Using Hololens, inspectors can look at the real-sized bridge model in the comfort of their offices and be guided automatically to areas of concern.

Context-based workflow

The two examples clarify the value of presenting data in context. By merging the digital and physical worlds, mixed reality enables a context-based workflow. It transforms the way civil engineers consume, interact and communicate information.

Through Hololens and other technologies, Trimble, Microsoft and the University of Cambridge are working together to develop a new generation of solutions towards improved automation in construction.

This article is based on an article published in the May 2017 issue of Civil Engineering.