AR in Construction in 2024: the Technology, Business and Product Adoption Trends That Are Changing the Game
The construction industry is at the cusp of a technological revolution, with augmented reality (AR) poised to become an indispensable tool for contractors in 2024. AR's ability to overlay digital information onto the real world promises to enhance productivity, reduce costs, and improve collaboration in a wide range of construction tasks.
This article is guided by insights from Sitelink's co-founding team - Jesse Vander Does - CTO, Niko Suvorov - CEO, and Anca Stefanescu - CGO. We’ll first explore the catalysts and dynamics of the current shift from 2D to 3D taking shape in the construction industry, discuss the business impact of AR technology in construction today, and finally, outline our predictions for the state of AR in construction in 2024. Let’s dive in!
A Fundamental Shift from 2D to 3D: Catalysts and Dynamics
The shift from 2D to 3D is laying the foundation for a new era in construction where three-dimensional thinking is becoming a necessity for staying competitive and meeting the demands of the modern built environment.
This fundamental shift towards 3D is driven by a convergence of factors - the perfect storm is happening in construction.
Large Skills and Generational Gap
The construction industry is experiencing a large skills gap with digital natives entering the construction workforce very slowly, due in part to the low technology adoption in this sector. Digital tools are one of the levers of incentivizing young employees to join.
This demographic shift is reshaping how projects are conceived and executed. The younger generation, raised in a digital era, is more inclined towards three-dimensional thinking and visualizations. The shift to 3D is not just a technological upgrade; it's a natural progression aligning with the cognitive preferences of the evolving workforce.
Increased Demand for More Efficient and Sustainable Construction Practices Coupled with Economic Challenges
From 2024 to 2026, the construction industry navigates a landscape of growth and challenges. Influential factors include economic fluctuations, labor shortages, technological advancements, a focus on sustainability and efficiency, and new market demands. These dynamics are driving significant changes across the industry:
Addressing Labor Shortages with Off-site and Industrialized Construction: The industry is leveraging off-site and industrialized construction to balance labor shortages with increasing work volumes. This shift towards prefabrication and modular building techniques reduces on-site labor reliance, leading to changes in business models.
Mitigating Supply Chain Disruptions: With the adoption of off-site manufacturing, supply chain strategies are evolving. Diversification of supplier bases, stockpiling essential materials, and local sourcing are critical for delivering predictable outcomes. Extended lead times for major MEP (Mechanical, Electrical, and Plumbing) equipment, combined with shorter go-to-market expectations from owners, are pushing the industry toward consolidation and resource-based project design.
This requires value engineering, where projects are designed based on available materials and components, ensuring feasibility and cost-effectiveness without compromising on constructability.
Embracing Technological Advancements: As projects increase in complexity and timelines shorten, digital tools such as BIM and AI facilitate a growing demand for enhanced project management. The need for collaboration and transparency in construction projects calls for digitizing every workflow on-site. This digitization ensures that all stakeholders have access to the information they need in the manner they require. We’re witnessing automation and robotics being adopted for repetitive tasks to improve efficiency and accuracy, further supporting the reduced need for an on-site workforce.
Government Incentives and Market Opportunities in Infrastructure and Higher Education: Driven by governmental incentives, infrastructure, and higher education opportunities are being pursued with a focus on sustainable and efficient construction practices.
Emerging Industries and New Infrastructure Demands: New industries like EVs, AI, microchip manufacturing, life sciences, and healthcare are creating new infrastructure demands and offering opportunities for diversification and innovation.
BIM Penetration Rate on the Rise
Faced with efficiency and operational demands, new market conditions and challenges, the construction industry is responding in part by introducing more 3D BIM. As the BIM penetration rate increases, so does the prevalence of 3D methodologies in construction projects. BIM's ability to enhance collaboration, reduce errors, and offer a holistic view of a project has positioned 3D as a central component of the digital transformation that BIM represents. It's not just about creating a 3D model - it's about leveraging the intelligence embedded in these models for better decision-making throughout the project lifecycle.
As we look ahead to the next few years, the construction sectors of Life Sciences, Healthcare, Data Centers, Advanced Manufacturing, Infrastructure, and Higher Education will be driving the industry. These sectors share similarities in terms of their complex design requirements and the increasing pressure for rapid delivery to market. They all demonstrate a convergence in their expectations for Building Information Modeling (BIM) and design approaches.
Life Sciences and Healthcare: These sectors emphasize the need for speed to market and design flexibility in many projects. For instance, prefabricating segments of hospitals in controlled environments is a strategy used to expedite construction, regardless of external conditions like weather, thus addressing both the complexity and timeline challenges in healthcare facility construction. Integrating innovative technological solutions in healthcare construction and design is crucial for meeting dynamic healthcare environments and community needs.
Data Centers: Speed is crucial in the data center space as delays equate to lost revenue. The industry has seen a shift from traditional construction timelines of 18-24 months to more expedited schedules, with expectations moving towards having move-in-ready facilities in as few as six months. Prefabrication of core infrastructure elements is a crucial strategy to accelerate time-to-market in data center construction.
Advanced Manufacturing, Infrastructure, and Higher Education: These verticals face similar challenges of balancing complex design requirements with the pressure for faster project delivery, given the overall trends in the construction industry
In terms of design-to-construction process, these sectors will likely share similarities in their need for detailed planning, coordination, and efficient design processes to meet their complex project requirements and accelerated timelines. BIM provides a collaborative platform to manage these demands by enabling precise planning, effective resource management, and enhanced stakeholder communication.
Enabling Technology is Getting More Powerful
The surge in 3D adoption is intricately tied to the growing power of enabling technologies.The iPhones and the iPads on the jobsites are getting increasingly more powerful, faster, more suitable for complex construction applications, like capturing LiDAR scans. From augmented reality to reality capture and indoor positioning, construction professionals now have access to tools that can translate 3D models into immersive, interactive experiences. These technologies empower stakeholders to visualize and comprehend complex structures in ways that traditional 2D blueprints could never achieve.
Augmented reality technology has made significant strides in recent years, with advancements in hardware, software, and content creation tools making it more accessible and versatile than ever before. Some of the most notable recent advancements in AR technology include:
Ubiquitous access to AR: Nearly every user with a cellphone has access to AR experiences. ARKit was released in 2017, social media is full of AR effects, the general public is now familiar with the power of AR.
Environmental understanding: Advancements in machine learning are showing up in AR. Experiences like RoomPlan allow device cameras to not just see, but to understand what objects are in the environment.
Advanced sensors: Many devices now have access to advanced sensor capabilities such as LiDAR (Light Detection and Ranging) and UWB (Ultra Wide-band) chips. These new sensing capabilities allow devices to capture their environment in 3D and find objects in their environment.
Hardware Advancements:
The development of more powerful and affordable AR devices has been a cornerstone of its recent growth. Smartphones, once limited in their AR capabilities, have undergone a dramatic transformation.
Several advancements in mobile hardware have enabled the widespread adoption and sophistication of AR technology. These advancements have made it possible for smartphones and tablets to accurately perceive and interact with their surroundings, creating immersive and engaging AR experiences. Here are some key mobile hardware advancements that enable AR technology:
Advanced Cameras: Modern smartphones and tablets are equipped with multiple cameras, with both telephoto and wide angle lenses. Wide angle lenses are well suited for Simultaneous Localization and Mapping (SLAM), while camera pairs can be used for stereo reconstruction and accurate estimates of world scale.
Accelerometers and Gyroscopes: Accelerometers and gyroscopes are sensors that measure motion and orientation, providing valuable data for AR applications. They enable devices to track users movement at a higher frequency than cameras, don’t rely on a well lit and visually feature rich environment, and require less power than camera sensors. On their own, these sensors suffer from drift, but when used in concert with cameras they are a critical component of a modern AR system.
Advanced Processors: Smartphones and tablets with powerful processors are able to handle the computational demands of AR experiences, including image processing, 3D rendering, and object tracking. Powerful processors ensure smooth, responsive AR interactions without lag or performance issues.
Depth Sensors: Depth sensors, such as time-of-flight (ToF) sensors, enable devices to accurately measure distances between objects and surfaces. This information is crucial for creating realistic and immersive AR experiences with precise object placement and interactions.
Software Advancements:
AR software has evolved significantly, with improved tracking capabilities, more realistic rendering, support for more complex interactions, and growing availability of user-friendly content creation tools for AR:
Improved tracking capabilities:
World-scale tracking: Utilizing a class of algorithms that perform Simultaneous Localization and Mapping (SLAM), a device can build a 3D map of the environment and estimate how it is moving through that map. With this understanding an application can render CG content that appears pinned to the real world.
Object tracking: This allows AR apps to track objects and surfaces in three dimensions, including their position, orientation, and scale. The most common object tracking falls into two categories, 2D image tracking and 3D model tracking.
More realistic rendering:
High-resolution 3D graphics: AR software is now capable of rendering 3D graphics with high resolution and detail. This allows AR apps to create virtual objects that look and feel like they are in the real world.
PBR materials: Physically based rendering (PBR) materials allow AR apps to create virtual objects with realistic textures and lighting effects. This makes AR experiences more immersive and believable.
Global illumination: Global illumination is a rendering technique that simulates the way light bounces around a scene. This can make AR experiences more realistic and visually appealing.
Support for more complex interactions:
Gesture recognition: AR apps can now recognize and interpret a wider range of gestures, such as hand movements, finger swipes, and taps. This allows users to interact with AR experiences in a more natural and intuitive way.
Object occlusion: AR apps can now track and occlude virtual objects behind real-world objects. This makes AR experiences more realistic and immersive.
Physics simulation: AR apps can now simulate the physics of virtual objects. This allows for more realistic interactions, such as objects colliding and falling.
Audio spatialization: AR apps can now position sound in 3D space. This allows users to hear virtual sounds coming from the direction of the real-world objects they are interacting with.
Content Creation Tools:
The growing availability of user-friendly content creation tools for AR (like Apple’s Reality Composer and Google’s Sceneform) is democratizing the development process by reducing the learning curve, encouraging experimentation, and enabling a wider range of individuals to contribute to the growing ecosystem of AR applications and experiences.These tools simplify the process of modeling, animating, and interacting with virtual elements in the real world, paving the way for a wider range of AR applications.
The Business Impact of AR in the Construction Industry
In this context, augmented reality technology, with its unique capabilities for time travel, 3D collaboration, and shared digital-physical asset visualization, offers transformative solutions to the challenges the industry faces.
Time Travel Capability in AR: Workers can visualize future stages of construction on-site, helping them understand the outcome of prefabricated components. This aids in better preparation and integration of these components when they arrive, reducing waste.
3D Collaboration for Off-site Construction: AR allows for capturing and sharing detailed, geo-tagged construction data (images, videos, LiDAR) with off-site teams. This enhances off-site fabrication and design coordination, streamlining the construction process.
Resource-based Design and AR Collaboration: AR's 3D collaboration feature can address real-time design changes based on availability of materials. This helps in value engineering, ensuring projects remain constructible and cost-effective despite supply chain disruptions.
Digitized Workflows for Transparency: AR can digitize on-site workflows, making every construction process transparent to all stakeholders, and increasing accountability. This is especially beneficial in projects where collaboration and accuracy are critical.
Augmented reality is driving construction towards more technologically advanced, efficient, and client-focused outcomes, particularly for General Contractors. GCs that embrace AR are well-positioned to save costs, increase efficiency, reduce errors, enhance on-site productivity, and improve client engagement.
Cost Savings:
Error Reduction: AR allows GCs to visualize project outcomes before construction begins, enabling them to identify and correct potential errors early on. This can significantly reduce rework and material waste.
Efficient Resource Use: Guiding workers in precise placements and alignments with AR leads to optimized material and labor use, curbing unnecessary expenditures.
Streamlined Processes: Integrating AR in design and construction processes aligns digital plans with physical construction more accurately and quickly, cutting down traditional cross-referencing time and costs.
Improved Efficiency:
Enhanced On-site Productivity: AR apps on everyday devices like smartphones and tablets allow workers to access crucial information in real-time. This convenience speeds up installation, inspection, and maintenance tasks and leads to faster project completion and improved productivity.
Quick Decision-Making: AR enables real-time visualization and collaboration, accelerating decision-making with immediate on-site adjustments.
Practical Training and Skill Development: AR aids on-site training, providing interactive, guided experiences that enhance worker skills and reduce learning curves for complex tasks.
Enhanced Competitiveness:
Innovation and Differentiation: Embracing AR technology gives GCs a cutting-edge advantage, which is crucial for standing out in competitive bid processes.
Client Engagement and Satisfaction: AR is used to provide clients with more transparent and interactive project updates, improving client satisfaction and building trust.
Capability for Complex Projects: The adaptability of AR in managing complex designs and requirements positions GCs to undertake a diverse range of projects, enhancing their market reach.
As the industry evolves, the integration of AR as a strategic asset into construction practices is set to become standard practice.
AR in Construction in 2024: Trends & Predictions
Now, let’s look ahead to the next year, and discuss the key technology, business, and product strategy predictions that will shape the future of AR in construction.
Business Predictions: A Strategic Shift from Innovation to Implementation
AR becomes a standard tool for design communication and management
RFI management shifts with context-rich AR communication
Integrating AR in field operations establishes a seamless connection with off-site fabrication processes
Real-time data analysis and visualization enable the transition to proactive project management
Advanced training and skill development with AR bridges the skill gap
The user experience becomes a paramount focus for AR applications
Time-to-value acceleration is crucial for AR to gain widespread adoption in construction
AR solutions increasingly adopt a process-enabled SaaS model
Innovation-light, bottom-up approaches become more prevalent in 2024
As AR technology matures and its benefits become more tangible, adoption across mid-size contractors increases
AR tools focus on deeper alignment with highly-specific industry needs
Data security and privacy become a critical concern for both construction companies and AR developers
Tech Predictions: View Synthesis, AR Hardware, and the Role of LLMs in Shaping Construction Tech
Gaussian Splatting applications gain momentum
The release of Apple’s Vision Pro combined with Spatial Videos usher in a new era of understanding and collaboration around jobsite conditions
LLMs transform how AEC software tools are developed
Below, we take a closer look at each one of our predictions.
2024 Business Predictions: A Strategic Shift from Innovation to Implementation
“2024 will mark a pivotal year in the construction industry, shifting from the initial “wow, I can see this” reaction to AR technologies to a more pragmatic “here’s what I can do with what I see.” This evolution signifies a move from a fascination with AR’s capabilities to practical, workflow-integrated applications that drive efficiency and productivity. ”
By 2024, the role of AR in construction will mature from an innovative visualization tool to an essential component of construction workflows. Here's how this shift is expected to manifest:
1. AR as a Standard Tool for Design Communication and Management
AR will become a standard tool for conveying design changes for early adopters, eliminating the complexities of traditional design communication methods. The technology will facilitate visualization and decision-making based on real-time, on-site LiDAR scan and up-to-date 3D models. This approach that merges AR with Reality Capture technology will streamline the design change process, fostering alignment and collaboration among diverse stakeholders, from architects to field workers.
By providing a shared and synchronized view of the project, AR will ensure that everyone is always up-to-date with the latest design updates.
2. More Efficient Handling of RFIs
The management of Request for Information (RFIs) will undergo a shift as AR empowers precise and context-rich communication. Instead of relying on vague descriptions and lengthy emails, AR will enable field workers to pinpoint site issues and share location-tagged, content-rich AR visualizations with relevant stakeholders. This enhanced clarity will lead to faster resolutions with significantly less back-and-forth, streamlining the RFI process and minimizing disruptions to the construction schedule.
The ability to overlay digital information onto the real world will prove particularly beneficial in complex projects where clarity and precision in communication are paramount. By allowing stakeholders to visualize issues in context, AR can effectively bridge the gap between field observations and technical drawings, eliminating misinterpretations and delays.
3. Synchronizing Field Operations with Off-Site Construction
Integrating AR in field operations will establish a seamless connection with off-site fabrication processes. Real-time data and feedback from the field will be shared with geo-tagged assets in the off-site fabrication facility, enabling on-the-fly adjustments to fabrication parameters to match the evolving conditions on the construction site.
This integration will enhance the adaptability of off-site construction processes, transforming them into agile systems that can respond to unforeseen challenges and changes on the jobsite. By bridging the gap between field and fabrication, AR will enable the adaptation of prefabricated elements to site-specific requirements, ensuring that the finished structure seamlessly integrates with its context.
4. Transition to Proactive Project Management
AR will facilitate a shift from reactive to proactive project management. By enabling real-time data analysis and visualization, AR will empower project managers to anticipate potential issues and take corrective actions before they cause delays or disruptions. For instance, analyzing structural integrity data to identify and flag potential structural issues before they escalate will allow engineers to save time and resources.
On-site workers will have immediate access to up-to-date construction documentation through AR, eliminating the need for paper plans and reducing the risk of errors and misinterpretations. AR will also facilitate collaboration among different teams, enabling seamless data sharing and improving decision-making processes across the project lifecycle.
5. Advanced Training and Skill Development
The use of AR for training will go beyond basic skill demonstration to more complex, scenario-based learning experiences. Workers will gain hands-on experience in a virtual environment, practicing sophisticated tasks in a safe and controlled setting before attempting them on-site. This simulated training environment will provide a realistic and interactive platform for workers to develop proficiency and confidence in executing complex tasks.
This innovative approach to training will be particularly crucial in addressing the skill gap, particularly for emerging technologies and practices being adopted in the construction industry. By providing pre-exposure to these advancements, AR-based training will equip workers with the necessary skills and knowledge to effectively incorporate these new technologies into their workflow.
2024 Product and Adoption Predictions: Ease of Use, Workflow Integration and Innovation-Light Approaches Drive Adoption
“The focus on bottom-up, innovation-light SaaS solutions that deliver accelerated time-to-value and respond to highly specific industry needs will pave the way for wider adoption of AR across mid-size contractors.”
2024 will be a pivotal moment for AR in the construction industry. A shift away from novelty and towards practical applications will transform the way projects are planned, designed, and built.
1. User Experience Takes Center Stage
The user experience will become a paramount focus for AR developers in the construction industry in 2024. As the novelty of AR technology fades, construction professionals demand easy-to-use, intuitive tools that integrate directly into their existing workflows. AR solutions that require extensive training, complex setup, or specialized expertise will struggle to gain traction. Instead, the focus will shift towards user-friendly interfaces, streamlined processes, and intuitive interactions that make AR accessible to a broader range of construction workers. This isn't just about aesthetics; it's about leveraging AR as an accessible daily asset.
Intuitive Interfaces: AR applications will become more intuitive and easy to use, with simplified interfaces that require minimal training for construction field teams to adopt.
Real-time Support: AR applications will provide real-time support and guidance to workers, helping them to identify potential problems, make informed decisions, and complete tasks efficiently.
2. Time-to-Value Acceleration Drives Adoption
Construction projects are inherently time-sensitive, and AR solutions need to align with this urgency. Developers will continue to focus on reducing the time it takes for workers to adopt and utilize AR technologies, emphasizing quick onboarding and immediate value proposition, and eliminating the need for lengthy training or ramp-up periods. This focus on time-to-value will be crucial for AR to gain widespread adoption within the construction industry.
Rapid Implementation: AR solutions will become easier and faster to implement, allowing construction firms to quickly adopt AR and start realizing its benefits.
Immediate Impact: AR applications will provide immediate value to workers, helping them to improve efficiency, reduce errors, and enhance safety on the jobsite.
Demonstrable ROI: AR solutions will have a clear and measurable return on investment (ROI), making it easier for construction firms to justify the adoption of AR technology.
3. Process-Enabled SaaS Models Gain Prominence
Implementing AR at scale in the construction sector - particularly for enterprise-wide deployments, requires a process-enabled Software as a Service (SaaS) approach.
As such, we see AR solutions increasingly adopting a process-enabled SaaS model, enabling companies to deploy and manage AR-enhanced workflows seamlessly. This will provide construction firms with the flexibility to integrate AR into their existing project management systems, ensuring consistent data access and streamlined collaboration across teams. Cloud-based SaaS solutions will also simplify updates, maintenance, and scalability, making it easier for companies to adapt their AR implementations to changing project requirements. For individual users, this means access to AR insights and instructions within the context of their existing workflows, without disrupting their established processes.
Integrated Workflows: AR solutions will be tightly integrated with existing construction workflows, providing workers with the information and guidance they need at the right time and place.
Cloud-based Access: AR solutions will become increasingly cloud-based, allowing construction professionals to access and use AR applications from any device, regardless of their location.
Subscription-based Models: AR solutions will increasingly adopt subscription-based models, making them more accessible and affordable for construction firms of all sizes.
By focusing on process-enabled SaaS, technology providers ensure not only smoother adoption but also sustained usage, driving value across the entire construction ecosystem.
4. Bottom-up Adoption of Innovation-Light AR Solutions
With some construction companies reducing or eliminating dedicated innovation teams, bottom-up adoption of AR will become more prevalent in 2024. This will involve empowering frontline workers, such as superintendents and field engineers, to adopt and champion AR tools. By providing self-serve solutions, clear user-guides, and ongoing support, companies can enable these individuals to identify and implement AR applications that directly address their day-to-day challenges. The rise of champions and power users within these organizations will drive adoption and foster a culture of innovation within the construction industry.
Self-Serve Solutions: AR solutions will focus on self-serve deployment, allowing construction workers to install, configure, and use AR applications without extensive training or IT support.
Community of Champions: AR adoption will be driven by a community of champions and power users within construction firms, who will promote the use of AR and share their experiences with other project stakeholders.
Innovation-Lite Approach: As construction firms reduce their innovation teams, AR solutions will focus on "innovation-lite" approaches that can be easily adopted and scaled by existing teams.
5. Increased Adoption Across Mid-Size Contractors
In 2024, we'll witness a significant increase in AR adoption among mid-size contractors, who represent a substantial portion of the construction industry. This growth will be driven by the availability of user-friendly, affordable AR solutions and the recognition of the value AR can bring to project efficiency and productivity. As AR technology matures and its benefits become more tangible, mid-size contractors will be increasingly willing to invest in AR solutions to improve efficiency, safety, productivity, and to gain a competitive edge. Cloud-based SaaS models and user-friendly interfaces will make it easier for these companies to adopt AR solutions without the need for extensive infrastructure or specialized expertise.
Cost-Effective Solutions: AR solutions will become more affordable and accessible to mid-size contractors, making them viable options for a wider range of projects.
Focus on ROI: Mid-size contractors will prioritize AR solutions that offer a clear and tangible ROI, demonstrating the value that AR can bring to their businesses.
Partnerships: Mid-size contractors will partner with AR vendors to customize and integrate AR solutions into their specific workflows and processes.
6. Deeper Alignment with Industry-Specific Needs
To stay ahead, AR providers must align their product roadmap with the evolving needs and challenges of the construction industry. In 2024, we will see more AR developers focusing on developing solutions that directly address the pain points and unmet needs of the construction industry by first understanding the specific challenges faced by different project phases.
Focus on Pain Points: AR solutions will be developed to address the specific pain points and challenges faced by construction craftspeople, such as site navigation, prefabrication assembly, and issue detection.
Collaboration Enhancement: AR solutions will facilitate collaboration between different teams on the jobsite, improving communication, coordination, and decision-making.
Sustainability Initiatives: AR solutions will support sustainability initiatives in the construction industry, such as waste reduction, energy efficiency, and resource optimization.
7. Increased Focus on Data Security and Privacy
As AR technology becomes increasingly integrated into the construction industry, data security and privacy will become a critical concern for both construction companies and AR developers. Sensitive project information and proprietary company data will all be handled through AR applications, making it essential to protect this data from unauthorized access, misuse, and breaches. To address these concerns, AR product developers will start incorporating robust data security and privacy measures into their applications at an earlier stage. This includes encryption algorithms to protect data in transit and at rest, access control, data minimization and anonymization, conducting regular security audits, and providing clear and transparent data protection policies to inform users about data collection practices, usage, and security measures.
2024 Tech Forecast: View Synthesis, AR Hardware, and the Role of LLMs in Shaping Construction Tech
“The next generation of visual communication and collaboration tools will be powered by view synthesis, AR hardware, and large language models. These technologies will enable us to see and understand jobsite conditions in new ways, and to collaborate more effectively between project stakeholders. ”
1. View Synthesis - Gaussian Splatting Applications Gain Momentum
View synthesis, the ability to visualize an environment from a perspective that wasn’t photographed, could be incredibly valuable for documenting and communicating about jobsite conditions. This technology could allow construction teams to generate 3D models of jobsites from existing photos or videos, which could be then used to:
Create more accurate and comprehensive jobsite documentation: This could help reduce errors and improve communication between contractors and stakeholders.
Identify potential safety hazards: By viewing jobsites from different perspectives, construction teams could more easily spot potential hazards that might not be visible from the ground.
Plan and coordinate construction activities: 3D models of jobsites could be used to plan and coordinate construction activities more effectively.
Troubleshoot problems: By visualizing jobsites in 3D, construction teams could more easily identify and troubleshoot problems.
The original NeRF paper was written in 2020 and kicked off renewed excitement in view synthesis by producing outstanding results even for challenging environments.
For the past 3 years researchers have been working on improving the quality, generation time and rendering time of NeRFs, but this year may have marked the end of NeRF’s dominance. In its place Gaussian Splatting offers comparable quality, but with much better rendering performance. It has already made its way into a few products, but expect to see deployments speed up next year. Gaussian Splats for Google Street View?
-
NeRFs are a type of deep learning model that can be used to reconstruct and render 3D scenes from a collection of input images. They are able to capture the complex geometry and appearance of real-world environments, and they can produce photorealistic results. However, NeRFs can be computationally expensive to train and render, which limits their practical applications.
-
Gaussian Splatting is a rasterization-based technique for rendering 3D scenes. It is based on the idea of representing the scene as a collection of small particles, or "splats," that are scattered throughout the 3D space. Each splat is associated with a Gaussian distribution, which represents the probability of finding a surface point within the splat.
Gaussian Splatting is faster, more efficient, and more GPU-friendly than NeRFs. It has the potential to revolutionize the field of computer graphics and to enable a wide range of new applications:
Virtual and augmented reality: Gaussian Splatting can be used to render photorealistic 3D environments for virtual and augmented reality applications.
Robotics: Gaussian Splatting can be used to create 3D maps of the environment, which can be used by robots for navigation and obstacle avoidance.
Computer-aided design (CAD) and engineering: Gaussian Splatting can be used to generate 3D models of physical objects, which can be used for design and analysis.
2. Apple's Vision Pro and Spatial Videos Enhance Collaboration
This year the long wait for Apple’s mixed reality headset ended and rumors are that the device will ship early next year. We’re eager to see how a high quality mixed reality headset, with intuitive inputs, might drive adoption.
In the construction industry, the ability to capture Spatial Videos on the iPhone 15, and view them in 3D on the Vision Pro will offer a new way to understand and collaborate around jobsite conditions - particularly for project stakeholders who are typically offsite.
The combination of spatial video capture and mixed reality viewing will transform the way construction projects are planned, executed, and managed.
3. LLMs Transform how AEC Software Tools are Developed
This past year, LLMs completely changed how we interact with computers. Next year multi-modal models - models that understand images, audio and video as well as text - will continue that trend. In construction that means that communications, photographs and videos collected on a jobsites will be inspectable like never before:
Analyze and interpret jobsite data: LLMs could analyze data from AR applications, such as photos, videos, and audio recordings, to identify patterns and trends.
Generate reports and documents: LLMs could generate reports and documents based on jobsite data.
Translate jobsite information into multiple languages: LLMs could translate jobsite information into multiple languages, which could be helpful for international construction projects.
Provide real-time feedback and suggestions: LLMs could provide real-time feedback and suggestions to construction workers based on their work.
LLMs will continue to transform how AEC software tools are developed. At Sitelink, our development process includes test driven development and peer programming.
The combination of view synthesis, AR hardware, and LLMs has the potential to transform the way construction teams work. By providing construction workers with access to real-time information and the ability to visualize jobsites from different perspectives, these technologies will improve safety, efficiency, and productivity.
Closing Thoughts:
Our predictions paint a compelling picture of the transformative impact of AR on the construction industry in 2024. As AR technology matures, business strategies evolve, and product development caters to the specific needs of the industry, AR is poised to become an indispensable tool for driving efficiency, innovation, and quality in the construction sector.
In our next article, we’ll explore the strategic and practical considerations of adopting AR in construction for contractors, and what construction companies can do to maximize their investment in this technology. Stay tuned and subscribe to our newsletter to get our next blog post straight to your inbox!