Applying Photogrammetry to Aerial Surveillance and Monitoring
3D Modelling
Photo to Digital Twin
INTRODUCTION
One of our most cherished collaborations is with a prominent Japanese engineering company, who's role in reshaping Japan's infrastructure and technology-driven society cannot be understated. This industry leader has pioneered innovation across energy, transportation, and public infrastructure with a keen focus on bridge building and construction technology, in an effort to "Build a Better Tomorrow." In one such innovative venture, this engineering powerhouse partnered with Codemonk to automate and streamline 3D modeling workflows capable of rendering construction spaces using aerial photography, LiDAR, and 3D modeling. And thus began the collaboration that redefined the status quo of construction technology.
Industry
SaaS
Time Frame
Services we offered
Photogrammetry, Computer Vision
Challenges at Hand
Prior to the engagement, the Japanese firm faced challenges in accurately visualizing construction activities across sites, obtaining precise measurements of construction elements, and achieving cost and construction efficiency. For instance, 3D modeling of construction was heavily reliant on dated methodologies that necessitated human data input, which were both time-consuming and resource-intensive.
Capturing aerial footage needed for modeling workflows alone involved the piloted operation of drones over the area of observation and the manual 3D reconstruction of topography. Adding to the shortcomings, planning and monitoring activities were delayed due to laborious surveys and scope evaluations. Evidently, these activities were resource-intensive. And, precision in measurement/site survey operations was compromised when compared with the actuals within the real world.
Engaging with the engineering company, Codemonk's assessment of the problem presented the following takeaways:
Aerial LiDAR photopgraphy
LiDAR technology offered by the Apple iPhone Pro models resulted in better quality of data capture, while integrating with Augmented Reality for accurate data capture.
LiDAR Scans to Digital Twins
3D Models could be extrapolated from data sources such as aerial photographs, videos, and LiDAR scans, thereby solving for complexities such as camera angles and lighting conditions, along with varying data quality and digital anomalies such as motion blur and noise.
Modelling and Post Production
Incorporate modeling tools to accurately measure artifacts within the construction space, with the ability to scale and export them as per convenience.
Proposed Resolution
Codemonk enabled the Japanese engineering firm to capture photos, videos, and LiDAR scans using equipment available to them. These data sources would then be uploaded onto a cloud platform, effectively building 3D models of the captured footage. The rendered 3D models would be available on the cloud portal and iOS applications for further adoption across the construction pipeline.
Development and Implementation
Codemonk built the underlying iOS application to capture photos and videos for 3D conversion, all the while utilizing iPhone 15 Pro's LiDAR technology for depth analysis. This methodology allowed Codemonk to facilitate on-site object scanning to create "Scale-Aware" models. Secondly, the engineering team also developed a web-hosted portal within which images, videos, and scans could be uploaded for 3D conversion. Together, both the integrated pipelines converted images, videos, and scans into suitable formats such as point clouds, meshes, and colored 3D models. Codemonk also deployed precision measurement tools within the web portal for simpler but accurate analysis.
While formulating the packaged solution that included the above mission-critical functionalities, Codemonk was tasked with ensuring that the solution being developed is future-proof and scalable for future iterations and adoption of the product.
Key Outcomes Achieved
Implementing the proposed solution, Codemonk demonstrated tangible value for the Japanese engineering giant across four unique business lines.
Construction Monitoring:
Codemonk empowered the firm's ground team to effortlessly capture images, videos, and LiDAR scans using smartphones for 3D modeling, in turn improving the real-time insights generated during ongoing construction activities.
Automated 3D models:
Codemonk's solution showcased the capability to produce ultra-fine, highly detailed 3D renders of the construction site, which was a completely manual process prior to the collaboration. Such reliable output improved the company's decision-making ability, removing any and all redundancies incurred previously.
Accurate Measurement of Construction Artifacts:
In tune with one of the firm's primary requirements, Codemonk developed measurement tools that could calculate the physical dimensions of objects scanned using the iOS application.
Adoption and Scalability:
One of the key advantages derived from the implementation of this solution is the ability to manage and organize a variety of data sources required for 3D modeling. The combination of smartphone photography, videography, and LiDAR technology provided a simplistic, yet all-encompassing tool for data viewing and analysis. More importantly, the engineering company could easily implement the solution organization-wide, improving scalability.
Interestingly enough, Codemonk was among the first to leverage iOS' AR object capture API for data aggregation and released the same along with iOS 17's public release.
Milestones for the Future
Reaping the rewards of this successful collaboration, the Japanese engineering firm and Codemonk are working on new iterations of the product with noteworthy enhancements such as measuring distances using latitudes and longitudes. The duo are also planning a more widespread adoption of the solution set across similar construction activities. Leaders from the company's technological arm recently visited Codemonk HQ in Bangalore to discuss similar prospects of collaboration and also to strengthen organizational ties.
Tracing these invaluable technological strides, it is safe to say that both the Japanese engineering leader and Codemonk are embarking on transformative initiatives that will strengthen construction activities around the world.
3D Modelling
Photo to Digital Twin