Photogrammetric measurement and 3D model creation

MOSBURG IN WIESBACH – PHOTOGRAMMETRIC MEASUREMENT AND 3D MODEL CREATION

What it's about?

As part of a seminar paper at the RheinMain University of Applied Sciences, Frank Schirmer and Mobahil Ahmad Qamar investigated the extent to which photogrammetry can be used as a transformative tool in the preservation of existing structures.

To this end, a survey of the Mosburg in Wiesbaden was created, evaluated and processed using PointCab Origins, among other tools, to create a 3D model. We present their workflow and results here.

The property – the Mosburg in Wiesbaden

The Mosburg is a so-called artificial ruin and is located in the Biebricher Schlosspark in Wiesbaden. It can look back on a long history and was built from 1805 to 1806 on the foundations of a moated castle, which probably dates back to the 14th or 15th century. Among other things, it served as a residence, artist’s studio and local history museum.

After the Second World War, the artificial castle unfortunately became an actual ruin. The castle is currently not open to the public. Frank and Mobahil were also unable to enter the castle. However, restoration work has partially begun and is being coordinated by the Hessian Real Estate Management.

Preparation, hardware and measurement

In order to survey the Mosburg as quickly and accurately as possible, Frank and Mobahil began by making relatively simple sketches to determine the optimum viewpoints and heights for the images. The sketches were then expanded in an iterative process until a detailed survey plan was available.

This was followed by the selection of surveying equipment. Among other things, the team decided to use simple smartphone cameras to speed up the survey. In order to achieve the best possible result, care was also taken to carry out the survey on a cloudless day with low humidity. The following hardware was used:

  • DJI Mavic Mini UAV
    Thanks to the DJI drone, the Mosburg could be photographed from different heights and perspectives. Even areas that were difficult to access, as well as the interior, could be captured better.

  • Sony A6000:
    This camera was mainly used to capture the details of the rear supporting wall, which is particularly badly damaged. This enabled cracks, protrusions and fractures to be precisely documented.

  • Sony Xperia XQ-BT-52 & Xiaomi Redmi 12
    With the two smartphone cameras, the remaining, better-preserved parts of the Mosburg could be captured quickly and efficiently.

The entire survey of the Mosburg took about 4 hours and was completed in 3 phases. In the first phase, the drone and the Sony camera were used to capture the rear supporting wall. In the second phase, the rest of the castle was photographed with the smartphones. Finally, the drone was sent back inside to take the remaining pictures. A total of over 600 images were taken.

To get the best possible results from a photogrammetric survey, you should pay particular attention to the following settings in advance:
Shutter speed
ISO (light sensitivity)
– Sufficient lighting or natural light

Data processing –
creating meshes and point clouds in MEtAshape

The images, which were taken with 4 different devices and 6 different cameras, have to be merged in the next step and converted into a mesh or point cloud. To achieve this, Frank and Mobahil decided to use Agisoft’s Metashape software. The process was completed in 6 steps:

  1. Data import
    When importing, the team creates a separate calibration group for each physical camera, as the smartphone cameras use different resolutions and focal lengths.
  2. Alignment (registration) of the photos
    Tie points, which represent overlaps in the individual photos, are used to “unite” all the photos into an overall image. The team identifies 4000 tie points using the highest possible resolution. The alignment is then further improved in an interactive process until an initial point cloud of tie points is created at the end.
blank
  1. Mesh creation
    A mesh is now created in a further iterative process. Here too, the highest possible resolution is used first and scaled down step by step.
  2. Create texture
    Metashape creates the texture based on the meshes. The higher the selected resolution, the more accurate the geometry.
  3. Create point cloud
    Based on the results created in the previous steps and various other parameters, Metashape creates a complete point cloud in this final step.
  4. Export
    When exporting, it is important to choose the right format for further processing. Not all formats contain all the important information and not all software can read all formats. In this case, the team decided to export the point cloud in .obj/.pts format.

In a personal conversation, Frank tells us that he initially tried out various formats when exporting until he found a format that he could continue working with cleanly in Origins. This is a difficulty that we often hear about. There are simply so many formats that fulfill different purposes, and users are often unaware of the advantages and disadvantages.

If possible, we recommend exporting the point cloud as a .las file. The .las format has sufficient information content for most applications and is highly interchangeable. This means that the information can usually be transferred cleanly when exporting and switching from one software to another.

If you would like to find out more about point cloud formats, you are welcome to watch our webinar on the subject.

Data processing and evaluation –
Fast results with PointCab Origins

Once a point cloud has been generated from the photogrammetric images, results can now be produced that can be used as a planning basis for future restoration work.

To do so, the team imports the point cloud into PointCab Origins. The 3 standard views are created automatically, providing a quick overview and orientation.

Using the layout & section tool, they can create the layouts and sections they need for further processing with just a few clicks. Important information such as distances, area calculations or level deviations can already be extracted from these in Origins. This means that the floor plans already form a solid planning basis for a renovation.

The layouts are automatically exported by Origins as .dwg files and can thus be imported directly into CAD software, in this case BricsCAD, for 3D modeling.

The team also creates the vector lines from the floor plans using the semi-automatic vectorizer in Origins. These can be imported into BricsCAD in the same way as the floor plans, making it much easier to create a 3D model.

In addition to the quick creation of results from the point cloud, PointCab Origins offers another major advantage: simple visual inspection of the data quality.

The team simply created and compared a floor plan of the smartphone point cloud with that of the drone point cloud and was thus able to quickly recognize whether the most important structures could also be captured cleanly via the smartphone.

Although the team used PointCab Origins for the first time for this project and did not receive any training, the evaluation and creation of results with Origins only took about 2 hours.

In a personal conversation, Frank tells us that he was able to quickly find his way around the software, especially thanks to the intuitive display with the standard views.

Conclusion

The project work has shown that even simple smartphones have a place in the photogrammetric recording of buildings. Of course, high-resolution cameras also had to be used in this case in order to capture important details such as the rear supporting wall if it was to be accurately modeled afterwards. In addition, the interior of the castle could only be captured by drone flight, as the site was simply not accessible. Nevertheless, the parts of the building that did not require special attention could be captured with satisfactory data quality via smartphone. The comparison between the floor plans created in Origins shows this very well.

Accordingly, the project work shows that for certain use cases, such as the creation of a simple site plan, the use of smartphones is not only possible, but also makes a lot of sense due to the time saved during recording.

Want to keep up with the latest pointCab news?

Then follow us on Social Media or subcribe to our newsletter!

Origins 4.1 – The latest functions

Origins4.1_update

ORIGINS 4.1 – THE LATEST FUNCTIONS

Origins 4.1 – The latest functions

Discover all-new functions in the latest 4.1 Origins Release! 

Due to our constant development and the inspiring feedback from our users, PointCab Origins 4.1 comes with many new functionalities and enhancements. Check out the new functions below.

NEW FUNCTIONS

Polygon editor for area-based tools

What it’s for?
View and edit the coordinates of your polygon points in the job editor!

How it’s done:
When creating a surface the coordinates of the polygon points appear in the job editor and can be adjusted there. This affects all functions of the area tool and all functions that are related to areas: Merger, point cloud export, volume, and mesh.

Polygon editor for area-based tools
Click to enlarge the image

Export origin point of sections in .dwg (customer request) 💡

Export origin point of sections in .dwg
Click to enlarge the image

What it’s for?
When exporting a section, the center of the section is exported as an additional CAD element called “origin point”. This way the reference point is preserved and you are quickly able to restore it, in case you need it. (A crosshair will be displayed in AutoCAD)

How it’s done:
Go to Layout & Section Tool > Create Section > Settings > Layout/Section/Space Warp > CAD > Activate “Add Centerpoint to dwg/dxf” under “Option”.

Customized 3D Point export to .dwg

What it’s for?
Now you can choose your preferred data format for exporting points to .dwg!

How it’s done:
In the Job Editor under “CAD” you can now find the “Text visibility in Export”. Here you can define where PointID, Point Number, and X, Y, Z information shall be exported to. When the 3D points are exported, the corresponding folder opens directly. Therefore right-clicking “show in folder” is no longer necessary. In the .dwg file, the selected information will be displayed next to the point. The same functionality is also available under the “File” tab in the Job Editor.

Customized 3D Point export to .dwg
Click to enlarge the image

“Save as” Functionality to .pcp (PointCab Project)

“Save as” Functionality to .pcp (PointCab Project)
Click to enlarge the image

What it’s for?
Finally, a new way to duplicate your project! Previously, you could only archive a project and then had to pack and unpack it again… These times are finally over!

How it’s done:
Just go to File > Save As: Origins saves a copy of your current project state in the background. Isn’t that great?

Export Orthophotos position (customer request) 💡

What it’s for?
Export the positions of several layouts with ease!

How it’s done:
Select all your layouts with the selection arrow or Ctrl + A, then copy them with Ctrl + C and simply paste them into your text editor. You will easily get all layouts with name and order Lefthandle | Righthandle | Center, as well as all 3D points.

Export Orthophotos position
Click to enlarge the image

Toggle on/off names of Panoramas

Toggle on/off names of Panoramas
Click to enlarge the image

What it’s for?
Finally a clearer display of panoramas – due to a third option!

How it’s done:
The names and positions of the panoramas can easily be hidden by pressing the “P” key. We love the new feature, try it out yourself right now!

Sections with enhanced reflectivity

What it’s for?
The new option enhances the reflectivity in your panoramas and in sections!

How it’s done:
In the panoramas, there is a new sheet that enhances reflectivity. If the “Enhanced reflectivity” slider is checked, the reflectivity will be displayed with increased contrast. To use it for sections just create a new one and set the reflectivity to 100% in the Job Editor under “Processing” and activate the slider for “Enhanced Reflectivity”. Now calculate your job and the sheet with “Enhanced Reflectivity” is available. Lookin’ good, isn’t it?

Click to enlarge the picture

Export all panoramas in different file formats

Export all panoramas in different file formats
Click to enlarge the image

What it’s for?
This new option helps you to convert your panoramas into your desired image file format. You can choose between png, jpg, tif, bmp, webp

How it’s done:
Before exporting the desired panoramas, choose your preferred format for exporting in the settings under General > Export > “Panorama format”.
Once that’s done, go to the Advanced Importer > “Import” tab: do a right click: select All scans > “Save all Panoramas” and export all panoramas in your preferred file formats!

⚠️Cloud-to-Cloud (C2C) Test / Beta⚠️

What’s it about?
We intend to offer a full-fledged cloud-to-cloud (C2C) registration in Origins. For now, this is our first attempt to provide C2C in Origins 4.1.

Here’s what to keep in mind:
We explicitly don’t recommend using this C2C in its current form to register actual projects!

But we would like to encourage you to test our C2C beta and we’re excited about your experiences and feedback about it.

GENERAL IMPROVEMENTS

Plane position names inside the plane area

What it’s for?
Improved visibility: In the Registration Editor, the labels of the recognized layers are now displayed within the respective layer.

blank
Click to enlarge the image

Optimized Nebula Export

blank
Click to enlarge the image

What it’s for?
Just a much faster Nebula Export to get your point cloud projects into the cloud!
Who doesn’t want that?

Shortcut Manager improvements

What it’s for?
We have added a Clear-Button in the Shortcut Manager. Maybe just a little improvement for your user experience but we think you deserve it.

How it’s done:
Settings > Shortcuts: New “Clear Button” to delete user-defined shortcuts.
The “Record Button” can then be used to record as usual.

Shortcut Manager improvements
Click to enlarge the image

Project main files backup

Project main files backup
Click to enlarge the image

What it’s for?
When changes are made to the project, Origins now creates automatic backups in the background!

How it’s done:
You don’t have to worry about it, origins will create the backups for you automatically!

Customizable zoom speed

What it’s for?
Adjust the zoom speed in the 3D viewer the way you prefer it.

How it’s done:
Open the 3D Viewer and click on the Gear Icon in the upper left corner. Then you’ll be able to adjust your zoom speed in the “3D View Parameter” in the Job Editor. This setting can also be found under Settings > GUI > 3D Control > Zoom Speed

blank
Click to enlarge the image

Advanced project information

Advanced project information
Click to enlarge the image

What it’s for?
This handy feature keeps you on track with your project information!

How it’s done:
You might have noticed it already when opening Origins: in the Last Projects overview, more project details are now displayed!
Curious about more information? Just open your project and go to “File” > “Project Info”. Now you can view your “Project Information” above the Job Editor. Have a look at e.g. the creation date, date of last changes, total processing time, and much more!

Layout center line visible in all standard views

What it’s for?
The red dotted line of a section, which marks the center of a section, will now also be displayed in the left-view orthophotos window.

How it’s done:
No need to change anything. Origins does that automatically now.

blank
Click to enlarge the image

Save into FARO project file (customer request) 💡

save-into-FARO-project-file
Click to enlarge the image

What it’s for:

We have added the new function “Save into FARO project file” by user request. 

How it’s done:

With this function, registration values (scan positions and rotations) can be directly written into an existing FARO LSPROJ file.

EXTENDED DATA FORMATS – IMPORT / EXPORT

FARO SDK/API update – Support of FARO Premium Scans

Fantastic news for all FARO Focus Premium users!
As of now, the scans can be imported from the Premium Scanner.

faro-3d-scanning

Import e57 files with panorama (for Mobile Mapping scan data)

Import e57 files with panorama (for Mobile Mapping scan data)
Click to enlarge the image

What it’s for?

Now you can write panoramas in .e57/.las format from datasets of NaVvis, GeoSLAM, and Stonex.

How it’s done with .e57 files:

  1. Create a new project and open your scan data. Select the .e57-file and save it to start importing your e57-file as a point cloud.
  2. Proceed to import the panoramas under “Tools” and click on “Import elements”
  3. Navigate to the “Import E57” tab and select the same file. There you can see how many panoramas are included. Click on import.
  4. Last step: simply calculate the panoramas in the job list.

How it’s done with Stonex files:

  1. Create a new project and open your Stonex data. Select the .las-file and save it to start importing your .las-file as a point cloud.
  2. After your Stonex point cloud has been successfully imported into Origins, go to “File” > “Import Elements”.
  3. Navigate to the “Import Stonex” tab and navigate to the location of your .txt file and press “Import”. Make sure that the option “Copy images to project” is activated.
  4. The panorama views appear as circles in your project and as jobs in the job list that need to be calculated. After Origins has processed the images, you can open them as usual by selecting the Panorama tool and clicking on the scan point in the standard views.

Please note:
The Stonex panoramas are just hemisphere panoramas (180 degrees) and therefore the point cloud cannot be back-projected onto them, which means that no measurements can be made. They are purely suitable for visualization purposes.

BUG FIXES