Region Growing Segmentation
(→Seed points) |
|||
| (9 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
=Region Growing Segmentation with Saga's Seeded Region Growing Tool= | =Region Growing Segmentation with Saga's Seeded Region Growing Tool= | ||
| − | The following tutorial by Sebastian Kasanmascheff explains how to delineate tree crowns, using SAGA's Seeded Region Growing Tool. The product, a polygon shapefile, can then be used in an object based classification, f.ex. in order to classify different tree species. | + | The following tutorial by Sebastian Kasanmascheff explains how to delineate tree crowns, using SAGA's Seeded Region Growing Tool. The product, a polygon shapefile, can then be used in an object-based classification, f.ex. in order to classify different tree species. |
| − | + | ||
| − | + | ||
| − | + | ||
=Material you need to complete the tutorial= | =Material you need to complete the tutorial= | ||
| Line 38: | Line 35: | ||
| − | In this picture you see, that the points align well with the tree tops. However, there are many points that represent small trees (in the lower left corner) which you might not be so interested in. In order to correct that, we are going to filter the points by their height in the seed shapefile and save the shapefile with the selected seeds only as a new shapefile. | + | In this picture you see, that the points align well with the tree tops. However, there are many points that represent small trees (in the lower left corner) which you might not be so interested in. In order to correct that, we are going to filter the points by their height in the seed shapefile and save the shapefile with the selected seeds only, as a new shapefile. |
| − | If the seed points do not fit the image well, it might be due to the fact that you are using an orthophoto and not a true orthophoto. If you are working only with a smaller dataset you can help it by using the {{button|text=Georeferencer}} in the {{button|text=Raster menu}} by | + | If the seed points do not fit the image well, it might be due to the fact that you are using an orthophoto and not a true-orthophoto. If you are working only with a smaller dataset you can help it by using the {{button|text=Georeferencer}} in the {{button|text=Raster menu}} by rubbersheeting your orthophoto to make it fit. You'll find the instructions for doing so [[Georeferencing_of_UAV photos|here]]. |
| Line 46: | Line 43: | ||
[[File:Filtered_seed_points.PNG]] | [[File:Filtered_seed_points.PNG]] | ||
| − | |||
| − | |||
| − | |||
| − | |||
=Seed point rasterization= | =Seed point rasterization= | ||
| − | In order to use the seed points in the region growing algorithm in SAGA, we have to convert the vector file to a raster file using the {{button|text=Rasterize}} module from the GDAL Conversions in QGIS. It is critical that we create a raster file that only contains the seed points and no-data. So every pixel outside the seed points has to be no-data. It is also critical that our rasterized vector image has the '''exact same''' CRS (Coordinate reference system), | + | In order to use the seed points in the region growing algorithm in SAGA, we have to convert the vector file to a raster file using the {{button|text=Rasterize}} module from the GDAL Conversions in QGIS. It is critical that we create a raster file that only contains the seed points and no-data. So every pixel outside the seed points has to be no-data. It is also critical that our rasterized vector image has the '''exact same''' CRS (Coordinate reference system), extent and pixel size as the single band images. |
* In the {{button|text=Processing Toolbox}}, type 'rasterize' and select the {{button|text=Rasterize}} tool ind the SAGA geoalgorithms submenu | * In the {{button|text=Processing Toolbox}}, type 'rasterize' and select the {{button|text=Rasterize}} tool ind the SAGA geoalgorithms submenu | ||
* Select the seed point shapefile as input | * Select the seed point shapefile as input | ||
* Select {{button|text=ID}} as {{button|text=Attribute}} and the other parameters according to the screenshot below | * Select {{button|text=ID}} as {{button|text=Attribute}} and the other parameters according to the screenshot below | ||
| − | * Select the | + | * Select the extent of one of the band splits as extent by clicking {{button|text=select canvas/ layers extent}} in the {{button|text=Output extent}} line |
* Copy the '''exact''' cellsize from either the metadata of one of your split images and set output raster size to {{button|text= Output resolution in map units per pixel}} | * Copy the '''exact''' cellsize from either the metadata of one of your split images and set output raster size to {{button|text= Output resolution in map units per pixel}} | ||
* Save to a local file | * Save to a local file | ||
| Line 81: | Line 74: | ||
| − | Now verify that the newly created seed point raster aligns 100% with one of the band split rasters by checking the metadata or {{button|text=Save raster layer as..}} mask and by zooming into the seed pixels. Also check with the Info button[[File:Info.PNG]], if any pixel which is not a seed point, is no-data. | + | Now verify that the newly created seed point raster aligns 100% with one of the band split rasters by checking the metadata or the {{button|text=Save raster layer as..}} mask and by zooming into the seed pixels. Also check with the Info button[[File:Info.PNG]], if any pixel which is not a seed point, is no-data. |
| Line 94: | Line 87: | ||
=Superimpose Vector= | =Superimpose Vector= | ||
| − | It happens regularly that, although following the previous steps meticulously, that the | + | It happens regularly that, although following the previous steps meticulously, that the extent and pixel size of the rasterized vector file does not match the splitted band images 100 %. In this case we have to use the OTB {{button|text=Superimpose Vector}} tool that you can find in the {{button|text=Processing Toolbox}}. |
* Open the {{button|text=Superimpose Vector}} tool in the {{button|text=Processing Toolbox}}. | * Open the {{button|text=Superimpose Vector}} tool in the {{button|text=Processing Toolbox}}. | ||
| Line 106: | Line 99: | ||
Next, go to the {{button|text=Properties}} of the newly created layer in the {{button|text= Layers Panel}} | Next, go to the {{button|text=Properties}} of the newly created layer in the {{button|text= Layers Panel}} | ||
| − | * Check the | + | * Check the extent of the layer in the {{button|text=Metadata}} tab. |
* Go to {{button|text=Styles}}, load max/min values and set the {{button|text=Color Gradient}} to {{button|text=White to black}} | * Go to {{button|text=Styles}}, load max/min values and set the {{button|text=Color Gradient}} to {{button|text=White to black}} | ||
| − | The result should look very much the same as the first rasterized vector, but the | + | The result should look very much the same as the first rasterized vector, but the extent and pixel size are now 100 % the same as in |
the split band images. | the split band images. | ||
| − | |||
=Region Growing in SAGA= | =Region Growing in SAGA= | ||
| Line 135: | Line 127: | ||
| − | * In the line below {{button|text=Grids}} you see the | + | * In the line below {{button|text=Grids}} you see the extent of your raster files. If you happen to see two different of those lines, your raster images do not match 100 %. You can fix that again with the {{button|text=Superimpose sensor}} Tool in the OTB library in {{button|text=QGIS}} |
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
=Seeded Region Growing Algorithm= | =Seeded Region Growing Algorithm= | ||
| Line 200: | Line 187: | ||
You can do that by trial and error, however, it helps to understand the math that lies behind these algorithms. | You can do that by trial and error, however, it helps to understand the math that lies behind these algorithms. | ||
| − | What the algorithm in the Seeded Region Growing module does, is that it starts with the seed point, goes to the adjacent pixels and | + | What the algorithm in the Seeded Region Growing module does, is that it starts with the seed point, goes to the adjacent pixels and joins them together if they are similar enough. 'Enough' in this case is determined by the similarity-condition which is expressed in the following formula: |
[[File:Formula_(1).PNG]] | [[File:Formula_(1).PNG]] | ||
| Line 209: | Line 196: | ||
'''α''' is the similarity criterion. It not need to be normalized and is set arbitrarily at 0.15. | '''α''' is the similarity criterion. It not need to be normalized and is set arbitrarily at 0.15. | ||
| − | '''σ<sub>1</sub>''' and '''σ<sub>2</sub>''' control how far the values (feature space / position space) are allowed to be. For a maximum distance of 40 % of the peak intensity and three color bands, the formula for '''σ<sub>1</sub>''' is: | + | '''σ<sub>1</sub>''' and '''σ<sub>2</sub>''' control how far away the values (feature space / position space) are allowed to be between each other. For a maximum distance of 40 % of the peak intensity and three color bands, the formula for '''σ<sub>1</sub>''' is: |
[[File:Formula_(2).PNG]] | [[File:Formula_(2).PNG]] | ||
| Line 228: | Line 215: | ||
=References= | =References= | ||
<references/> | <references/> | ||
| + | |||
| + | [[Category:QGIS Tutorial]] | ||
Latest revision as of 13:21, 21 February 2019
[edit] Region Growing Segmentation with Saga's Seeded Region Growing Tool
The following tutorial by Sebastian Kasanmascheff explains how to delineate tree crowns, using SAGA's Seeded Region Growing Tool. The product, a polygon shapefile, can then be used in an object-based classification, f.ex. in order to classify different tree species.
[edit] Material you need to complete the tutorial
Data
A multispectral image of the forest canopy
A canopy height model CHM
Software
QGIS 2.18.11
SAGA 2.3.2
[edit] Split multiband image into several raster images
SAGA's Region Growing Algorithm works only with single band images. Therefor, we have to split our multiband image into its individual bands following these instructions.
[edit] Seed points
The first step here is to extract the position of the tree tops, which are going to be the starting point for the region growing algorithm. You find a description of how to derive the seed points from a CHM here . Now have a look at how the seeds align with your multiband image
In this picture you see, that the points align well with the tree tops. However, there are many points that represent small trees (in the lower left corner) which you might not be so interested in. In order to correct that, we are going to filter the points by their height in the seed shapefile and save the shapefile with the selected seeds only, as a new shapefile.
If the seed points do not fit the image well, it might be due to the fact that you are using an orthophoto and not a true-orthophoto. If you are working only with a smaller dataset you can help it by using the Georeferencer in the Raster menu by rubbersheeting your orthophoto to make it fit. You'll find the instructions for doing so here.
This looks much better:
[edit] Seed point rasterization
In order to use the seed points in the region growing algorithm in SAGA, we have to convert the vector file to a raster file using the Rasterize module from the GDAL Conversions in QGIS. It is critical that we create a raster file that only contains the seed points and no-data. So every pixel outside the seed points has to be no-data. It is also critical that our rasterized vector image has the exact same CRS (Coordinate reference system), extent and pixel size as the single band images.
- In the Processing Toolbox, type 'rasterize' and select the Rasterize tool ind the SAGA geoalgorithms submenu
- Select the seed point shapefile as input
- Select ID as Attribute and the other parameters according to the screenshot below
- Select the extent of one of the band splits as extent by clicking select canvas/ layers extent in the Output extent line
- Copy the exact cellsize from either the metadata of one of your split images and set output raster size to Output resolution in map units per pixel
- Save to a local file
The result should look like this:
Now verify that the newly created seed point raster aligns 100% with one of the band split rasters by checking the metadata or the Save raster layer as.. mask and by zooming into the seed pixels. Also check with the Info button
, if any pixel which is not a seed point, is no-data.
Your raster should align like this:
[edit] Superimpose Vector
It happens regularly that, although following the previous steps meticulously, that the extent and pixel size of the rasterized vector file does not match the splitted band images 100 %. In this case we have to use the OTB Superimpose Vector tool that you can find in the Processing Toolbox.
- Open the Superimpose Vector tool in the Processing Toolbox.
- Select one of the split band images as Reference input
- Select the rasterized seed point shapefile as The image to reproject
- Fill in the other parameters as shown here:
Next, go to the Properties of the newly created layer in the Layers Panel
- Check the extent of the layer in the Metadata tab.
- Go to Styles, load max/min values and set the Color Gradient to White to black
The result should look very much the same as the first rasterized vector, but the extent and pixel size are now 100 % the same as in
the split band images.
[edit] Region Growing in SAGA
Now we finally made it to the fun part of the whole exercise, which is creating the segments around the tops of the trees i.e. the seed points. Therefor we open SAGA GIS.
- When prompted, select an empty Startup Project
- Click the
button
- Change
to All files
- Open all split band images and the superimposed seed raster one after another
- The layer panel on the left should now look like this:
- In the line below Grids you see the extent of your raster files. If you happen to see two different of those lines, your raster images do not match 100 %. You can fix that again with the Superimpose sensor Tool in the OTB library in QGIS
[edit] Seeded Region Growing Algorithm
- Go to the Geoprocessing menu and select Find and Run tool
- Write ' region growing' and select
- Select the one grid on offer
- Select your seed point raster as Seeds
- Select your splitted band images as Features
- Select create in Segments, Similarity and Tables<<Seeds
- Select Normalize
- Select 4 (von Neumann
- Select feature space and position
- Insert the values shown in the picture and click Okay twice. We will talk about the input values later on...
After a short while, SAGA will have finished the calculation and you'll notice two new layers in the layer panel. Double-click on Segments and you hopefully see the first fruit of all the effort that you put into this exercise:
[edit] Vectorising the raster data
In the next step we are going to create polygons in a shapefile which we can then open in QGIS...
- In the Find and Run tool search, enter 'vectorising grid' and select
- Fill in the mask as follows and double-click Okay :
- Right click on the newly created Segments file under Shapes in the Layer panel
- Select Save as and save the file as ESRI shapefile
[edit] Opening the polygon file in QGIS
Now you can open the shapefile in QGIS and adjust the look of the segments in the Styles tab in the properties of the layer:
[edit] The math part
As you see in the last image, the segments fit the crowns quite well, but there is room for improvement. You can start to fine-tune the segmentation by changing the different parameters in the segmentation tool: Variance in Feature Space, Variance in Position Space, (Similarity Treshold), Method and Neighbourhood. You can also try to include or exclude certain data.
You can do that by trial and error, however, it helps to understand the math that lies behind these algorithms.
What the algorithm in the Seeded Region Growing module does, is that it starts with the seed point, goes to the adjacent pixels and joins them together if they are similar enough. 'Enough' in this case is determined by the similarity-condition which is expressed in the following formula:
.PNG)
The meaning of the parameters are easy to understand: 'f' is a value (f.ex. a spectral value or a height value) 'r' is a location. The indices designate which value it is, the one from the seed point or from the pixel that is being investigated (should it be joined to the segment of the seed or not).
't' indicates vector transposition and σ1 and σ2 are variances in colour and position space. The latter normalize the value differences between seed point and pixel.
α is the similarity criterion. It not need to be normalized and is set arbitrarily at 0.15.
σ1 and σ2 control how far away the values (feature space / position space) are allowed to be between each other. For a maximum distance of 40 % of the peak intensity and three color bands, the formula for σ1 is:
.PNG)
σ2 determines the maximum spatial distance δ which is set to the radius of the largest crown (for spherical crowns):
(BECHTEL 2008[1])
The algorithm in the Seeded Region Growing module is based on the work of ERIKSON (2003[2], 2004[3], ERIKSON & OLOFSSON 2005[4])
[edit] References
- ↑ Bechtel, B. (2008)."Segmentation for Object Extraction of Trees using MATLAB and SAGA." SAGA–Seconds Out, Hamburger Beiträge Zur Physischen Geographie Und Landschaftsökologie. Univ. Hamburg, Inst. für Geographie (2008): 1-12..
- ↑ Erikson, M. (2003). Segmentation of individual tree crowns in colour aerial photographs using region growing supported by fuzzy rules. Canadian Journal of Forest Research, 33(8), 1557-1563.
- ↑ Erikson, M. (2004). Segmentation and classification of individual tree crowns (Vol. 320).
- ↑ Erikson, M., & Olofsson, K. 2005). Comparison of three individual tree crown detection methods. Machine Vision and Applications, 16(4), 258-265.
