Instance segmentation of front doors in mobile mapping system imagesTools Klimkowska, Anna Maria (2020) Instance segmentation of front doors in mobile mapping system images. MRes thesis, University of Nottingham.
AbstractScene understanding, through instance segmentation, is one of the most challenging and difficult tasks in computer vision. Instance segmentation is a combination of object detection and semantic segmentation, resulting in assigning each pixel in an image to a given class. This research aims to investigate the capabilities of the Mask R-CNN architecture to detect front doors from images delivered from a Mobile Mapping System. It was achieved by conducting a set of experiments focusing on training the Mask R-CNN with different combinations of training datasets. Front doors are important objects of interest in this work due to their significance in various applications like enriching information of building Level of Details, or recognising door locations for emergency services and people with disabilities. The data used in the training and testing phases included images collected from different locations (cities in the UK and Poland) and of various types (mobile phone, Mobile Mapping System, RGB and gray images). The results of the analysis suggest that increasing the size of the training dataset improves model capabilities for front door detection. Moreover, the analysis of the performance of models trained on datasets from different locations shows that models can be used to detect front door instances regardless of the origin of the training and test datasets. However, despite the satisfactory results, a comparative analysis of the Mask R-CNN and YOLOv3 approaches showed the superiority of the YOLOv3 over Mask R-CNN in the overall model performance. The best data combination used to train Mask R-CNN resulted in an F1-score equal to 0.7 which increased to 0.74 through the implementation of a post-processing step based on a heightto-width ratio threshold. The research carried out in this project shows the potential of the examined method for front door detection from Mobile Mapping Systems.
Actions (Archive Staff Only)
|
Tools
Tools
![[thumbnail of Anna_Klimkowska_20201543_MRes-Instance_Segmentation_of_Front_Doors_in_Mobile_Mapping_Systems.pdf]](https://eprints.nottingham.ac.uk/style/images/fileicons/application_pdf.png "Anna_Klimkowska_20201543_MRes-Instance_Segmentation_of_Front_Doors_in_Mobile_Mapping_Systems.pdf")
