Giter VIP home page Giter VIP logo

canadianbuildingfootprints's Introduction

Introduction

This dataset contains 12,663,475 computer generated building footprints in all Canadian provinces and territories. This data is freely available for download and use.

License

This data is licensed by Microsoft under the Open Data Commons Open Database License (ODbL)

FAQ

What the data include:

12,663,475 building footprint polygon geometries from all Canadian provinces and territories in GeoJSON format.

What is the GeoJson format?

GeoJSON is a format for encoding a variety of geographic data structures. For Intensive Documentation and Tutorials, Refer to GeoJson Blog

Creation Details:

The building extraction is done in two stages:

  1. Semantic Segmentation – Recognizing building pixels on the aerial image using DNNs
  2. Polygonization – Converting building pixel blobs into polygons

Semantic Segmentation

DNN architecture

The network foundation is ResNet34 which can be found here. In order to produce pixel prediction output, we have appended RefineNet upsampling layers described in this paper. The model is fully-convolutional, meaning that the model can be applied on an image of any size (constrained by GPU memory, 4096x4096 in our case).

Training details

The training set consists of 3 million labeled images. Majority of the satellite images cover diverse residential areas in Canada. For the sake of good set representation, we have enriched the set with samples from various areas covering mountains, glaciers, forests, beaches, coasts, etc. Images in the set are of 256x256 pixel size with 1 ft/pixel resolution. The training is done with CNTK toolkit using 32 GPUs.

Polygonization

Method description

We developed a method that approximates the prediction pixels into polygons making decisions based on the whole prediction feature space. This is very different from standard approaches, e.g. Douglas-Peucker algorithm, which are greedy in nature. The method tries to impose some of a priori building properties, which is, at the moment, manually defined and automatically tuned.

Metrics

Building matching metrics on our evaluation set:

Metric Value
Precision 97.5%
Recall 74.5%

False positive ratio across the board is 7.5%, or one false positive per 4 mi2 area. We have noticed particular extraction problems on agricultural fields that we'll try to fix in the next iteration.

We track various metrics to measure the quality of the output:

  1. Intersection over Union – This is the standard metric measuring the overlap quality against the labels
  2. Shape distance – With this metric we measure the polygon outline similarity
  3. Dominant angle rotation error – This measures the polygon rotation deviation

On our evaluation set contains ~45k building. The metrics on the set are:

  • IoU is 0.76, Shape distance is 0.43, Average rotation error is 3.7 degrees

Data Vintage

The vintage of the footprints depends on the vintage of the underlying imagery. Because Bing Imagery is a composite of multiple sources it is difficult to know the exact dates for individual pieces of data.

How good are the data?

Our metrics show that in the vast majority of cases the quality is at least as good as data hand digitized buildings in OpenStreetMap. It is not perfect, and false positives exist, but most areas look awesome.

What is the coordinate reference system?

EPSG: 4326

Will there be more data coming for other geographies?

Maybe. This is a work in progress.

Why is the data being released?

Microsoft has a continued interest in supporting the open data ecosystem.

Should we import the data into OpenStreetMap?

Maybe. Never overwrite the hard work of other contributors or blindly import data into OSM without first checking the local quality. While our metrics show that this data meets or exceeds the quality of hand drawn building footprints, the data does vary in quality from place to place, between rural and urban, mountains and plains, and so on. Inspect quality locally and discuss an import plan with the community. Always follow the OSM import community guidelines.

Province/Territory Number of Buildings Unzipped MB
Alberta 1,937,284 453
British Columbia 1,488,776 349
Manitoba 723,502 175
New Brunswick 351,640 74
Newfoundland and Labrador 265,376 54
Northwest Territories 17,326 5
Nova Scotia 400,826 81
Nunavut 4,191 1
Ontario 3,832,076 826
Prince Edward Island 76,606 16
Quebec 2,535,293 527
Saskatchewan 1,013,250 281
Yukon 17,329 4


Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Legal Notices

Microsoft and any contributors grant you a license to the Microsoft documentation in this repository under the Creative Commons Attribution 4.0 International Public License, see the LICENSE file, and grant you a license to any code in the repository under the MIT License, see the LICENSE-CODE file.

Microsoft, Windows, Microsoft Azure and/or other Microsoft products and services referenced in the documentation may be either trademarks or registered trademarks of Microsoft in the United States and/or other countries. The licenses for this project do not grant you rights to use any Microsoft names, logos, or trademarks. Microsoft's general trademark guidelines can be found at http://go.microsoft.com/fwlink/?LinkID=254653.

Privacy information can be found at https://privacy.microsoft.com/en-us/

Microsoft and any contributors reserve all others rights, whether under their respective copyrights, patents, or trademarks, whether by implication, estoppel or otherwise.

canadianbuildingfootprints's People

Contributors

timusumisu avatar nikolatr avatar microsoftopensource avatar msftgits avatar

Watchers

 avatar paper2code - bot avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.