Giter VIP home page Giter VIP logo

gijs / isprs-potsdam-viz Goto Github PK

View Code? Open in Web Editor NEW

This project forked from azavea/isprs-potsdam-viz

0.0 1.0 0.0 711 KB

Viewer for Azavea's work on the ISPRS Potsdam image segmentation contest

Home Page: https://www.azavea.com/blog/2017/05/30/deep-learning-on-aerial-imagery/

License: Apache License 2.0

Makefile 2.56% Shell 8.32% HCL 1.36% Scala 12.56% JavaScript 60.64% CSS 10.02% HTML 4.55%

isprs-potsdam-viz's Introduction

ISPRS Potsdam data viewer

This is an application for viewing the ISPRS Potsdamn dataset and results from Azavea's Raster Vision project.

Requirements

  • Vagrant 1.8+
  • VirtualBox 4.3+
  • Ansible 2.2+

Getting Started

Quick setup

Make sure you have a geotrellis profile in your aws-cli profiles, with keys that can access your data on S3.

Clone the project, cd into the directory, then run ./scripts/setup.sh to create the Vagrant VM and then build the Docker container(s).

setup.sh can also be used to restore the project to its initial state: it will re-provision the VM, then remove and rebuild the Docker container(s).

Note: this will destroy the VM's existing Docker container before rebuilding it.

To run just the UI server

./scripts/setup.sh
vagrant up
vagrant ssh
./scripts/server.sh

Downloading test data

make load-local will download the necessary data.

Using Docker in the VM

The other project scripts are meant to execute in the VM in the /vagrant directory. To run the container during development use the following commands:

vagrant up
vagrant ssh
./scripts/server.sh

Scripts

Name Description
cibuild.sh Build the project for CI server TODO
clean.sh Clean up unused Docker resources to free disk space. TODO
console.sh Run docker-compose exec app /bin/sh TODO
lint.sh Run ESLint TODO
server.sh Run docker-compose up and start a server on port 8284
setup.sh Bring up the VM, and then destroy and rebuild the Docker container
test.sh Run tests TODO
update.sh Update the app container with npm dependencies TODO

Makefile

Command Description
local-run Run benchmark job locally
upload-code Upload code and scripts to S3
create-cluster Create EMR cluster with configurations
ingest-dsm IDW ingest with or without pyramiding
ingest-labels Raw PointCloud ingest without pyramiding yet
ingest-rgbir Local IDW ingest with or without pyramiding
ingest-unet Run server on EMR master
ingest-fcn TIN ingest with or without pyramiding
wait Wait for last step to finish
proxy Create SOCKS proxy for active cluster
ssh SSH into cluster master
get-logs Get spark history logs from active cluster
clean Clean local project

Running on EMR

Requires: Reasonably up to date aws-cli.

Configuration

You will need to modify config-aws.mk to reflect your credentials and your VPC configuration. config-emr.mk and config-ingest.mk have been configured with an area over Japan. Be especially aware that as you change instance types config-emr.mk parameters like EXECUTOR_MEMORY and EXECUTOR_CORES need to be reviewed and likely adjusted.

EMR pipeline example

make upload-code && make create-cluster
make ingest-rgbir

Licence

isprs-potsdam-viz's People

Contributors

lossyrob avatar tnation14 avatar yoninachmany avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.