Giter VIP home page Giter VIP logo

ideas's People

Watchers

Matt Hampel avatar James Cloos avatar Alex B. Hill avatar

ideas's Issues

Managing / staying on top of upcoming incentives

Related to / more than #13

A system for knowing about / staying on top of grant deadlines: what's coming up; how to apply; what materials you need; deadlines; pre-deadlines (eg "Make sure you ask people for letters of support by this date if you want to get them in on time); informational calls / webinars distilled into easy-to-read packages.

Shareable mood board

A way to create and share moodboards for sites

  • Drag and drop photos into a page
  • Resize them
  • Maybe be able to zoom in and out
  • Infinite canvas

Better constituent communications

What if it was easier for NGOs or governments to reach out to people based on where they live?

Might include

  • Snail mail
  • Texts
  • Email
  • FB groups
  • Whatever

Based on drawing a shape on a map

Put NYC permit data online in a better format

NYC Building Permits
A building can have multiple jobs. A job can have multiple permits.

Jobs are the most interesting of the two, because they detail the work to be done an estimated cost. Other interesting things they record:

  • Current and proposed new zoning square feet
  • Current and proposed number of stories
  • Text description in all caps

Permits are interesting because they have the name of the business (”Permittee’s Business Name”), a personal name for the business (often the name of the owner), and other related information. Both the permit and job data have the property owner’s name and business name.

The data

The online system is pretty good, especially if you want to skim the data or do a quick search. You can start with a BIN, job, or permit number, and drill up or down to the details: http://a810-bisweb.nyc.gov/bisweb/PropertyProfileOverviewServlet?requestid=2&bin=1077836. (Sure, it doesn’t look great – but the pages load in ¾ of a second)

The open data is here: https://data.cityofnewyork.us/Housing-Development/DOB-Permit-Issuance/ipu4-2q9a

That’s usually around 400,000 rows of open permits (are they all open?) on a particular day. The CSV export is around 300MB.

*The historical reports are here: *
http://www.nyc.gov/html/dob/html/codes_and_reference_materials/statistics.shtml

This is where you can easily get bulk data

The job reports list jobs issued in a given month. I don’t know if the same job ID can appear across multiple months. A given month might have 9,000+ jobs.

That page also has complaint reports. There is a searchable database of bad construction professionals at http://www.nyc.gov/html/dob/html/safety/iad.shtml. You can probably connect the two to permit

Are there duplicate permits across months? Duplicate jobs across months?

How people use the data

Historical permits http://www.metrohistory.com/searchfront.htm

Sweeten permit dot map: https://sweeten.com/maps

NY Times search: http://realestate.nytimes.com/community/building_permits.aspx

Weekly monitor of violations

http://www.buildingviolation.com/newyork.html

Data debugging checklist

  • Do the counts match?
  • Is there data missing? Why?
  • Capitalization and spelling good
  • Google iiiittttt

Hospital discharge data

Apparently many states release detailed data on hospital patient discharges (age, gender, injuries, etc)

CRM for property

Select the properties you want to track. We let you keep notes, relationships, vacancy status, project status, etc.

Standardize all the open data!

Something like OpenAddresses for all the endpoints:

  • Building data
  • 311
  • Inspections
  • Etc etc

Since it won't standardize itself.

Modern GIS for the lazy professional

  • Just drag and drop shapefiles / other geodata
  • Great library that remembers where all those files are and keeps them accessible & searchable
  • Quickly combine a couple shapefiles to one table/layer
  • Nice attribute editor
  • Quality measures for your data
  • Quick search of data portals etc

TableAPI

Write data to a table like Google Spreadsheets -- but without all the junk around it. Super easy auth for reading and writing.

CartoDB Lite

Not really even close to cartodb

Single-user to start? (Could be multi-user if privs are just GRANT'ed on a per-table basis to users...)

How to sanitize queries and manage permissions? Don't worry, just use Postgres permissions for now!

When authenticated: user gets more db privs (write, drop, etc)

When unauthenticated: just read privs

POST /user/login

POST /data -- send a shapefile, geojson, whatever to create a table

GET /tables -- list all the tables

GET /tables/:table-name/?sql=select * from foo where -- run arbitrary sql to get geojson

POST /tables/:table-name/tiles... -- or something like that, create a style

How to sanitize queries? Just rely on DB permissions.

GET /tables/:table-name/tiles/z/x/y.png?sql=... -- arbitrary tiles

Uses nodetiles for rendering.

OSM => SVG extractor for print maps

Would extract features, group them by type, and then convert and export them to SVG files.

Current output specs:

  • Each feature should be a group (since it could be multiple lines)
  • Repeat buildings should be excluded
  • Probably should result in several files: at least one for each feature type (road, building, etc), so they can easily be styled in separate layers in Illustrator

Maybe there are other convenient semantics that can be added for Illustrator to use. I'll have to test to see how it works.

References:

Open source data cleaner-type project

  • Google Refine style histograms
  • Supports large data
  • Supports postgres database queries
  • Drag and drop CSV import and preview
  • Local Node app
  • Easy cleaning

screen shot 2016-05-02 at 10 37 42 am

Big LocalData Priorities

  • Group accounts
  • Group admins vs project admins
  • Table view
  • Tighten up zones: add names, tracking of parcels completed
  • of parcels completed.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.