ideas's People
ideas's Issues
LocalData Property Intelligence
Parcels, buildings, owners across the US.
How much have Detroit projects earned from crowdfunding?
how much have Detroit projects made on crowdfunding? (kickstarted, indiegogo), and what type of project were they?
Map financial incentives
Tax prgograms, TIF, etc etc
Does City Council's research division still exist? What have they published?
Managing / staying on top of upcoming incentives
Related to / more than #13
A system for knowing about / staying on top of grant deadlines: what's coming up; how to apply; what materials you need; deadlines; pre-deadlines (eg "Make sure you ask people for letters of support by this date if you want to get them in on time); informational calls / webinars distilled into easy-to-read packages.
"Have Atlantic run various pieces by students at community colleges across America. Arguing who they will vote for."
List all the useful libraries
- Export
-- CSV
-- Shapefile - Tables
-- Sorting
-- Searching - Data / APIS
-- ESRI featureservices
-- CensusReporter?
Shareable mood board
A way to create and share moodboards for sites
- Drag and drop photos into a page
- Resize them
- Maybe be able to zoom in and out
- Infinite canvas
Picture book of survey results
Lulu: 9 in wide, 7 high, http://www.lulu.com/create/books
photo ratio: 4:3
Better constituent communications
What if it was easier for NGOs or governments to reach out to people based on where they live?
Might include
- Snail mail
- Texts
- FB groups
- Whatever
Based on drawing a shape on a map
Put NYC permit data online in a better format
NYC Building Permits
A building can have multiple jobs. A job can have multiple permits.
Jobs are the most interesting of the two, because they detail the work to be done an estimated cost. Other interesting things they record:
- Current and proposed new zoning square feet
- Current and proposed number of stories
- Text description in all caps
Permits are interesting because they have the name of the business (”Permittee’s Business Name”), a personal name for the business (often the name of the owner), and other related information. Both the permit and job data have the property owner’s name and business name.
The data
The online system is pretty good, especially if you want to skim the data or do a quick search. You can start with a BIN, job, or permit number, and drill up or down to the details: http://a810-bisweb.nyc.gov/bisweb/PropertyProfileOverviewServlet?requestid=2&bin=1077836. (Sure, it doesn’t look great – but the pages load in ¾ of a second)
The open data is here: https://data.cityofnewyork.us/Housing-Development/DOB-Permit-Issuance/ipu4-2q9a
That’s usually around 400,000 rows of open permits (are they all open?) on a particular day. The CSV export is around 300MB.
*The historical reports are here: *
http://www.nyc.gov/html/dob/html/codes_and_reference_materials/statistics.shtml
This is where you can easily get bulk data
The job reports list jobs issued in a given month. I don’t know if the same job ID can appear across multiple months. A given month might have 9,000+ jobs.
That page also has complaint reports. There is a searchable database of bad construction professionals at http://www.nyc.gov/html/dob/html/safety/iad.shtml. You can probably connect the two to permit
Are there duplicate permits across months? Duplicate jobs across months?
How people use the data
Historical permits http://www.metrohistory.com/searchfront.htm
Sweeten permit dot map: https://sweeten.com/maps
NY Times search: http://realestate.nytimes.com/community/building_permits.aspx
Weekly monitor of violations
Map of open data portals
Get the bounds of each one.
Bulk or targeted POI info from OSM
Pull POIs from OSM for mapping -- churches, restaurants, etc.
A page that lists every municipal body in the region
And links to their meeting minutes / calendars
Drag-n-drop ETL tools
using papaparse, turf, some shapefile reader...
Brigade idea: genius bar!
Map wifi hotspots
Assumption is that effectively everyone with home internet access also has a wifi router
We can find those with WiGLE, and map them by identifying unique MAC addresses
Here's an example: http://hampelm.github.io/detroit-wifi/web/
Good sources to get leads for news
- Court dockets
- WARN filings
- Legistar alerts
- Bankruptcy filings (where to find?)
Machine learning with parcel data / predictive analytics
Classifiers
Data debugging checklist
- Do the counts match?
- Is there data missing? Why?
- Capitalization and spelling good
- Google iiiittttt
Hospital discharge data
Apparently many states release detailed data on hospital patient discharges (age, gender, injuries, etc)
Do something with parcels and openaddresses
Track HUD spending -- how much is spent down and how much is left on the table?
Visual tools for ETL pipelines
CRM for property
Select the properties you want to track. We let you keep notes, relationships, vacancy status, project status, etc.
Put geojson.io on top of pgsql
Just something you can point at your db to do simple admin tasks.
Asset mapping survey tool
Simple CRUD app, lets people do community asset mapping. Simple subscription.
Make a calendar / list of all the HUD / HOME / etc funding opportunities
With a short paragraph of description
List of court cases past and future in Detroit
Standardize all the open data!
Something like OpenAddresses for all the endpoints:
- Building data
- 311
- Inspections
- Etc etc
Since it won't standardize itself.
Modern GIS for the lazy professional
- Just drag and drop shapefiles / other geodata
- Great library that remembers where all those files are and keeps them accessible & searchable
- Quickly combine a couple shapefiles to one table/layer
- Nice attribute editor
- Quality measures for your data
- Quick search of data portals etc
Rebuild OneBusAway to be lightweight and standards-friendly
This is mostly @prashtx's idea.
Better map annotation tools
TableAPI
Write data to a table like Google Spreadsheets -- but without all the junk around it. Super easy auth for reading and writing.
CartoDB Lite
Not really even close to cartodb
Single-user to start? (Could be multi-user if privs are just GRANT'ed on a per-table basis to users...)
How to sanitize queries and manage permissions? Don't worry, just use Postgres permissions for now!
When authenticated: user gets more db privs (write, drop, etc)
When unauthenticated: just read privs
POST /user/login
POST /data
-- send a shapefile, geojson, whatever to create a table
GET /tables
-- list all the tables
GET /tables/:table-name/?sql=select * from foo where
-- run arbitrary sql to get geojson
POST /tables/:table-name/tiles...
-- or something like that, create a style
How to sanitize queries? Just rely on DB permissions.
GET /tables/:table-name/tiles/z/x/y.png?sql=...
-- arbitrary tiles
Uses nodetiles for rendering.
Open, nationwide parcel database
Every parcel and every owner everywhere.
OSM => SVG extractor for print maps
Would extract features, group them by type, and then convert and export them to SVG files.
Current output specs:
- Each feature should be a group (since it could be multiple lines)
- Repeat buildings should be excluded
- Probably should result in several files: at least one for each feature type (road, building, etc), so they can easily be styled in separate layers in Illustrator
Maybe there are other convenient semantics that can be added for Illustrator to use. I'll have to test to see how it works.
References:
- Info on referencing: http://sarasoueidan.com/blog/structuring-grouping-referencing-in-svg/
- GeoJSON to SVG: https://github.com/gagan-bansal/geojson2svg
Open source data cleaner-type project
Big LocalData Priorities
- Group accounts
- Group admins vs project admins
- Table view
- Tighten up zones: add names, tracking of parcels completed
-
of parcels completed.
FME with Open Source
Drag and drop conversions between geodata formats.
expensify for apartment hunting
just paste in craigslist ads and streeteasy links and so on and we scrape
Google for Geodata / Enigma for geodata
Detroit OSM POI import
Top shops
All major nonprofits
Address data from 2013 parcels (open source)
Tool to find all businesses within a given area
Add more tests to ddot-sms
Service that makes an archival copy of a URL on demand
Including linked assets (eg css, images)
A blog that covers new things in the mapping space
Intern idea: overview of centers on philanthropy
There are a couple dozen. What does each one do? Who do they cover? What are the big players? Major publications? Influential scholars?
Take a picture of every flyer on every telephone pole
Do something with all these cool geoserver layers
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.