Giter VIP home page Giter VIP logo

elsa-flooding-nyc-311's Introduction

Analyzing 311 Street Flooding Complaints in NYC for Tropical Storm Elsa (7/9) as well as the Flash Flood the day before (7/8)

Notes:

  • complaint end duration is capped on 7/12
  • full complaint duration is from 7/8 to 7/12
  • query only includes descriptor = Street Flooding (SJ)

author: Mark Bauer
created date: 07.12.21

how to download the data:

  • click the green Code Button
  • click Download ZIP
  • check your Downloads folder

screenshot below:

download csv link to 311 data on nyc open data: https://data.cityofnewyork.us/Social-Services/311-Service-Requests-from-2010-to-Present/erm2-nwe9

elsa-flooding-nyc-311's People

Contributors

mebauer avatar

Watchers

 avatar  avatar

elsa-flooding-nyc-311's Issues

Pull 311 data filtered by date, rather than entries limit

In the "query data for street flooding complaints" section, service requests are being downloaded fully (since 2010, I assume), with a limit to the maximum number of rows.

Since in this project you are interest in a specific date, it would be more efficient to filter the data by date before downloading it. That way (especially now that you have done the sanity checks) you can save yourself from a) a longer download of heavier data and b) having to filter it later.

Im guessing this would require to convert your query into sth like:

query = """
SELECT 
    *
WHERE 
    created_date BETWEEN  '2021-07-07T00:00:00.000' AND  '2021-07-13T00:00:00.000'

    AND

    descriptor = 'Street Flooding (SJ)'
"""

Doing this (if I am right), the query will first filter the whole dataset by date, making it much smaller and manageable, to then isolate the descriptor of interest.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.