Giter VIP home page Giter VIP logo

mast30034_pj1_new's Introduction

MAST30034 Project 1 - Quantitative Analysis

Dependencies

  • Language: Python 3.8.3
  • Packages / Libraries:pandas,sklearn,folium,numpy,warnings,seaborn,matplotlib.pyplot,matplotlib.mlab.

Datasets

Directory

Change this to fit your needs when you have started the project.

  • raw_data: Contains all the raw data files. You may add this folder to .gitignore if your files are too large, but you must provide code to automatically download or links so that we may manually download them.
  • in order to create empty folder in git, a file name"a.abc" is created in raw_data/yellow, remove this file before the running of code! -raw_data/yellow: "the new folder need to be created before download the TLC file" -raw_data/taxi_zones: "files for folium and geopandas" -raw_data/december.csv: weather data for evluate the modelling.
  • preprocessed_data: Contains all the preprocessed data files. You may add this folder to .gitignore if your files are too large, but your script should automaticaally generate files here given the correct dataset in raw_data.
  • plots: Output and save all your figures here.
  • code: Keep all notebooks and scripts in this folder. Ensure that you have notebooks for each stage of code. Here's an example:
    • Download.ipynb for "download the TLC files"
    • data_cleaning.ipynb for "Preprocessing" and/or "Exploratory Data Analysis".
    • weather.ipynb for "read in weather csv file and preprocessing, combine weather data with cleaned TLC feather file."
    • Demand.ipynb for "Analysis and visualisation of what effect demand of yellow taxi"
    • Tips.ipynb for "Analysis and visualisation of what effect the tips"
    • Geospatial.ipynb for "Geospatial Visualisation"
    • modeling.ipynb for "Statistical Modelling".
    • @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
    • !!!!!the code must run in the order listed above!!!!
    • @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
  • deprecated: A folder to store "old code" that you do not use anymore or code that you experimented with, but decided to not go ahead. This is useful in case you ever need to come back to an older iteration of code or to express your other approaches to the problem.

Other

  • the auto saveing of Geospatial.ipynb may not avaliable after running all code in this file.
  • most of the plot are not shown in the report is shown here.
  • there exit some plot is saved by screenshot
  • the external dataset weather is modified(changed the name of file), please use the csv file included in the raw_data.

mast30034_pj1_new's People

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.