Giter VIP home page Giter VIP logo

corn-price-analysis's Introduction

Modeling USDA Corn Prices with Generalized Least Squares Regression

Zane Billings

Intro

This began as a project for Statistical Methods II (MATH 375) at Western Carolina University in 2019. The project, with only a few minor fixes, is essentially left as-is in the Archive directory. Since then, I decided to take a few hours and work on this again, to see if I remembered what I learned, and also to re-do the project now that (in 2021) I think I'm better at coding and statstics.

Modeling Strategy

Description of Contents

  • Data: this directory contains all of the data used in this project.
    • Raw: contains the raw excel file downloaded from the USDA website.
    • Processed: contains the Rds and CSV files produced by the data cleaning script.
  • Code: this directory contains all .R code files used in data cleaning and analysis.
    • Raw-Data-Downloading.R: this script downloads the excel file of the raw data from the USDA website to the Data/Raw directory.
    • Data-Cleaning.R: this script imports the relevant sheets from the raw excel file, extracts and cleans the relevant data, joins together data from across streets, and saves the final cleaned data to CSV and Rds formats in the Data/Processed directory.
  • Figures: this directory will contain all figures and visualizations from the analysis.
  • Models: this directory will contain all models created from the analysis saved as .Rds files.
  • Manuscript: a write-up of the final model results will be contained here.

corn-price-analysis's People

Contributors

wzbillings avatar

Watchers

avatar

corn-price-analysis's Issues

Fully automate data updating.

The current data downloading solution has to be manually updated for each new update of the Feed Grains dataset due to the USDA website structure. Look into seeing if there is an API or way to automatically construct file name to fully automate the data downloading function.

Clean additional sheets.

Only part of the sheets are cleaned currently, but this could be expanded to completely clean the dataset. This would potentially allow for updated corn price analysis as well as analyses of other grains.

Update cleaned data to include other grains.

Current data cleaning scripts discard all sheet data that is not related to corn. This could be refactored to clean multiple grains at one time, either with a "grain" indicator variable, separate datasheets, or just as additional columns of the data.

Automate data cleaning.

In Archive, the data undergoes several manual cleaning steps. Write an R script that cleans the data without any manual input.

Automate data downloading.

Currently data is manually downloaded from the USDA website. Write an R or shell script to automatically download the excel file.

Update README

the README describes what is currently in the Archive folder and needs to be updated to fit the refactored project structure.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.