Giter VIP home page Giter VIP logo

kaggle-donorschoose-nlp-lightgbm's Introduction

Kaggle-DonorsChoose-NLP-LightGBM

Competition

DonorsChoose.org receives hundreds of thousands of project proposals each year for classroom projects in need of funding. Right now, many volunteers is needed to manually screen each submission before it's approved to be posted on the DonorsChoose.org website. The goal of the competition is to predict whether a DonorsChoose.org project proposal submitted by a teacher will be approved, using the text of project descriptions as well as additional metadata about the project, teacher, and school. DonorsChoose.org can then use this information to identify projects most likely to need further review before approval. Our goal here is to generate the numerical, categorical and rich text features that can be mined from the essay and resource request data. The hypothesis is that certain features mined such can be strong predictors of the binary outcome of whether an application will be accepted or not.

Process Overview

1574100207862

Data Understanding

We have 3 datasets namely, Train (the training set), Test (the testing set), and Resources (items requested along with each application or proposal).

1574100207862

Feature Engineering and Text Analysis

Using all the features as it is rarely useful in data mining. To make this features more informative, we performed a range of feature engineering steps and performed text analysis on the essays and title of essays.

1574100207862

Data Mining

We experimented with multiple prediction algorithms

  1. Random Forest
  2. SVM
  3. Boosting

1574100207862

Prediction Performance

Based on the important features, we then implemented stacked model of LightGBM and CatBoost. Their comparative performance with Kaggle Leadership board is reported in the graph below.

1574100207862

kaggle-donorschoose-nlp-lightgbm's People

Contributors

guptapiyush340 avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.