arghyam / arghyam-scrapers Goto Github PK

is_minority_L7
is_naxal_L7
is_st_L7
IsBRGFDistrict_L7

The performance bubble chart.

If you want to look at how a particular state's data moves through time you can't because it goes back to country view automatically while you change the sheets.

Is there a way to fix it so you can just look at one state?

Make it clear that you can click on the state to see the district level.

http://arghyam.github.io/arghyam-scrapers/#Financial%20Progress%7CProject%20outlay%20used%20-%20BPL

Project outlay used BPL to Money spent for building toilets for the rural poor

districtData_L2
districtFinancialData_L3
districtPhysicalData_L3
stateData_L2
stateData_L8
stateFinancialData_L3

http://arghyam.github.io/arghyam-scrapers/#Financial%20Progress%7CShare%20of%20centre%20-%20Approved

For this Viz can we follow a diff colour coding:

60 - 70% centre share can be light green
anything less than 60% should be red - irrespective of gradient
anything above 70% can become progressively darker shades of gree

http://tsc.gov.in/TSC/Report/Physical/RptPhysicalProgessStateWiseDistrictwise.aspx?id=PHY

Scrape this table. For specifically the school progress column.

http://arghyam.github.io/arghyam-scrapers/#Performance%7CFinancial%20vs%20Physical%20progress

Financial vs Physical progress

Comparing spending to toilet construction

We want to start moving to a staging page and a separate experiment viz page so that we can get the finalized code and do the final push to IWP.

So that means we need to get the 6 visualizations we want for launch separated from the others and get them finished.

Also replace the TSC page with just a preview of the 6 visualizations.

BPL etc. for hover & description - and glossary for datasets - Nisha & amrtha to figure this out

http://arghyam.github.io/arghyam-scrapers/#Physical%20Progress%7C%25%20toilets%20built%20below%20poverty%20household

% toilets built below poverty household to

Evaluation of toilets built for the rural poor

To be designed.

Will it be possible to insert header rows in each file so we know what each column corresponds to?

Amrtha

The census households table are available here:

https://drive.google.com/folderview?id=0B9MvDRHquaP6SWdxUkpteHFZYWs&usp=sharing

Table 101 for each state gives total rural households though they do not have an APL, BPL segregation.

I think we should go ahead and do one consolidated coverage table for physical performance (previously split in two as BPL - http://arghyam.github.io/arghyam-scrapers/#Physical%20Progress%7CCoverage%20of%20BPL%20Toilets%3A%20households and APL (http://arghyam.github.io/arghyam-scrapers/#Physical%20Progress%7CCoverage%20of%20APL%20Toilets%3A%20households).

So now:

1. The size of the box is from the rural households used as residence - total column (2nd set of data for e.g. for Ap column 12 ) for each table 101 from the census.
2. The colour of the box:
   • Numerator - total number of households with toilets - will be total IHHLs from Project performance part of this sheet http://tsc.gov.in/tsc/Report/Physical/RptPhysicalProgessStateWiseDistrictwise.aspx?id=Home
   • Denominator - Total residences for all rural areas from table 101

Add the census link source to viz

Nisha will send IWP link to it.

http://arghyam.github.io/arghyam-scrapers/?#Toilets%20built%7CCoverage%20of%20Toilets%20-%20Rural%20Households

Santhosh - to do!

From Nisha:

The bubble visual. Some districts are above 140%. You can't see the bubble and when you select with the drop down you can't read it.

For example, MP then pick district Sehore. You can't see the info bubble.

http://arghyam.github.io/arghyam-scrapers/#Performance%7CFinancial%20vs%20Physical%20progress

Anand's comment: need to discuss how to resolve this.

http://arghyam.github.io/arghyam-scrapers/?v=1#Money%20spent%7CMoney%20given%20vs.%20Money%20spent

Can the size of each of these bars be bigger?

Cartogram story in the same format as treemap

http://arghyam.github.io/arghyam-scrapers/#Toilets%20built%7CCoverage%20of%20Toilets%20-%20Rural%20Households

For all viz. make only the vizualisation downloadable as svg and not the gradient

Make it explode

http://arghyam.github.io/arghyam-scrapers/?#Performance%7CComparing%20spending%20to%20toilet%20construction

http://arghyam.github.io/arghyam-scrapers/#Financial%20Progress%7CProject%20outlay%20used -

change title from -Project outlay used to

Spending on rural sanitation

Currently, the bar chart exceeds the available height of the SVG. We need to make the bar chart alone have a larger height. This will also fix the comment made by @amrtha on #13

The typical ratio is supposed to be 60% - 20% - 20% for all the bar charts. This will make it easy to compare.

http://arghyam.github.io/arghyam-scrapers/#Financial%20Progress%7CSource%20of%20funding

Source of funding to

Where does the money come from? and which share is spent?
Government of India, State Government, People (beneficiaries)

Include following dates in viz
Feb-18
March - 15
April - 30
May - 29

By district (rows)

By column (Cols)

a) If data changed (1 or 0)
b) How often?
c) How much?

3 csv files

mention the list of datas

Do a scatter plot comparing census with tsc -
x-axis -
spent - tsc - expenditure 1999 to 2011

y axis
rural HH with Toilet - 2011 census
tsc - built total to 2011

Census Table 2808 HH-8
Rural only

one color for census - blue
one color for tsc - orange

Need to replace width (100%) with pixels (940px)

Add matrix to scatter plot.

Amrtha and Nisha will define matrix and update

http://arghyam.github.io/arghyam-scrapers/?#Performance%7CComparing%20spending%20to%20toilet%20construction

Convert "source of funding" into a 3-bar version showing approval, release and expenditure in a comparable way

This file contains data as of 2013-06-02, not 2013-06-10. Please

1. Download data-2013-06-09.csv from ec2-arghyam
2. Add the Rural Households column to this
3. Commit it
4. Delete data-2013-06-10.csv
5. Replace data-2013-06-10.csv with data-2013-06-09.csv in stories.js

s

It would be useful to know how you have coded these sheet names so we can match them against the datasets we needed to scrape.

Performance reports have multiple sources, such as physical and financial data. Allow mention of multiple sources.

Change names of 2 of the 3 main heads under which visualisations are categorised:

1. Financial Progress to Money spent
2. Physical progress to Toilets built

Adding a column for the state name

Adding a glossary of terms to the datasets

expenses/ expenditure - spent/ spending
approved/ outlay - plan

Every day, ec2-arghyam:~/arghyam-scrapers/data.csv should be automatically generated

districtData_L2
districtData_L6 (empty column)
stateData_L2