canonical dirty data data.frame about janitor HOT 10 CLOSED

I like this! I originally had a short little .csv to go with this package, to illustrate dirty features and cleaning them. It wasn't truly nasty though.

I agree that the dirty_iris.csv file is not real-world dirty. That set has this as dirtiness:

– The petal length of an iris is at least 2 times its petal width.
– The sepal length of an iris cannot exceed 30 cm.
– The sepals of an iris are longer than its petals

That might be called semantic dirtiness? Or something. I'm more interested in, say, lines of whitespace used horizontally and vertically as delimiters in an Excel file, for instance. Or the bad NA value in a numeric column that you mention. Dates are often screwy like this.

I will assign this to you, thanks for offering!

from janitor.

It won't let me assign this to you. Not sure why, after some Googling. Maybe you need to be a collaborator on the repo? I just sent you an invite for that.

from janitor.

I think you're right - just assigned myself (a KIPP-ism 😄 )

from janitor.

Been thinking about this - it would be nice for each row to identify how/why it was dirty, to help surface test success/failure.

from janitor.

I was thinking more about this yesterday. It would make for a cool vignette to have a dirty Excel file that gets cleaned one step at a time. We could make a .csv too but then is that really as dirty? 😈

from janitor.

whoops I accidentally closed this

from janitor.

I am working on this right now and it is cathartic to create some ugly data - I think you will like it. If it's not in a spreadsheet made by a novice, it's not really dirty data.

from janitor.

there's this gnarly spreadsheet of spending on journals.

@jennybc's jailbreakr project points to the Enron corpus - maybe grab a subset of those?

from janitor.

The spreadsheets that underpin the gapminder package have some lovely features 😂 and, since I use it to teach data cleaning, the whole glorious mess is laid out here:

https://github.com/jennybc/gapminder/tree/master/data-raw#readme

from janitor.

Filing this under, I would love to see this happen, but realistically I am not going to get to it - so closing as I tidy up issues.

from janitor.