justiceamoh / mhb Goto Github PK

You guys need help with this project?

titles from www.cyberhymnal.org/ which had bad mark-up were stored in errorTitles.txt.
in title.txt the are represented as '__'

1. spelling mistakes
2. no title
3. wrong hymn number*
4. title not found on www.cyberhymnal.org/

*this will be the most difficult to chk since i have to go through the hymns one-by-one. I'll do this last

Seems some mhb files, like 35.mhb, have no lyrics. This is probably because their html tags is different from the rest. play around with beautiful soap and figure out a way to fix.

most of the lyrics frm cyberhymnal.org/ are enclosed in 'div' a few in 'td'
but mock_scrapper.py only checks in divs for lyrics hence for those in the output will be '__'

http://www.oremus.org is "under construction" in parts which contain the hymns i need

So there are some small errors in the mhb database. Some hymns have weird characters, some authors name are spelt differently, and so forth and so on. We need to go through the database and fix all these errors

From the db_builder.py, the entries for hymn lyrics and authors are of type python buffers. hence they are saved into the database as python buffers. the buffers are stored as blobs into the db and throws an error when reading in android.