Detect whether page is suitable for applying readability about python-readability HOT 2 CLOSED

Hi Andre0991,

python-readability was made for articles view pages: pages with only one large piece of text, which needs to be extracted.
I'm not sure how any check like this could be performed.
Try to think about a heuristics that will do this.
For example, you might subclass Document and override select_best_candidate function to check to analyse the returned fragments, count non-overlapping fragments and their lengths.
But most probably you won't be able to differentiate between article+large comments+snippets and a homepage with a number of article snippets.

from python-readability.

Thanks for your answer, burly.

I think I'll have a loot at the heuristics used by Firefox readability implementation (Firefox currently shows the readability button only for certain pages).

from python-readability.