danipolo / screaming-frog-shingling Goto Github PK
View Code? Open in Web Editor NEWThis project forked from jroakes/screaming-frog-shingling
Uses Screaming Frog Internal HTML with text extraction along with a shingling algorithm to compare content duplication across the pages of a crawled site.
License: MIT License