dabit3 / archive-forever Goto Github PK

1. We may get a “Checking if the site connection is secure” message on a lot of pages specifically Cloudflare security-enabled sites.
   instead of using fetch here in the code better to use the puppeteer page's content() method to fetch HTML(I haven't tested it though)

An archive of a medium website looks like this:

2. Also, on some websites, archived HTML is not included with CSS and js files. regex/replace here in the code are not good options in my opinion(and I think we're using original site's assets in the archive which may not be available in future). instead, we should find a solution where it includes all external css/js and encode images in base64 into a single HTML file. Something like this (again, not tested though. just a thought)

With these fixed, it will be an awesome project