Parsed HTML Rewriter

A DOM-based implementation of Cloudflare Worker's HTMLRewriter.

Unlike the original, this implementation parses the entire DOM (provided by linkedom), and runs selectors against this representation. As a result, it is slower, more memory intensive, and can't process streaming data.

Note that this approach was chosen to quickly implement the functionality of HTMLRewriter, as there is currently no JS implementation available. A better implementation would replicate the streaming approach of lol-html, or even use a WebAssembly version of it.

However, this implementation should run in most JS contexts (including Web Workers, Service Workers and Deno) without modification and handle many, if not most, use cases of HTMLRewriter. It should be good enough for testing and offline Workers development.

Usage

This module can be used in two ways.

As a standalone module:

import { ParsedHTMLRewriter } from '@worker-tools/parsed-html-rewriter'

await new ParsedHTMLRewriter()
  .transform(new Response('<body></body>'))
  .text();

Or as a polyfill:

import '@worker-tools/parsed-html-rewriter/polyfill'

await new HTMLRewriter() // Will use the native version when running in a Worker
  .transform(new Response('<body></body>'))
  .text();

innerHTML

Unlike the current (March 2021) version on CF Workers, this implementation already supports the proposed innerHTML handler. Note that this feature is unstable and will likely change as the real version materializes.

await new HTMLRewriter()
  .on('body', {
    innerHTML(html) {
      console.log(html) // => '<div id="foo">bar</div>'
    },
  })
  .transform(new Response('<body><div id="foo">bar</div></body>'))
  .text();

Caveats

Because this version isn't based on streaming data, the order in which handlers are called can differ. Some measure have been taken to simulate the order, but differences may occur.
Texts never arrive in chunks. There is always just one chunk, followed by an empty one with lastInTextNode set to true.
The onDocument handler is currently not implemented.

ajwcontreras / parsed-html-rewriter Goto Github PK