I would like to contribute to your project with a restyling of your documentation. With a modern visual update, improved organization, and enriched content. I believe the documentation can become more user-friendly and accessible. I'm experienced in markdown and eager to collaborate on this improvement.

I aim to:

1. restyle the documentation
2. Create sections for the documentation
3. Create other files and guide with separate information

I note that the regular expression created by your Mathematica function is verbose (and likely inefficient to match against) since it is just a big disjunction of the individual tokens.

Obtaining minimal DFA from regular expressions is hard (i.e. has prohibitive cost) in general as the NFA -> DFA step may blow up the size of the automaton, but it may work out here.
Plus, it's not clear what size the regular expression we get by one of several algorithms will be.

Worth a try, anyway, I think.

Motivation: Mathematica highlighting has not been included into the SE-wide highlighting solution because of the size of the file(s). If they can be shrunk, chances are we'd be able to use Mathematica highlighting on other sites as well.

This is a suggestion to add a minor feature.

It would be nice to be able to show escape sequences within strings.

This would really drive the point home that "\sin" is not the same thing as "\\sin" in Mathematica.