Optional
aliasAn optional alias or list of aliases.
Optional
greedyWhether the token is greedy.
Optional
insideThe nested grammar of this token.
The inside
grammar will be used to tokenize the text value of each token of this kind.
This can be used to make nested and even recursive language definitions.
Note: This can cause infinite recursion. Be careful when you embed different languages or even the same language into each another.
Optional
lookbehindIf true
, then the first capturing group of pattern
will (effectively) behave as a lookbehind group meaning that the captured text will not be part of the matched text of the new token.
The regular expression of the token.
The expansion of a simple
RegExp
literal to support additional properties.