TokenRule
is identical to ExtensibleRule
with the exception of the following:
- The rules it declares define the language token.
- Token rules are automatically marked with the
ExplicitSpaces
attribute which indicates that whitespace rules should be placed manually.
See also
RuleAttributes
Name
TokenRule
ExtensibleRuleBody
token vs. regex