TokenRule is identical to ExtensibleRule with the exception of the following:
- The rules it declares define the language token.
- Token rules are automatically marked with the
ExplicitSpacesattribute which indicates that whitespace rules should be placed manually.
See also
RuleAttributes
Name
TokenRule
ExtensibleRuleBody
token vs. regex