Module margo_parser.tokenizer
A tokenizer for Margo syntax
Expand source code
"""A tokenizer for Margo syntax"""
from .tokenizer import tokenize
Sub-modules
margo_parser.tokenizer.margo_transformer
margo_parser.tokenizer.tokenizer