TokenizerKt

public final class TokenizerKt
Content copied to clipboard

Functions

tokenize
Link copied to clipboard
final Either<TokenizerError, List<Token>> tokenize(String input)
Content copied to clipboard
Generates a List of Token from a String.