The compiler's lexical analyzer can be used in your programs to simplify parsing.  See Doc Parsing or Parse Opcode File.

See Tokens.