Currently the `Lexer` trait requires a prev_token method, but the general parser implementation doesn't use it in the algorithm. I'm unsure of any grammars where the TDOP implementation would need to backtrack.
Currently the
Lexertrait requires a prev_token method, but the general parser implementation doesn't use it in the algorithm.I'm unsure of any grammars where the TDOP implementation would need to backtrack.