Function: tokenize()
tokenize(
input):Token[]
Defined in: packages/core/src/parser/lexer.ts:111
Tokenize an OData query expression string into a token array. The last token is always EOF.
Parameters
input
string
Raw OData expression string (e.g., "Price gt 5 and Active eq true")
Returns
Token[]
Array of tokens ending with EOF
Throws
ODataParseError on unrecognized characters