Prepare tokenizer for using borrowed strings instead of allocations.#2073

eyalleshem wants to merge 1 commit intoapache:mainapache/datafusion-sqlparser-rs:mainfrom

eyalleshem:reduce-string-copieseyalleshem/sqlparser-rs:reduce-string-copiesCopy head branch name to clipboard