hansott opened a new pull request, #1647:
URL: https://github.com/apache/datafusion-sqlparser-rs/pull/1647
Currently the tokenizer throws an error for
```js
insert into cats_2 (petname) values ('foo'),--\r(version()||'\n');
```
this is because postgres treats \r as a separate new line character, see
https://github.com/postgres/postgres/blob/master/src/backend/parser/scan.l
> In order to make the world safe for Windows and Mac clients as well as
Unix ones, we accept either \n or \r as a newline.
> A DOS-style \r\n sequence will be seen as two successive newlines, but
that doesn't cause any problems.
> non_newline [^\n\r]
> comment ("--"{non_newline}*)
Let's make sure we start a new line if we encounter a \r when tokenizing a
comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
