Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-09 Thread Jark Wu
ursday, October 8, 2020 at 10:15 PM > *To: *Dylan Forciea > *Cc: *Till Rohrmann , dev , > Shengkai Fang , "user@flink.apache.org" < > user@flink.apache.org>, Leonard Xu > *Subject: *Re: autoCommit for postgres jdbc streaming in Table/SQL API > > > > Hi Dyl

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-09 Thread Dylan Forciea
at 10:15 PM To: Dylan Forciea Cc: Till Rohrmann , dev , Shengkai Fang , "user@flink.apache.org" , Leonard Xu Subject: Re: autoCommit for postgres jdbc streaming in Table/SQL API Hi Dylan, Sorry for the late reply. We've just come back from a long holiday. Thanks for reporti

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-08 Thread Jark Wu
[INFO] > > [ERROR] Tests run: 10, Failures: 2, Errors: 0, Skipped: 0 > > > > Thanks, > > Dylan Forciea > > > > *From: *Till Rohrmann > *Date: *Thursday, October 8, 2020 at 2:29 AM > *To: *Dylan Forciea > *Cc: *dev , Shengkai Fang , " > user@f

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-08 Thread Dylan Forciea
" , "j...@apache.org" , Leonard Xu Subject: Re: autoCommit for postgres jdbc streaming in Table/SQL API This sounds good. Maybe there are others in the community who can help with the review before the Jark and Leonard are back. Cheers, Till On Wed, Oct 7, 2020 at 7:33 PM Dylan

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-08 Thread Till Rohrmann
apache.org" , Leonard Xu < > xbjt...@gmail.com> > *Subject: *Re: autoCommit for postgres jdbc streaming in Table/SQL API > > > > Ok, I have created FLINK-19522 describing the issue. I have the code I > made so far checked in at > https://github.com/apache/flink/compare/ma

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-07 Thread Dylan Forciea
g" , Leonard Xu Subject: Re: autoCommit for postgres jdbc streaming in Table/SQL API Ok, I have created FLINK-19522 describing the issue. I have the code I made so far checked in at https://github.com/apache/flink/compare/master...dforciea:FLINK-19522 but this only fixes the SQL API. It s

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-07 Thread Dylan Forciea
uot; , "j...@apache.org" , Leonard Xu Subject: Re: autoCommit for postgres jdbc streaming in Table/SQL API Hi Dylan, thanks for reaching out to the Flink community and excuse our late response. I am not an expert for the Table API and its JDBC connector but what you describe sounds li

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-07 Thread Till Rohrmann
issue after it is created. It wasn’t a huge amount of code, so it’s > probably not a big deal if you wanted to redo it. > > Thanks, > Dylan > > From: Shengkai Fang > Date: Wednesday, October 7, 2020 at 9:06 AM > To: Dylan Forciea > Subject: Re: autoCommit for postgre

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-07 Thread Dylan Forciea
: Re: autoCommit for postgres jdbc streaming in Table/SQL API Sorry for late response. +1 to support it. I will open a jira about it later. Dylan Forciea mailto:dy...@oseberg.io>>于2020年10月7日 周三下午9:53写道: I hadn’t heard a response on this, so I’m going to expand this to the dev

Re: autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-07 Thread Dylan Forciea
: Dylan Forciea Date: Thursday, October 1, 2020 at 5:14 PM To: "user@flink.apache.org" Subject: autoCommit for postgres jdbc streaming in Table/SQL API Hi! I’ve just recently started evaluating Flink for our ETL needs, and I ran across an issue with streaming postgres data via the Table/S

autoCommit for postgres jdbc streaming in Table/SQL API

2020-10-01 Thread Dylan Forciea
Hi! I’ve just recently started evaluating Flink for our ETL needs, and I ran across an issue with streaming postgres data via the Table/SQL API. I see that the API has the scan.fetch-size option, but not scan.auto-commit per https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connec