Kafka Connect JDBC Array Type

2017-11-11 Thread Alex Good
Hey All, I'm using the JDBC sink to materialise a kafka topic in a postgres table. The records in the topic are avro messages. I'm running into this problem because one of the fields in the messages is an array: org.apache.kafka.connect.errors.ConnectException: null (ARRAY) type doesn't have a ma

Re: GlobalKTable never finishes restoring

2017-11-08 Thread Alex Good
x27;s incorrect. Alex On Wed, Nov 8, 2017 at 3:54 PM Alex Good wrote: > No problem, it was an interesting little bughunt. I'll create a JIRA and > PR this afternoon/evening. > > Thanks > Alex > > On Wed, Nov 8, 2017 at 3:05 PM Matthias J. Sax > wrote: > >

Re: GlobalKTable never finishes restoring

2017-11-08 Thread Alex Good
> also fine, and I (or someone else) can do it. Please let us know. > > For 0.11.0.1, the workaround would be to not use transactions when you > write the topic that you read as global state/KTable. > > Thanks a lot for reporting the issue and helping to nail it down! &

Re: GlobalKTable never finishes restoring

2017-11-07 Thread Alex Good
ommit marker correctly. > > Will look into this in more detail tomorrow. Would still be valuable, if > you could verify my suspicion. > > Thanks! > > -Matthias > > On 11/7/17 7:01 PM, Alex Good wrote: > > Disabling transactions doesn't seem to have changed any

Re: GlobalKTable never finishes restoring

2017-11-07 Thread Alex Good
r set the consumer into READ_UNCOMMITTED mode to verify? It only a > > guess that it might be related to transactions and it would be great to > > verify or rule it out. > > > > Thanks a lot! > > > > -Matthias > > > > > > On 11/7/17 3:15 PM, A

GlobalKTable never finishes restoring

2017-11-07 Thread Alex Good
Hi All, I have a simple kafka streams app that seems to hang when restoring state for a GlobalKTable. We're running in a test environment at the moment and the topic it is loading from only has two messages in it, I don't know if the very low volume of messages would affect the restore? I've atta