Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2018-03-19 Thread Matthias J. Sax
Benz, > so when replace the old api usage >> with the new one we don’t have any kind of auto renaming so the backup >> topic name will be inconsistent. Yes. Note, that for global state stores, there won't be any internally created changelog topics because the original input topic can be used for

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2018-03-19 Thread Panuwat Anawatmongkhon
Hi Matthias, I am not sure weather I understand the impact correctly. With the old api user have to specify name for state store and the name is used for auto generated topics for fault tolerance, so when replace the old api usage with the new one we don’t have any kind of auto renaming so the back

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2018-03-18 Thread Panuwat Anawatmongkhon
I couldn’t find this thread in mailing list. this reply is just to trigger it up so I can include it in KIP On Thu, 28 Dec 2560 at 03:07 Matthias J. Sax wrote: > @Matthias: just wanted to follow up on your question: > > I wanted to double check. If I understand the proposal, it would > repl

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-27 Thread Matthias J. Sax
@Matthias: just wanted to follow up on your question: I wanted to double check. If I understand the proposal, it would replace the explicit name with a name that is dynamically generated using the AtomicInteger index. Would this affect the naming of any internally generated top

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-16 Thread Panuwat Anawatmongkhon
Hi all, I would like to start the vote thread tomorrow, feel free to ask if there is any concern. Thank you On Thu, 7 Dec 2560 at 19:22 Panuwat Anawatmongkhon < panuwat.anawatmongk...@gmail.com> wrote: > > Yes, Matthias. > The object will be used togerther with function table and function stream.

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-07 Thread Panuwat Anawatmongkhon
Yes, Matthias. The object will be used togerther with function table and function stream. I didn’t see how this will affect other part but if you do, please explain more on how this will affect generated topic name. Thank you Panuwat On Thu, 7 Dec 2560 at 00:01 Matthias Margush wrote: > Hi. > >

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-06 Thread Matthias Margush
Hi. I wanted to double check. If I understand the proposal, it would replace the explicit name with a name that is dynamically generated using the AtomicInteger index. Would this affect the naming of any internally generated topics? On Wed, Dec 6, 2017 at 7:59 AM Panuwat Anawatmongkhon < panuwat.

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-06 Thread Panuwat Anawatmongkhon
Thanks Bill. I can't think of reason to keep the old method too so if there is no further discussion by tomorrow, I would like to start the vote thread. On Tue, Dec 5, 2017 at 10:38 PM, Bill Bejeck wrote: > Hi Panuwat, > > Thanks for the KIP, overall looks good to me. > > I want to play the dev

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-05 Thread Bill Bejeck
Hi Panuwat, Thanks for the KIP, overall looks good to me. I want to play the devil's advocate for a second and ask do we want to keep the older method with the extra parameters vs. deprecation? Although ATM I can't think of a good reason to keep the old method with the extra parameters. Thanks,

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-05 Thread Ted Yu
Fine by me. On Tue, Dec 5, 2017 at 2:45 AM, Panuwat Anawatmongkhon < panuwat.anawatmongk...@gmail.com> wrote: > Thank you, Matthias. > > Ted, > How about this. > > String globalTopicName = "testGlobalTopic"; > String globalStoreName = "testAddGlobalStore"; > final StreamsBuilder builder = new Str

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-05 Thread Panuwat Anawatmongkhon
Thank you, Matthias. Ted, How about this. String globalTopicName = "testGlobalTopic"; String globalStoreName = "testAddGlobalStore"; final StreamsBuilder builder = new StreamsBuilder(); final KeyValueStoreBuilder globalStoreBuilder = EasyMock.createNiceMock(KeyValueStoreBuilder.class); EasyMock.e

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-04 Thread Matthias J. Sax
Panuwat, Thanks a lot for the KIP! Just one nit: `does not follow provide a good` -> spelling: remove `follow` ? Otherwise, looks good to me. -Matthias On 12/4/17 10:49 AM, Ted Yu wrote: > Looks like you're implying logic similar to this: > > public synchronized GlobalKTable globalTab

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-04 Thread Ted Yu
Looks like you're implying logic similar to this: public synchronized GlobalKTable globalTable(final String topic, final Consumed consumed) { StreamsBuilder is returned instead of GlobalKTable. Can you add code snippet showing

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-04 Thread Panuwat Anawatmongkhon
What i am thinking right now is using the same approach as org.apache.kafka.streams.kstream.internals.InternalStreamsBuilder#globalTable On Mon, 4 Dec 2560 at 23:10 Ted Yu wrote: > Can you describe how sourceName is inferred based on the new API ? > > Please fill out JIRA number. > > BTW here is

Re: [DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-04 Thread Ted Yu
Can you describe how sourceName is inferred based on the new API ? Please fill out JIRA number. BTW here is the URL for the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-233%3A+Simplify+StreamsBuilder%23addGlobalStore On Mon, Dec 4, 2017 at 7:39 AM, Panuwat Anawatmongkhon < panuwat.

[DISCUSS] KIP-233: Simplify StreamsBuilder#addGlobalStore

2017-12-04 Thread Panuwat Anawatmongkhon
Hi all, I created a KIP. https://cwiki.apache.org/confluence/display/KAFKA/KIP233%3A+Simplify+StreamsBuilder%23addGlobalStore Cheers, Benz