Hi Kafka Team,
I'd like to bring this thread back at the top of the email stack to get a
chance to see this KIP merge in the next minor/major release.
Thanks.
Le ven. 18 janv. 2019 à 01:20, Florian Hussonnois a
écrit :
> Hey folks,
>
> This KIP has start since a while but
operation
> > >>>>>>>>> itself, so I guess it would mean the name applies to the result
> > of
> > >>>>>> the
> > >>>>>>>>> operation? It doesn't really work.
> > >>>>>>>>>
> that implements `NamedOperation` as `Named`, which would be used in our
> >>> adding overload functions. The main reason is to have consistency in
> >>> naming." And I think I'm on the same page with John with his more
> >> detailed
> >>> p
PR has been rebased)
Thanks,
Le ven. 22 sept. 2017 à 09:36, Florian Hussonnois a
écrit :
> Hi team,
>
> Are there any more votes ? Thanks
>
> Le 12 sept. 2017 20:18, "Gwen Shapira" a écrit :
>
>> Thanks for clarifying.
>>
>> +1 again :)
>>
&
-----
> > > >>> Node | X | X |
> X
> > > >>> |
> > > >>>
> > > >>
> > >
> >
> ---
confluent.io>
> > > wrote:
> > >
> > >> While I understand that it should be possible to specify store name
> and
> > >> processor name independent from each other, it's still unclear to me,
> > >> why we cannot use the `Materi
Hi folks,
I would like to initiate a vote for the following KIP :
https://cwiki.apache.org/confluence/display/KAFKA/KIP-307%3A+Allow+to+define+custom+processor+names+with+KStreams+DSL
Note, there is still some minor discussions regarding the implementation.
Thanks
--
Florian HUSSONNOIS
e `Materialized` to name the processor for this
> case, too. Can you elaborate on the motivation?
>
>
> -Matthias
>
> On 1/11/19 3:39 PM, Florian Hussonnois wrote:
> > Hi Guozhang,
> >
> > I have updated the PR as well as the KIP. I should add more unit tests to
> &g
ility, those added overloads would be not-often
>>> used functions for them anyways. And by letting existing control classes to
>>> extend Named, we can have a unified method name for static constructor as
>>> well.
>>>
>>>
>>>
>>> Guoz
sor(s) instead of allowing uses to specify a new name.
> >
> > About the inconsistency in method naming. I agree, that `as` is very
> > generic and maybe not the best choice.
> >
> > I think it might be helpful, to have a table overview in the KIP, that
> > list al
> >
> > Those are my two feedbacks!
> >
> > I hope you find this helpful, rather than frustrating. I'm sorry I didn't
> > get a chance to comment sooner.
> >
> > Thanks for the KIP, I think it will be much nicer to be able to name the
> > p
any related topic / store names.
> > * For 3, I'd vote for adding overloaded functions with Named.
> > * For 4, if users really want to name the processor she can call
> > aggregate() instead, so I think it is okay to skip this case.
> >
> >
> > Guozha
inal V value) {
> > return predicate.test(key, value);
> > }
> >
> > @Override
> > public String name() {
> > return name;
> > }
> > };
> > }
> &
t of the processor names:
> > this will in turn change the internal state store names, as well as
> > internal topic names as well, making the new application topology to be
> > incompatible with the ones. One rationale I had about this KIP is that
> > aligned this effort, moving
t; Joined.
> > >
> > > But instead of adding the "Processed" parameter to a large percentage
> of
> > > the methods, which would result in overloaded methods (which we removed
> > > quite a bit with KIP-182) what do you think of adding a method
>
Hi,
I would like to start a new discussion on following KIP :
https://cwiki.apache.org/confluence/display/KAFKA/KIP-307%3A+Allow+to+define+custom+processor+names+with+KStreams+DSL
This is still a draft.
Looking forward for your feedback.
--
Florian HUSSONNOIS
Florian Hussonnois created KAFKA-6958:
-
Summary: Allow to define custom processor names with KStreams DSL
Key: KAFKA-6958
URL: https://issues.apache.org/jira/browse/KAFKA-6958
Project: Kafka
Florian Hussonnois created KAFKA-6957:
-
Summary: Add getter to AbstractStream class to make
internalTopologyBuilder accessible outside of package
Key: KAFKA-6957
URL: https://issues.apache.org/jira/browse
ology building exception when accessing store with the method
ProcessorContext#getStateStore
Is it the desired behavior or a bug ?
--
Florian HUSSONNOIS
tions be custom implementations, or are
> there
> > some provider implementations that are general enough for Connect to
> > include them?
> >
> > Best regards,
> >
> > Randall
> >
> > On Fri, Oct 20, 2017 at 5:08 AM, Florian Hussonnois <
>
for all deployed connectors, to provide default configs or to
provide sensitive configs like user/password.
I've met these requirements on different projects.
Do you think, this feature merits a new KIP ?
Thanks,
--
Florian HUSSONNOIS
ntations.
> >
> > Randall
> >
> > On Fri, Sep 8, 2017 at 9:46 AM, Gwen Shapira wrote:
> >
> > > Basically, you are saying that the part where the comment says: "Offset
> > > data should only be read during startup or reconfiguration of a t
Hi Shapira,
We only expose the OffsetStorageReader to connector which relies on
KafkaOffsetBackingStore. The store continuesly consumes offsets from kafka
so I think we can't have stale data.
Le 8 sept. 2017 06:13, "Randall Hauch" a écrit :
> The KIP and PR expose the OffsetStorageReader, whic
torContext` and `SinkConnectorContext` to which we can add
more methods if needed, and they are very similar to `SourceTaskContext`
and `SinkTaskContext`.
Thoughts?
On Wed, Apr 5, 2017 at 3:59 PM, Florian Hussonnois
wrote:
> Hi All,
>
> Is there any feedback regarding that KIP ?
&g
ent server (for example Consul).
Do you think this two minor suggestions can deserved KIPs ?
Thanks very much.
Florian.
--
Florian HUSSONNOIS
:
> >>
> >>> +1
> >>>
> >>> On 5/18/17 8:26 AM, Bill Bejeck wrote:
> >>>> +1
> >>>>
> >>>> On Thu, May 18, 2017 at 6:54 AM, Florian Hussonnois <
> >>> fhussonn...@gmail.com>
> >>>
t; > > Thanks
> > > Eno
> > >
> > > > On 21 Apr 2017, at 05:58, Guozhang Wang wrote:
> > > >
> > > > +1. Thanks a lot for the KIP!
> > > >
> > > > Guozhang
> > > >
> > > > O
s is -- I would not add anything more to
> TaskMetadata.
> >>>
> >>> About subtopologies and tasks. We do have the concept of subtopologies
> >>> already in KIP-120. It's only missing and ID that allow to link a
> >>> subtopology to a task.
&g
Hi All,
Is there any feedback regarding that KIP ?
https://cwiki.apache.org/confluence/display/KAFKA/KIP-131+-+Add+access+to+OffsetStorageReader+from+SourceConnector
Thanks,
2017-03-14 22:51 GMT+01:00 Florian Hussonnois :
> Hi Matthias,
>
> Sorry I didn't know this page. Ths KIP
Hi All,
I would like to start the vote for the KIP-130 :
https://cwiki.apache.org/confluence/display/KAFKA/KIP+130%3A+Expose+states+of+active+tasks+to+KafkaStreams+public+API
Thanks,
--
Florian HUSSONNOIS
ng through the new
class ThreadMetadata.
Thanks,
2017-03-27 23:40 GMT+02:00 Florian Hussonnois :
> Hi Guozhang, Matthias,
>
> It's a great idea to add sub topologies descriptions. This would help
> developers to better understand topology concept.
>
> I agree that is not
quot; introduced in KIP-120, it will simply describe the
>> > whole topology possibly composed of multiple sub-topologies. So it is
>> > hard for users to tell which sub-topology is executed under which task
>> > on-the-fly.
>> >
>> > Hence I'm thinki
[
https://issues.apache.org/jira/browse/KAFKA-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927100#comment-15927100
]
Florian Hussonnois commented on KAFKA-4905:
---
Hi [~mjsax], I'm so
adding those
> metrics mentioned in my previous email would suffice even for the use case
> that you have mentioned.
>
>
> Guozhang
>
> On Wed, Mar 8, 2017 at 3:18 PM, Florian Hussonnois
> wrote:
>
> > Hi Guozhang
> >
> > Thank you for your feedback. I
[
https://issues.apache.org/jira/browse/KAFKA-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Hussonnois updated KAFKA-4905:
--
Summary: StreamPartitionAssignor doesn't respect subscriptions to assign
parti
Florian Hussonnois created KAFKA-4905:
-
Summary: StreamPartitionAssignor doesn't respect subscriptions to
asisgn partitions.
Key: KAFKA-4905
URL: https://issues.apache.org/jira/browse/KAFKA
rovementProposals-KIPsunderdiscussion
>
> Thanks,
>
> Matthias
>
>
> On 3/7/17 1:24 PM, Florian Hussonnois wrote:
> > Hi all,
> >
> > I've created a new KIP to add access to OffsetStorageReader from
> > SourceConnector
> >
> > https://cwiki.apache.o
for every instance of the
> > KafkaStreams application. I'm wondering if that is good enough for what
> you
> > are trying to achieve? If not could it be modified to include the per
> > Thread assignment?
> >
> > Thanks,
> > Damian
> >
> >
>
Hi all,
I've created a new KIP to add access to OffsetStorageReader from
SourceConnector
https://cwiki.apache.org/confluence/display/KAFKA/KIP-131+-+Add+access+to+OffsetStorageReader+from+SourceConnector
Thanks.
--
Florian HUSSONNOIS
It should be the same as
> TaskState#consumedOffsetsByPartition.keySet()
>
> Or do I miss something?
>
>
> -Matthias
>
> On 3/1/17 5:19 AM, Florian Hussonnois wrote:
> > Hi Eno,
> >
> > Yes, but the state() method only returns the global state of the
> &
:46 GMT+01:00 Eno Thereska :
> Thanks Florian,
>
> Have you had a chance to look at the new state methods in 0.10.2, e.g.,
> KafkaStreams.state()?
>
> Thanks
> Eno
> > On 1 Mar 2017, at 11:54, Florian Hussonnois
> wrote:
> >
> > Hi all,
> >
> &
Hi all,
I have just created KIP-130 to add a new method to the KafkaStreams API in
order to expose the states of threads and active tasks.
https://cwiki.apache.org/confluence/display/KAFKA/KIP+130%3A+Expose+states+of+active+tasks+to+KafkaStreams+public+API
Thanks,
--
Florian HUSSONNOIS
Florian Hussonnois created KAFKA-4819:
-
Summary: Expose states of active tasks to public API
Key: KAFKA-4819
URL: https://issues.apache.org/jira/browse/KAFKA-4819
Project: Kafka
Issue
[
https://issues.apache.org/jira/browse/KAFKA-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Hussonnois updated KAFKA-4794:
--
Affects Version/s: 0.10.2.0
> Add access to OffsetStorageReader from SourceConnec
Florian Hussonnois created KAFKA-4794:
-
Summary: Add access to OffsetStorageReader from SourceConnector
Key: KAFKA-4794
URL: https://issues.apache.org/jira/browse/KAFKA-4794
Project: Kafka
le to tell when a task has finished a file?
>
> Thanks,
> Jason
>
> On Fri, Feb 17, 2017 at 4:45 AM, Florian Hussonnois >
> wrote:
>
> > Hi Kafka Team,
> >
> > I'm developping a connector which need to monitor the progress of its
> tasks
&
ed ? I can contribute to it.
Thanks,
--
Florian HUSSONNOIS
es already, it might be worth
> > adding it IMHO. Not sure what the opinion of other is? We should make
> > sure that the feature gets accepted before you put a lot of effort in
> > it. :)
> >
> >
> > - -Matthias
> >
> > On 10/17/16 2:10 PM, Florian Hussonnoi
you think that feature would be usefull I can create a jira and
contribute to it.
Also, do I need to create a new KIP as this requires changes on a public
API ?
Thanks,
--
Florian HUSSONNOIS
ms is a little more clever in
> how partitions are assigned. It uses a custom assignor which takes into
> account the consumer's host information.
>
> Thanks,
> Jason
>
> On Thu, Sep 1, 2016 at 9:00 AM, Florian Hussonnois
> wrote:
>
> > Hi Kafka Team,
> >
>
as
> not delivered in time, and hence it was re-tried.
>
>
> Guozhang
>
>
> On Tue, Aug 30, 2016 at 2:45 AM, Florian Hussonnois >
> wrote:
>
> > Hi all,
> >
> > I am using kafka_2.11-0.10.0.1, my understanding is that the producer API
> > batche
[
https://issues.apache.org/jira/browse/KAFKA-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459658#comment-15459658
]
Florian Hussonnois commented on KAFKA-3340:
---
I have updated a pull request
Hi Kafka Team,
I would like to have your opinion before creating a new JIRA.
I'm working with the Java Consumer API. The current partition assignors use
the consumer ids to sort members before assigning partitions.
This works pretty well as long as all consumers are started into the same
JVM and
[
https://issues.apache.org/jira/browse/KAFKA-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454817#comment-15454817
]
Florian Hussonnois commented on KAFKA-4106:
---
Thank you very much, sorry to
Florian Hussonnois created KAFKA-4106:
-
Summary: Consumer / add configure method to PartitionAssignor
interface
Key: KAFKA-4106
URL: https://issues.apache.org/jira/browse/KAFKA-4106
Project
Hi all,
I am using kafka_2.11-0.10.0.1, my understanding is that the producer API
batches records per partition to send efficient requests. We can configure
batch.size to increase the throughtput.
However, in case of failure all records within the batch failed ? If that
is true, does that mean t
Florian Hussonnois created KAFKA-3922:
-
Summary: Add a copy-constructor to AbstractStream
Key: KAFKA-3922
URL: https://issues.apache.org/jira/browse/KAFKA-3922
Project: Kafka
Issue Type
ed to add a support for KStream DSL.
Also, I would like to know if you will plan to add an "external" module in
order to add contributions without impacting the kafkastreams APIs?
Please feel free to give me your feedback about my API.
Thanks for you time and the amazing work you are doin
[
https://issues.apache.org/jira/browse/KAFKA-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329482#comment-15329482
]
Florian Hussonnois commented on KAFKA-3737:
---
Hi Gwen,
My concern is
Florian Hussonnois created KAFKA-3737:
-
Summary: Closing connection during produce request should be log
with WARN level.
Key: KAFKA-3737
URL: https://issues.apache.org/jira/browse/KAFKA-3737
ed an implementation :
https://github.com/apache/kafka/pull/1179
Thanks
--
Florian HUSSONNOIS
Hi Kafka Developers,
I would like to start a new KIP like Ewan has proposed into this
discussion :
https://issues.apache.org/jira/browse/KAFKA-3496
I've created a new account into confluence but some rights are required to
create a new page.
Am I right ?
Thank you in advance,
--
Fl
[
https://issues.apache.org/jira/browse/KAFKA-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florian Hussonnois updated KAFKA-3496:
--
Summary: Add reconnect attemps policies for client (was: Add policies to
reconnection
Florian Hussonnois created KAFKA-3496:
-
Summary: Add policies to reconnection
Key: KAFKA-3496
URL: https://issues.apache.org/jira/browse/KAFKA-3496
Project: Kafka
Issue Type: Improvement
Florian Hussonnois created KAFKA-3340:
-
Summary: Add support for rebalance and adding concurrently records
with MockConsumer
Key: KAFKA-3340
URL: https://issues.apache.org/jira/browse/KAFKA-3340
Florian Hussonnois created KAFKA-2998:
-
Summary: New Consumer should not retry indefinitely if no broker
is available
Key: KAFKA-2998
URL: https://issues.apache.org/jira/browse/KAFKA-2998
Project
66 matches
Mail list logo
