+1 (non-binding)
On 2021/12/14 19:20:02 Matteo Merli wrote:
> https://github.com/apache/pulsar/issues/13306
>
>
> Pasted below for quoting convenience.
>
>
>
>
> ## Motivation
>
> In Pulsar 2.8, we have introduced a setting to control the amount of memory
> used by a client instance
+1 (non-binding)
On 2021/12/14 17:18:03 Matteo Merli wrote:
> https://github.com/apache/pulsar/issues/13302
>
> Copying here for quoting convenience
>
>
>
>
>
> ## Motivation
>
> Pulsar standalone is the "Pulsar in a box" version of a Pulsar cluster, where
> all the components are start
+1 (non-binding)
On Mon, Jan 10, 2022 at 12:39 AM Enrico Olivelli
wrote:
> +1 (binding)
>
> Enrico
>
> Il giorno lun 10 gen 2022 alle ore 07:47 Hang Chen
> ha scritto:
>
> >
> > This is the voting thread for PIP-122. It will stay open for at least 48
> > hours.
> >
> > https://github.com/apache
+1 (non-binding)
On Mon, Jan 10, 2022 at 12:40 AM PengHui Li wrote:
> +1 (binding)
>
> Penghui
>
> On Mon, Jan 10, 2022 at 4:38 PM Enrico Olivelli
> wrote:
>
> > +1 (binding)
> >
> > Enrico
> >
> > Il giorno lun 10 gen 2022 alle ore 07:45 Hang Chen
> > ha scritto:
> > >
> > > This is the votin
Before we advance further, we first need to get on the same page of the
pros and cons of allowing this feature.
If functions can access (especially the write access) other functions'
state, the data ownership will be a mess, isolation is broken and data
security might be compromised.
On Wed,
+1 (non-binding)
On Wed, Jan 5, 2022 at 7:19 AM Lan Liang wrote:
> +1
>
>
>
>
>
>
> Best Regards,
> Lan Liang
> On 12/23/2021 19:21，Haiting Jiang wrote：
> +1
>
> Thanks,
> Haiting
>
> On 2021/12/23 05:35:03 Michael Marshall wrote:
> +1
>
> - Michael
>
> On Wed, Dec 22, 2021 at 6:18 PM Sijie Guo
Hi all,
Not all modules enable the checkstyle.
I think we need to make sure the behavior is consistent across all modules.
On Wed, Jan 12, 2022 at 9:42 AM Michael Marshall
wrote:
> Hi Pulsar Community,
>
> I notice that we have had several recent PRs adding checkstyle to more
> of our modules:
+1 (non-binding)
On Wed, Jan 12, 2022 at 7:07 PM PengHui Li wrote:
> +1 (binding)
>
> This is a behavior change, which we should highlight in the release note.
>
> Penghui
>
> On Thu, Jan 13, 2022 at 12:44 AM Chris Herzog
> wrote:
>
> > +1 (non)
> >
> >
> > On Tue, Jan 11, 2022 at 9:46 PM r...@
+1 (non-binding)
This is very interesting
On Mon, Jan 17, 2022 at 5:08 AM Lan Liang wrote:
> +1, Thanks for your work!
>
>
> - lan.liang
>
>
> On 01/17/2022 20:50，ZhangJian He wrote：
> +1
>
> PengHui Li 于2022年1月17日周一 14:01写道：
>
> +1 (binding)
>
> Regards,
> Penghui
>
> On Sat, Jan 15, 2022 at
Hi All,
Just want to bring this PIP[1] to your attention. The PRs [2] have been
open for quite some time. The feature is valuable for many use cases and I
would like to help the original author to push the effort on it.
The general idea is introducing a new API for Pulsar Functions which allows
d
Hi Everyone,
I would like to call for a vote of the PIP-86 in a separate email.
Let me know if we've already done that.
On Thu, Jan 20, 2022 at 12:07 PM Enrico Olivelli
wrote:
> Neng,
>
> Il Gio 20 Gen 2022, 20:20 Neng Lu ha scritto:
>
> > Hi All,
> >
> >
https://github.com/apache/pulsar/pull/13205
Please VOTE within 48 hours.
Best Regards,
Neng Lu
Thanks for your participation.
Close the vote with 3 (+1) bindings and 1 (+1) non-bindings.
On Fri, Jan 21, 2022 at 3:19 PM 陳智弘 wrote:
> +1
>
> Niclas Hedhman 於 2022年1月22日 週六 05:27 寫道：
>
> >
> > +1, non-binding
> >
> > On 2022-01-21 21:07, Neng Lu wrote:
&g
+1 non-binding
On Thu, Feb 10, 2022 at 1:09 AM Hang Chen wrote:
> +1
>
> Best,
> Hang
>
> PengHui Li 于2022年2月10日周四 12:06写道：
> >
> > +1
> >
> > Thank you!
> >
> > - Penghui
> >
> > On Thu, Feb 10, 2022 at 3:18 AM Lari Hotari wrote:
> >
> > > +1
> > > Thank you, Michael, for volunteering to be t
+1 non-binding
On Wed, Feb 9, 2022 at 6:46 PM Matteo Merli wrote:
> +1
>
>
> --
> Matteo Merli
>
>
> On Wed, Feb 9, 2022 at 6:44 PM r...@apache.org
> wrote:
> >
> > Hello Everyone:
> >
> >
> > I hope you’ve all been doing well. In the past two months, we have
> >
> > fixed a number of bugs rel
+1 for requiring JDK11 and prepare for JDK17
On 2022/05/09 11:03:27 Enrico Olivelli wrote:
> I am sorry,
> I have missed this thread.
>
> I believe that requiring JDK17 to build and especially to RUN the
> Pulsar broker is not a good idea currently.
> Many enterprises, especially the bigger, or b
Thanks for this detailed discussion about processing guarantee and ack.
These two settings are together affecting the behavior of a running function.
One thing I want to clarify is:
AUTO_ACK setting means if the function runtime will ack messages or not.
("function runtime" here specifically ref
> For users, sink is also part of the function framework.
^^ Is this written inside any Pulsar documentation? If you look the code
closely, the source and sink are actually configurable in Java runtime. User
can actually provide their own source/sink implementation.
On 2022/05/10 01:38:48 Baozi
CK is designed this way.
>
> I'll give another example:
>
> > If AUTO_ACK is TRUE, then the JavaInstanceRunnable will be acking messages.
>
>
> And if Guarantees != ATMOST_ONCE，then the JavaInstanceRunnable not will ack
> message.
>
> > JavaInstanceRunnable
Hi All,
+1 (non-binding)
On Mon, May 23, 2022 at 5:09 AM Enrico Olivelli wrote:
> +1 (binding)
> it looks like the patch has already been committed
>
>
> https://github.com/apache/pulsar/commit/ebca19b522fd9f4496689ca7d32ede345d28511a
>
> Enrico
>
> Il giorno lun 16 mag 2022 alle ore 07:18 Hang
Some suggestions:
1. Instead of deleting the `autoAck`, keep it but not use it in the code.
And documented clearly it's deprecated for the following 2~3 release. And
then delete it.
2. For `PulsarSinkAtLeastOnceProcessor` and
`PulsarSinkEffectivelyOnceProcessor`, if `NONE` is configured, it defaul
Hi All,
Would "Preemptive" Mode make sense?
On Wed, May 11, 2022 at 8:56 AM Matteo Merli wrote:
> +1
>
>
> On Tue, May 10, 2022 at 5:56 AM Enrico Olivelli
> wrote:
>
> > Hello,
> > I created a new PIP about a new AccessMode for the Producer.
> > https://github.com/apache/pulsar/issues/15528
>
Hi All,
I'm curious to learn once the image is run as non-root, how can we debug or
investigate production issues inside a running cluster?
On Thu, May 19, 2022 at 12:14 PM Michael Marshall
wrote:
> Hello Pulsar Community,
>
> With the 2.10.0 release, our Pulsar Docker images default to run as
This is a good idea.
Also one thing i realize is people are replying with +1, is this considered
as a vote?
On Thu, May 26, 2022 at 6:26 AM mattison chao
wrote:
> +1
>
> Best,
> Mattison
>
> On Thu, 26 May 2022 at 15:25, Gavin Gao wrote:
>
> > +1
> >
> >
> > On 2022/05/26 06:31:37 Yubiao Feng
+1 (non-binding)
On Tue, May 31, 2022 at 6:21 AM Haiting Jiang
wrote:
> +1
>
> Thanks,
> Haiting
>
> On 2022/05/26 13:40:30 zhaocong wrote:
> > Hi Pulsar Community,
> >
> >
> > I would like to start a VOTE on "Support zero-copy of NIC to NIC on
> Proxy"
> > (PIP-168).
> >
> >
> > The proposal ca
Hi Michael,
Thanks for the detailed explanation.
On Thu, May 26, 2022 at 11:08 PM Michael Marshall
wrote:
> Hi Neng Lu,
>
> I put together a doc [0] that includes some tips for troubleshooting a
> non-root docker image. Some of the details depend on how you're
> deployin
t;
> >> Hi, Asaf.
> >>
> >> Thanks review.
> >>
> >>>> I'm not entirely sure that is accurate. The Effectively-Once as I
> >>> understand it is achieved using transactions, thus the consumption of
> >> that
> >>> me
Hi All,
+1 (non-binding)
On Tue, Jun 7, 2022 at 5:42 AM Enrico Olivelli wrote:
> I have left one last minute comment, can you please take a look ? then
> I will post my +1
>
> thanks
> Enrico
>
--
Best Regards,
Neng
I would suggest first having some concrete implementations in a separate
repo.
After verifying its functionality and performance, then we can move into
the main pulsar repo.
On Fri, Jun 3, 2022 at 5:09 AM Enrico Olivelli wrote:
> Overall I agree with the proposal.
> I left some minor feedback on
1. We can compose some charts/tables as https://endoflife.date/python on
the Pulsar website to help people understand the time frame.
2. Regarding the LTS release proposal, one thing I need some clarification
is will the LTS release include major new features compared to last release?
For exam
To my understanding, the Pulsar IO Connectors (i.e. Sources/Sinks) are
quite self-contained. They move data around.
If we want to enable functionality described inside the PIP (process ->
write to otherplace), can we think in another way -- allow flexible
configuring of a Pulsar Function?
Origina
Hi,
Not sure if this is too late or not, I replied in the discussion thread
about some thinking.
Whether we tweak the sink connector or we allow a flexible and general
function creation.
On Mon, Aug 1, 2022 at 5:03 PM mattison chao
wrote:
> +1 (non-binding)
>
> Best,
> Mattison
>
> On Tue, 2 Au
https://github.com/apache/pulsar/pull/11056
Based on some comments, it seems the community has previously discussed
similar issues. Just want to hear people's thoughts and see how we can move
this forward.
Best Regards,
Neng Lu
Hi All,
I've prepared a brief PIP for the pulsarclient changes we have discussed.
Please take a look and let me know what you think.
I would really appreciate it.
Best Regards,
Neng Lu
# PIP: Expose Pulsar-Client via Function/Connector BaseContext
- Status: Proposal
- Authors: Neng Lu
-
e proposal looks good to me. +1
>
> - Sijie
>
> On Wed, Jun 30, 2021 at 12:40 PM Neng Lu wrote:
> >
> > Hi All,
> >
> > I've prepared a brief PIP for the pulsarclient changes we have discussed.
> > Please take a look and let me know what you think.
> >
> > I would really appreciate it.
> >
> > Best Regards,
> > Neng Lu
>
ve assigned PIP-85 to your PIP.
> >
> > https://github.com/apache/pulsar/wiki/PIP-85:-Expose-Pulsar-Client-via-Function-Connector-BaseContext
> >
> > The proposal looks good to me. +1
> >
> > - Sijie
> >
> > On Wed, Jun 30, 2021 at 12:40 PM Neng Lu wrot
I think the reason is for keeping the original `Function` unchanged, so that
existing implemented functions are not affected.
On 2021/07/06 03:34:49 Sijie Guo wrote:
> Thank you for starting the discussion!
>
> I have added this proposal to PIP-86:
> https://github.com/apache/pulsar/wiki/PIP-86
; Is that correct?
>
> We can use reflection to check if the methods exist or not to solve 2), no?
>
> - Sijie
>
> On Tue, Jul 6, 2021 at 11:34 AM Neng Lu wrote:
> >
> > I think the reason is for keeping the original `Function` unchanged, so
> > that existi
Enrico Olivelli wrote:
> Il Mar 6 Lug 2021, 21:30 Neng Lu ha scritto:
>
> > IMHO, The old runtime should not be able to run the new functions.
>
>
> This is not possible to enforce this because we cannot change old code.
>
> >
> >
> > New functions
Based on my local test, it's fine for String Schema.
On 2021/07/19 18:47:49 Devin Bost wrote:
> > This leads to an IncompatibleClassChangeError when you have a Function or
> > a Connector that is using Schema.JSON(Pojo.class)
>
> I just noticed this detail. Do we have a sense of how often people
+1
Neng Lu
On 2021/07/19 08:44:11 "r...@apache.org" wrote:
> Hello Everyone:
>
> I hope you’ve all been doing well. In the past two months, we have
> fixed a number of bugs related to connection leaks and added
> some new features. For more information refer to:
>
never committed successfully.
I have prepared a fix here: https://github.com/apache/pulsar/pull/11435
Best Regards,
Neng Lu
+1
On 2021/07/23 16:48:42 Aaron Williams wrote:
> Hello Apache Pulsar Community,
>
> Many of us community members were having a conversation about Slack and how
> it is not working very well as a tool to answer questions from the wider
> community and we should try to push more of the questions t
Hi,
What's your new connector used for in the customer use cases?
A `pulsar-io-kafak-connector` is used for moving data between kafka and
pulsar.
But in your case, a `pulsar-io-pulsar-connector`, do you mean you want to
move data across different pulsar clusters?
On Mon, Nov 15, 2021 at 6:51 AM
lusters which belongs to different
> company or organization
>
> Thanks
> ZhangJian He
>
> Neng Lu 于2021年11月16日周二 上午2:50写道：
>
> > Hi,
> >
> > What's your new connector used for in the customer use cases?
> > A `pulsar-io-kafak-connector` is used for
+1 (non-binding)
On Mon, Nov 15, 2021 at 5:50 PM PengHui Li wrote:
> +1,
>
> Penghui
> On Nov 16, 2021, 9:27 AM +0800, Ruguo Yu , wrote:
> > Hi Community,
> >
> > The tool ` pulsar-admin` supports `set-clusters` and `get-clusters`
> command so that we can `set` / `get` replication clusters for a
Just curious to learn is there any progress on moving all the connectors into
separate repos?
Maybe I can help if the decision is finalized.
On 2021/11/17 06:18:52 Lari Hotari wrote:
> Dear Pulsar community members,
>
> PIP-62[1], "PIP 62: Move connectors, adapters and Pulsar Presto to separate
tackle.
On Wed, Nov 17, 2021 at 10:29 AM Sijie Guo wrote:
> I don't think you need a separate connector.
>
> An identity function should be able to do the job for you.
>
> - Sijie
>
> On Mon, Nov 15, 2021 at 3:34 PM Neng Lu wrote:
>
> > Just did a quick search, it&#
How about making the behavior when timeout configurable? And by default, it
will send the `CloseProducer` cmd?
On 2021/11/17 05:52:21 Michael Marshall wrote:
> Hi All,
>
> I noticed that the `ServerCnxTest#testCreateProducerTimeout` test
> indicates that a producer will send a `CloserProducer` c
+1 for dropping the schema when a topic is deleted by default.
I previously met a strange error that after creating a topic with the same name
as previous deleted topic, the "ghost" schema is associated with the new topic
again and caused a lot of confusion for us.
On 2021/11/18 03:35:50 Ruguo
Thank you Chris, I also updated the function's go runtime to utilize the most
recent release.
On 2021/11/16 05:41:11 Chris Kellogg wrote:
> The Apache Pulsar team is proud to announce Apache Pulsar Go Client version
> 0.7.0.
>
> Pulsar is a highly scalable, low latency messaging platform running
ull/12838>
Please VOTE within 72 hours.
Best Regards,
Neng Lu
elp.
Best regards,
Neng Lu
+1
On 2021/12/09 15:29:55 Michael Marshall wrote:
> Hello Pulsar Community,
>
> I'd like to propose that we release 2.7.4. We have merged several
> important fixes since we released 2.7.3 in August.
>
> I am happy to volunteer to be the release manager.
>
> Here [0] you can find the list of 36
+1
On 2023/11/15 03:39:42 Pengcheng Jiang wrote:
> Hi Pulsar Community,
>
> This thread is to start a vote for PIP-312: Use StateStoreProvider to
> manage state in Pulsar Functions endpoints.
>
> I start the voting process since there are some approves for the PIP PR.
>
> PR: https://github.com
I normally tend to be a silent observer of the community due to my
limited time schedule.
But I feel the obligation to share my thoughts in this thread so that
people are not misled.
> Most of the PIP monitoring involves adding plugins to existing
> metrics APIs. He has also contributed to the PIP
+1
This can reduce the image size significantly and thus improve the
efficiency and reduce the cost.
On Tue, Mar 5, 2024 at 11:25 PM Enrico Olivelli wrote:
> +1
>
> Great idea
>
> Enrico
>
> Il Mer 6 Mar 2024, 08:23 Zixuan Liu ha scritto:
>
> > +1
> >
> > This is a good idea, and then we must
+1
On 2024/06/28 20:51:39 Apurva Telang wrote:
> Hello All,
>
> I would like to start the voting thread for PIP-337: SSL Factory Plugin to
> customize SSL Context and SSL Engine generation
>
> PIP link: https://github.com/apache/pulsar/pull/22016
> Discuss Thread:
> https://lists.apache.org/thre
The proposal makes sense to me.
The only note I want to add is to make sure the PulsarAdmin access in Source
and Sink is also controlled by the flag `exposePulsarAdminClientEnabled`.
Similar to the following:
https://github.com/apache/pulsar/blob/master/pulsar-functions/runtime/src/main/java/or
Congratulations!
On Thu, Jan 19, 2023 at 7:18 AM Zike Yang wrote:
> Congratulations! Bo Cong
>
> BR,
> Zike Yang
>
> On Thu, Jan 19, 2023 at 6:11 PM Jiuming Tao
> wrote:
> >
> > Congrats！
> >
> > > 2023年1月18日 21:50，PengHui Li 写道：
> > >
> > > Hi all,
> > >
> > > The Apache Pulsar Project Manage
g concerns regarding this
change, we will revert the above PR fist and then make modifications to it.
Best Regards,
Neng Lu
+1 for the change.
On 2023/02/28 01:06:51 Pengcheng Jiang wrote:
> Hello, community:
>
> ### Motivation
>
> Currently, pulsar functions are using `LZ4` as the compression type, and
> users cannot change it, yet some users may want to custom this behavior.
>
> ### Modifications
>
> Add a `Compr
to introduce a new flag? Another possibility is users
> can use pulsar admin to reset the cursor to the latest position,
> Why will it not work for users?
>
> Regards,
> Penghui
>
> > On Mar 1, 2023, at 10:16, Neng Lu wrote:
> >
> > In certain failure c
e won't be reverted in this case).
On 2023/03/07 03:45:02 Neng Lu wrote:
> Hi Penghui,
>
> Thanks for your question.
>
> One case is failure recovery for a windowing function.
>
> A windowing function will ack message until its window is emitted. If the
> window funct
Hi Yunze,
+1 for separating Python client and Python Pulsar Functions pip installation.
On the Java side, the client lib and functions lib are also published
separately.
My concern is how the migration progress should look like,
1. we need to set up functions lib so that users can install it usi
Hi All,
Based on [1], Pulsar has various primitive schema types and has a very
clear mapping between java classes to primitive schema types.
But in code [2], Pulsar Function Source only handles the byte and String
java classes primitive schema mapping while default all other primitive
types to JS
+1
The SchemaInfo class is claimed to be public and stable, but it's actually
changed even between patch releases.
This is really concerning.
On Fri, May 5, 2023 at 11:51 PM tison wrote:
> PR-16380 adds a new field timestamp. With Lombok config auto-generate, it
> causes the constructor signatu
gt; a new run, functions
> > will fail to start, and this will remind users to update their function
> >
> > Regards,
> > Pengcheng Jiang
> >
> > Neng Lu 于2023年4月28日周五 06:59写道：
> >
> > > Hi All,
> > >
> > > Based on [1], Pulsar has various p
thanks for the improvements, +1
On Tue, May 30, 2023 at 2:20 AM Pengcheng Jiang
wrote:
> Hi Mesika:
>
> Thanks for the suggestions, I updated the pip, and for the rest questions:
>
> 5. yes, all config goes through arguments instead of a file
> 6. it should be a JSON string that can be deseriali
Treating the BYTES schema differently (i.e. forbid uploading it) than other
schemas will be confusing to users.
If the BYTES schema is the default schema for a new topic, then how about
saving a BYTES schema in the registry instead of saving nothing?
On Mon, Apr 17, 2023 at 8:42 PM PengHui Li
Hi Michael,
Thanks for writing the PIP for the connector secret issue.
One question I have is why not reusing the `context.getSecret()` method inside
connectors to get sensitive values.
In this way, no API/framework changes are needed and all we need to do is
update each connector to get the
+1 (binding)
On Sun, Jan 5, 2025 at 7:33 AM Tao Jiuming wrote:
> +1 nonbinding
>
> Lari Hotari 于2025年1月3日 周五17:57写道：
>
> > +1 (binding)
> >
> > -Lari
> >
> > On 2025/01/03 04:45:28 Pengcheng Jiang wrote:
> > > Hello Community,
> > >
> > > I want to start the vote for PIP-401: Support set batchin
72 matches
Mail list logo
