[GitHub] [pulsar-helm-chart] lhotari commented on a change in pull request #119: Update to Pulsar 2.7.2

2021-05-14 Thread GitBox


lhotari commented on a change in pull request #119:
URL: https://github.com/apache/pulsar-helm-chart/pull/119#discussion_r632347584



##
File path: dev-func-k8s-values.yaml
##
@@ -0,0 +1,109 @@
+# 
+#  Copyright 2021 DataStax, Inc. 
+#  
+#  Licensed under the Apache License, Version 2.0 (the "License");
+#  you may not use this file except in compliance with the License.
+#  You may obtain a copy of the License at
+#  
+#  http://www.apache.org/licenses/LICENSE-2.0
+#  
+#  Unless required by applicable law or agreed to in writing, software
+#  distributed under the License is distributed on an "AS IS" BASIS,
+#  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+#  See the License for the specific language governing permissions and
+#  limitations under the License.
+#  
+# 
+
+enableAntiAffinity: no
+enableTls: no 
+enableTokenAuth: no
+restartOnConfigMapChange:
+  enabled: yes
+extra:
+  function: yes
+  burnell: yes
+  burnellLogCollector: yes

Review comment:
   Remove?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [pulsar-helm-chart] lhotari commented on a change in pull request #119: Update to Pulsar 2.7.2

2021-05-14 Thread GitBox


lhotari commented on a change in pull request #119:
URL: https://github.com/apache/pulsar-helm-chart/pull/119#discussion_r632348097



##
File path: dev-func-k8s-values.yaml
##
@@ -0,0 +1,109 @@
+# 
+#  Copyright 2021 DataStax, Inc. 
+#  
+#  Licensed under the Apache License, Version 2.0 (the "License");
+#  you may not use this file except in compliance with the License.
+#  You may obtain a copy of the License at
+#  
+#  http://www.apache.org/licenses/LICENSE-2.0
+#  
+#  Unless required by applicable law or agreed to in writing, software
+#  distributed under the License is distributed on an "AS IS" BASIS,
+#  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+#  See the License for the specific language governing permissions and
+#  limitations under the License.
+#  
+# 
+
+enableAntiAffinity: no
+enableTls: no 
+enableTokenAuth: no
+restartOnConfigMapChange:
+  enabled: yes
+extra:
+  function: yes
+  burnell: yes
+  burnellLogCollector: yes
+  pulsarHeartbeat: yes
+  pulsarAdminConsole: yes
+
+zookeeper:
+  replicaCount: 1 
+  resources:
+requests:
+  memory: 300Mi
+  cpu: 0.3
+  configData:
+PULSAR_MEM: "\"-Xms300m -Xmx300m -Djute.maxbuffer=10485760 
-XX:+ExitOnOutOfMemoryError\""
+
+bookkeeper:
+  replicaCount: 1 
+  resources:
+requests:
+  memory: 512Mi
+  cpu: 0.3
+  configData:
+BOOKIE_MEM: "\"-Xms312m -Xmx312m -XX:MaxDirectMemorySize=200m 
-XX:+ExitOnOutOfMemoryError\""
+
+broker:
+  component: broker
+  replicaCount: 1 
+  ledger:
+defaultEnsembleSize: 1 
+defaultAckQuorum: 1 
+defaultWriteQuorum: 1 
+  resources:
+requests:
+  memory: 600Mi
+  cpu: 0.3
+  configData:
+PULSAR_MEM: "\"-Xms400m -Xmx400m -XX:MaxDirectMemorySize=200m 
-XX:+ExitOnOutOfMemoryError\""
+
+autoRecovery:
+  resources:
+requests:
+  memory: 300Mi
+  cpu: 0.3 
+
+function:
+  replicaCount: 1 
+  functionReplicaCount: 1
+  runtime: "kubernetes"
+  resources:
+requests:
+  memory: 512Mi
+  cpu: 0.3
+  configData:
+PULSAR_MEM: "\"-Xms312m -Xmx312m -XX:MaxDirectMemorySize=200m 
-XX:+ExitOnOutOfMemoryError\""
+
+proxy:
+  replicaCount: 1 
+  resources:
+requests:
+  memory: 512Mi
+  cpu: 0.3
+  wsResources:
+requests:
+  memory: 512Mi
+  cpu: 0.3
+  configData:
+PULSAR_MEM: "\"-Xms400m -Xmx400m -XX:MaxDirectMemorySize=112m\""
+  autoPortAssign:
+enablePlainTextWithTLS: yes
+  service:
+autoPortAssign:
+  enabled: yes
+
+grafanaDashboards:
+  enabled: yes
+
+pulsarAdminConsole:
+  replicaCount: 1
+
+kube-prometheus-stack:
+  enabled: yes
+  prometheusOperator:
+enabled: true
+  grafana:
+enabled: true
+adminPassword: e9JYtk83*4#PM8

Review comment:
   password intentional?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [pulsar-helm-chart] lhotari commented on a change in pull request #119: Update to Pulsar 2.7.2

2021-05-14 Thread GitBox


lhotari commented on a change in pull request #119:
URL: https://github.com/apache/pulsar-helm-chart/pull/119#discussion_r632349000



##
File path: examples/test-kube-functions-minikube.yaml
##
@@ -0,0 +1,78 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+
+extra:
+  functionsAsPods: yes
+
+## deployed withh emptyDir
+volumes:
+  persistence: false
+
+# disabled AntiAffinity
+affinity:
+  anti_affinity: false
+
+# disable auto recovery
+components:
+  autorecovery: false
+  functions: yes
+
+zookeeper:
+  replicaCount: 1
+
+bookkeeper:
+  replicaCount: 1
+
+broker:
+  replicaCount: 1
+  configData:
+## Enable `autoSkipNonRecoverableData` since bookkeeper is running
+## without persistence
+autoSkipNonRecoverableData: "true"
+# storage settings
+managedLedgerDefaultEnsembleSize: "1"
+managedLedgerDefaultWriteQuorum: "1"
+managedLedgerDefaultAckQuorum: "1"
+
+proxy:
+  replicaCount: 1
+
+functions:
+  replicaCount: 1
+  runtime: kubernetes
+
+image:
+  zookeeper:
+repository: apachepulsar/pulsar-all
+tag: 2.8.0-SNAPSHOT
+  bookie:
+repository: apachepulsar/pulsar-all
+tag: 2.8.0-SNAPSHOT
+  autorecovery:
+repository: apachepulsar/pulsar-all
+tag: 2.8.0-SNAPSHOT
+  broker:
+repository: apachepulsar/pulsar-all
+tag: 2.8.0-SNAPSHOT
+  functions:
+repository: apachepulsar/pulsar-all
+tag: 2.8.0-SNAPSHOT
+  proxy:
+repository: apachepulsar/pulsar-all
+tag: 2.8.0-SNAPSHOT

Review comment:
   Is this file intentionally part of this PR?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




Re: Idea: Add "List of Contributors" to Pulsar Release Blog

2021-05-14 Thread Enrico Olivelli
This is the query I am doing:

curl https://api.github.com/repos/apache/pulsar/compare/v2.7.1...v2.7.2
| jq '[.commits[].commit.author.name] | unique'

[
  "Ali Ahmed",
  "Andrey Yegorov",
  "Binbin Guo",
  "David Kjerrumgaard",
  "Deon van der Vyver",
  "Devin Bost",
  "Enrico Olivelli",
  "Guangning E",
  "Kevin Wilson",
  "Lari Hotari",
  "Marvin Cai",
  "Masahiro Sakamoto",
  "Matteo Merli",
  "Michael Marshall",
  "Rajan Dhabalia",
  "Shen Liu",
  "Ting Yuan",
  "Vincent Royer",
  "Yong Zhang",
  "Yunze Xu",
  "Zhanpeng Wu",
  "Zike Yang",
  "baomingyu",
  "congbo",
  "dockerzhang",
  "feynmanlin",
  "hangc0276",
  "li jinquan",
  "limingnihao",
  "linlinnn",
  "lipenghui",
  "mlyahmed",
  "penghui",
  "ran"
]

If you have a better query please let me know.

I am adding the results to the Blog Post for 2.7.2

Enrico

Il giorno ven 14 mag 2021 alle ore 05:59 Jia Zhai 
ha scritto:
>
> +1
>
> On Tue, May 11, 2021 at 4:28 PM Zhiyuan Ju  wrote:
>
> > +1 That would be great for contributors as well
> >
> > Best Regards!
> > @ Zhiyuan Ju 
> >
> >
> > Jinfeng Huang  于2021年5月11日周二 上午10:42写道:
> >
> > > Thank you for sharing the instructions here. That's fantastic ~
> > >
> > > Best Regards,
> > > Jennifer
> > >
> > >
> > > On Tue, May 11, 2021 at 8:46 AM Anonymitaet _ 
> > > wrote:
> > >
> > > > As instructed by Rui Fu, we can get the contributor list via the GitHub
> > > > API, the general steps are as below.
> > > >
> > > > 1. Compare two Pulsar releases to get the number of contributors for a
> > > > release.
> > > > For example,
> > > > https://github.com/apache/pulsar/compare/v2.7.1...v2.7.2-candidate-1.
> > > >
> > > > 2. Fetch the release compare from GitHub's API (
> > > > https://docs.github.com/en/rest/reference/repos#compare-two-commits) .
> > > > For example,
> > > >
> > >
> > https://api.github.com/repos/apache/pulsar/compare/v2.7.1...v2.7.2-candidate-1
> > > > .
> > > >
> > > > 3. Use a JSON query tool to filter and get the result.
> > > >
> > > > P.S. Thanks again for Rui to share this useful tip!
> > > >
> > > > On 2021/5/11, 04:29, "Sijie Guo"  wrote:
> > > >
> > > > +1
> > > >
> > > > > About the contributors' list, I'm not sure if we can use GitHub
> > API
> > > > to
> > > > fetch.
> > > >
> > > > Should be doable from Github API. It might be worth doing some
> > > > research on
> > > > how to do that.
> > > >
> > > > - Sijie
> > > > On Sun, May 9, 2021 at 8:21 PM Dianjin Wang <
> > djw...@streamnative.io
> > > > .invalid>
> > > > wrote:
> > > >
> > > > > Hi guys,
> > > > >
> > > > > I would like to open one discussion thread for the suggestion on
> > > the
> > > > Pulsar
> > > > > release blog. Should we add a new module named "List of
> > > > Contributors" for
> > > > > the blog? This module could show the contributors involved in
> > this
> > > > release,
> > > > > encouraging much more community members to join. The following
> > can
> > > > be an
> > > > > example:
> > > > >
> > > > >  *List of Contributors*
> > > > >  The Apache Pulsar community would like to thank each one of the
> > > > > contributors that have made this release possible:
> > > > >   [ xxx, xxx...]
> > > > >
> > > > > About the contributors' list, I'm not sure if we can use GitHub
> > API
> > > > to
> > > > > fetch.
> > > > >
> > > > > Any thoughts on this?
> > > > >
> > > > > Best,
> > > > > Dianjin Wang
> > > > >
> > > >
> > > >
> > > >
> > >
> >


Re: [ANNOUNCE] New committer: Yuto Furuta

2021-05-14 Thread Dianjin Wang
Congratulations!

Best,
Dianjin Wang


On Wed, May 12, 2021 at 11:19 AM Nozomi Kurihara 
wrote:

> Hi everyone,
>
> The Project Management Committee (PMC) for Apache Pulsar
> has invited Yuto Furuta (https://github.com/k2la) to become a committer
> and we are pleased
> to announce that he has accepted.
>
> Yuto has been active in Pulsar community for the past 3 years. He has
> constantly contributed to many bug fixes and feature enhancements, in
> particular Pulsar Node.js client library.
>
> Please join us in congratulating and welcoming Yuto onboard!
>
> Thanks,
> Nozomi
>


Re: [ANNOUNCE] Apache Pulsar Go Client 0.5.0 released

2021-05-14 Thread Dianjin Wang
Well Done!
Thank all contributors for making this release happen!

Best,
Dianjin Wang


On Fri, May 14, 2021 at 2:24 AM Matteo Merli  wrote:

> The Apache Pulsar team is proud to announce Apache Pulsar Go Client
> version 0.5.0.
>
> Pulsar is a highly scalable, low latency messaging platform running on
> commodity hardware. It provides simple pub-sub semantics over topics,
> guaranteed at-least-once delivery of messages, automatic cursor management
> for
> subscribers, and cross-datacenter replication.
>
> For Pulsar release details and downloads, visit:
> https://github.com/apache/pulsar-client-go/releases/tag/v0.5.0
>
> We would like to thank the contributors that made the release possible.
>
>
> --
> Matteo Merli
> 
>


Pulsar WebSite Builder is failing

2021-05-14 Thread Enrico Olivelli
Hello,
the website builder is failing on CI, below you can find the error

Is there anyone who knows how it works and how to fix it ?
Is there a way to update it manually ?

I cannot announce 2.7.2 release until the website is updated.


this is the link:
https://github.com/apache/pulsar/runs/2581534691?check_suite_focus=true

this is the error:
Please, upgrade your dependencies to the actual version of core-js.
38596warning jest > jest-cli > jest-config > babel-core >
babel-register > core-js@2.6.12: core-js@<3.3 is no longer maintained
and not recommended for usage due to the number of issues. Because of
the V8 engine whims, feature detection in old core-js versions could
cause a slowdown up to 100x even if nothing is polyfilled. Please,
upgrade your dependencies to the actual version of core-js.
38597warning jest > jest-cli > jest-environment-jsdom > jsdom >
left-pad@1.3.0: use String.prototype.padStart()
38598warning jest > jest-cli > jest-environment-jsdom > jsdom >
request-promise-native@1.0.9: request-promise-native has been
deprecated because it extends the now deprecated request package, see
https://github.com/request/request/issues/3142
38599warning jest > jest-cli > jest-haste-map > sane >
fsevents@1.2.13: fsevents 1 will break on node v14+ and could be using
insecure binaries. Upgrade to fsevents 2.
38600warning highlight.js@9.18.5: Support has ended for 9.x series.
Upgrade to @latest
38601[2/4] Fetching packages...
38602info fsevents@1.2.13: The platform "linux" is incompatible with
this module.
38603info "fsevents@1.2.13" is an optional dependency and failed
compatibility check. Excluding it from installation.
38604error @redocly/openapi-core@1.0.0-beta.45: The engine "node" is
incompatible with this module. Expected version ">=12.0.0". Got
"10.23.3"
38605error Found incompatible module.
38606info Visit https://yarnpkg.com/en/docs/cli/install for
documentation about this command.
38607Error: Process completed with exit code 1.

Enrico


Re: Pulsar WebSite Builder is failing

2021-05-14 Thread Enrico Olivelli
Il giorno ven 14 mag 2021 alle ore 13:43 Enrico Olivelli
 ha scritto:
>
> Hello,
> the website builder is failing on CI, below you can find the error
>
> Is there anyone who knows how it works and how to fix it ?
> Is there a way to update it manually ?
>
> I cannot announce 2.7.2 release until the website is updated.
>
>
> this is the link:
> https://github.com/apache/pulsar/runs/2581534691?check_suite_focus=true
>
> this is the error:
> Please, upgrade your dependencies to the actual version of core-js.
> 38596warning jest > jest-cli > jest-config > babel-core >
> babel-register > core-js@2.6.12: core-js@<3.3 is no longer maintained
> and not recommended for usage due to the number of issues. Because of
> the V8 engine whims, feature detection in old core-js versions could
> cause a slowdown up to 100x even if nothing is polyfilled. Please,
> upgrade your dependencies to the actual version of core-js.
> 38597warning jest > jest-cli > jest-environment-jsdom > jsdom >
> left-pad@1.3.0: use String.prototype.padStart()
> 38598warning jest > jest-cli > jest-environment-jsdom > jsdom >
> request-promise-native@1.0.9: request-promise-native has been
> deprecated because it extends the now deprecated request package, see
> https://github.com/request/request/issues/3142
> 38599warning jest > jest-cli > jest-haste-map > sane >
> fsevents@1.2.13: fsevents 1 will break on node v14+ and could be using
> insecure binaries. Upgrade to fsevents 2.
> 38600warning highlight.js@9.18.5: Support has ended for 9.x series.
> Upgrade to @latest
> 38601[2/4] Fetching packages...
> 38602info fsevents@1.2.13: The platform "linux" is incompatible with
> this module.
> 38603info "fsevents@1.2.13" is an optional dependency and failed
> compatibility check. Excluding it from installation.
> 38604error @redocly/openapi-core@1.0.0-beta.45: The engine "node" is
> incompatible with this module. Expected version ">=12.0.0". Got
> "10.23.3"
> 38605error Found incompatible module.
> 38606info Visit https://yarnpkg.com/en/docs/cli/install for
> documentation about this command.
> 38607Error: Process completed with exit code 1.

it looks like the problem is in the "pulsar build  image" that still
installs Node 10 instead of Node 12

I am trying to prepare a quick fix, but I will need help from someone
who can push the image to dockerhub


Enrico

>
> Enrico