2019-10-16 14:00:51 UTC - Marvin Cai: Is there some problem with test Jenkins server? Got error when running tests Caused: java.io.IOException: Cannot run program “mvn” (in directory “/home/jenkins/jenkins-slave/workspace/pulsar_precommit_java8"): error=2, No such file or directory, <https://builds.apache.org/job/pulsar_precommit_java8/12224/console> ---- 2019-10-16 15:00:15 UTC - Sijie Guo: I think there were issues regarding ASF jenkins machines. ---- 2019-10-16 15:00:31 UTC - Sijie Guo: We can update the jobs to exclude those machines. ---- 2019-10-16 15:44:05 UTC - Marvin Cai: got it, thanks! ---- 2019-10-16 18:17:32 UTC - Jerry Peng: You can also implement your own KubernetesSecretsProviderConfigurator and you will provide the CA cert as a secret that will be written to the pod on startup ---- 2019-10-16 19:50:16 UTC - Ali Ahmed: @Matteo Merli @Sijie Guo I have created a ticket for apache infra to enable appveyor am also going to create a sample appveyor job in fork similar to this <https://github.com/GostCryptTeam/gostcrypt/blob/810d5d646720fd9f202a9582cb7dd45ae0c27524/.appveyor.yml> ---- 2019-10-16 19:52:37 UTC - Sijie Guo: Thank you :pray: ---- 2019-10-16 22:11:44 UTC - Addison Higham: okay, I have two commits that enhance the kubernetes runtime: <https://github.com/apache/pulsar/pull/5398> <- adds the ability for the kubernete secret token provider to also push out CA information <https://github.com/apache/pulsar/pull/5400> >- adds an interface that allows for the generation of k8s manifests to be customized
I have them back-ported to 2.4 where they are working in our cluster. Makes it so we can very easily put our functions on different pools of compute and didn't have to implement any interfaces in order to get the CA into the functions worker ---- 2019-10-16 22:13:07 UTC - Addison Higham: I was going to try and do a bit of a writeup first on the k8s manifest customization... but it ended up going quick enough that I figured it made sense just to open the PR. Happy to change some approach there though if there are any other ideas... ---- 2019-10-17 01:30:24 UTC - Ali Ahmed: @Sijie Guo @Matteo Merli A bit of bad news appveyor seems to work fine and has good test report generation also, but hte jobs for the free tier are limited to 60mins . we could trying splitting up and job and introducing remote caching to get arounf the problem but not sure about it. other piece of information is git hub actions will be GA on November 23rd ---- 2019-10-17 01:36:22 UTC - Ali Ahmed: assuming the GA date is correct the best thing to do would be just to enable github actions straight away, apache spark have already done there migration ---- 2019-10-17 01:37:17 UTC - Matteo Merli: we cannot enable it straight away. It requires pushing to a branch in the apache/pulsar repo ---- 2019-10-17 01:42:31 UTC - Ali Ahmed: we can ask to disable apache jenkins checks disabled, push the existing github action pr and we should be set , The commits will still require +1 from committers but doesn’t require the jobs to pass. ---- 2019-10-17 01:42:41 UTC - Ali Ahmed: we can do the rest in phase 2 ---- 2019-10-17 01:43:18 UTC - Matteo Merli: we cannot do that for 1 month ---- 2019-10-17 01:57:12 UTC - Ali Ahmed: should we invest in a bot strategy with mirroring for the next month or so ? ----
