[
https://issues.apache.org/jira/browse/BEAM-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243863#comment-17243863
]
Piotr Szuberski edited comment on BEAM-11387 at 12/4/20, 9:47 AM:
------------------------------------------------------------------
PR https://github.com/apache/beam/pull/13026 was already blocked by the Kafka
performance tests failures, discussed at
https://github.com/apache/beam/pull/13026#discussion_r524364352 . There was a
fix done in the meantime at https://github.com/apache/beam/pull/13356
was (Author: piotr-szuberski):
I think this was the commit when perf tests succeeded
https://github.com/apache/beam/pull/13026
This PR was already blocked by the Kafka performance tests failures though,
discussed at https://github.com/apache/beam/pull/13026#discussion_r524364352 .
There was a fix done in the meantime at
https://github.com/apache/beam/pull/13356
I tried to revert Kafka version bump back to 1.0.0 at
https://github.com/apache/beam/pull/13471 but it didn't help so I don't think
bumping Kafka version was the cause. The tests are not even started so it has
to be some issue with the kubernetes setup of Kafka environment.
> Kafka performance test is failing
> ---------------------------------
>
> Key: BEAM-11387
> URL: https://issues.apache.org/jira/browse/BEAM-11387
> Project: Beam
> Issue Type: Bug
> Components: io-java-kafka, test-failures
> Reporter: Piotr Szuberski
> Priority: P1
>
> Kafka performance tests are failing due to "outside-X" service port
> allocation in kubernetes setup.
> I confirmed it's not caused by Kafka clients version update from 1.0.0 to
> 2.4.1.
> Logs from example failing job [1]:
> 07:28:23 job.batch/kafka-config-eff079ec created
> 07:28:23 Error from server (Invalid): error when creating
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml":
> Service "outside-0" is invalid: spec.ports[0].nodePort: Invalid value:
> 32400: provided port is already allocated
> 07:28:23 Error from server (Invalid): error when creating
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml":
> Service "outside-1" is invalid: spec.ports[0].nodePort: Invalid value:
> 32401: provided port is already allocated
> 07:28:23 Error from server (Invalid): error when creating
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml":
> Service "outside-2" is invalid: spec.ports[0].nodePort: Invalid value:
> 32402: provided port is already allocated
> 07:28:23 Build step 'Execute shell' marked build as failure
> [1] https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/1636/console
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
