Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-07-14 Thread Kamil Wasilewski
gt;>>>>> org.apache.beam.sdk.io.kafka.KafkaUnboundedSource.createReader(KafkaUnboundedSource.java:121)\n\tat >>>>>>>>>> org.apache.beam.sdk.io.kafka.KafkaUnboundedSource.createReader(KafkaUnboundedSource.java:43)\n\t

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-07-13 Thread Kamil Wasilewski
essBundleContext.output(FnApiDoFnRunner.java:1335)\n\tat >>>>>>>>> org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:75)\n\tat >>>>>>>>> org.apache.beam.sdk.io.Read$UnboundedSo

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-18 Thread Piotr Filipiuk
.harness.FnApiDoFnRunner.processElementForSplitRestriction(FnApiDoFnRunner.java:715)\n\tat >>>>>>>> org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:216)\n\tat >>>>>>>> o

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-18 Thread Chamikara Jayalath
t; org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForPairWithRestriction(FnApiDoFnRunner.java:688)\n\tat >>>>>>> org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:216)\n\tat >>>>>&g

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-18 Thread Piotr Filipiuk
piDoFnRunner.access$600(FnApiDoFnRunner.java:121)\n\tat >>>>>> org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:1340)\n\tat >>>>>> org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContext.o

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-12 Thread Piotr Filipiuk
llectionConsumerRegistry.java:179)\n\tat >>>> org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:177)\n\tat >>>> org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:106)\n\tat >

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-08 Thread Heejong Lee
PoolExecutor.java:624)\n\tat >>> java.lang.Thread.run(Thread.java:748)\n" >>> log_location: "org.apache.beam.fn.harness.data.QueueingBeamFnDataClient" >>> >>> On Fri, Jun 5, 2020 at 3:57 PM Piotr Filipiuk >>> wrote: >>&

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-08 Thread Chamikara Jayalath
pache.beam.fn.harness.data.QueueingBeamFnDataClient" >> >> On Fri, Jun 5, 2020 at 3:57 PM Piotr Filipiuk >> wrote: >> >>> Thank you for the suggestions. >>> >>> Neither Kafka nor Flink run in a docker container, they all run locally. >>>

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-08 Thread Chamikara Jayalath
t;> error, see attached. >> >> On Fri, Jun 5, 2020 at 3:47 PM Venkat Muthuswamy < >> venkat_pack...@yahoo.com> wrote: >> >>> Is Kafka itself running inside another container? If so inspect that >>> container and see if it has a network alias and add th

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-08 Thread Piotr Filipiuk
etwork alias and add that alias to your >> /etc/hosts file and map it to 127.0.0.1. >> >> >> >> *From:* Chamikara Jayalath >> *Sent:* Friday, June 5, 2020 2:58 PM >> *To:* Luke Cwik >> *Cc:* user ; dev ; Heejong >> Lee >> *Subject:* Re:

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-05 Thread Piotr Filipiuk
ne 5, 2020 2:58 PM > *To:* Luke Cwik > *Cc:* user ; dev ; Heejong Lee > > *Subject:* Re: Python SDK ReadFromKafka: Timeout expired while fetching > topic metadata > > > > Is it possible that "'localhost:9092'" is not available from the Docker > enviro

RE: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-05 Thread Venkat Muthuswamy
Subject: Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata Is it possible that "'localhost:9092'" is not available from the Docker environment where the Flink step is executed from ? Can you try specifying the actual IP address of the node runn

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-05 Thread Chamikara Jayalath
Is it possible that "'localhost:9092'" is not available from the Docker environment where the Flink step is executed from ? Can you try specifying the actual IP address of the node running the Kafka broker ? On Fri, Jun 5, 2020 at 2:53 PM Luke Cwik wrote: > +dev +Chamikara Jayalath > +Heejong

Re: Python SDK ReadFromKafka: Timeout expired while fetching topic metadata

2020-06-05 Thread Luke Cwik
+dev +Chamikara Jayalath +Heejong Lee On Fri, Jun 5, 2020 at 8:29 AM Piotr Filipiuk wrote: > I am unable to read from Kafka and getting the following warnings & errors > when calling kafka.ReadFromKafka() (Python SDK): > > WARNING:root:severity: WARN > timestamp { > seconds: 1591370012 >