Re: PyFlink Kafka-Connector NoClassDefFoundError

2021-04-19 Thread Dian Fu
}]} > > as > > Types.ROW([Types.ROW([Types.STRING(), Types.STRING()])]) > > I'm aware that I would need something like Types.ARRAY here, but it seems > that only supports primitive Types as array-elements and not rows. > > Given that the JsonRowDeserializati

Aw: Re: PyFlink Kafka-Connector NoClassDefFoundError

2021-04-19 Thread G . G . M . 5611
ExecutionEnvironment.get_execution_environment() env.set_parallelism(1) kafka_props = {'bootstrap.servers': 'localhost:9092', 'group.id': 'twitter_consumers'} kafka_consumer = FlinkKafkaConsumer("twitter-stream", SimpleStringSchema(), kafka_props

Re: PyFlink Kafka-Connector NoClassDefFoundError

2021-04-18 Thread Dian Fu
Hi, You need to use the fat jar [1] as documented in the Kafka Table & SQL connector page [2]. [1] https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka_2.11/1.12.2/flink-sql-connector-kafka_2.11-1.12.2.jar

PyFlink Kafka-Connector NoClassDefFoundError

2021-04-18 Thread G . G . M . 5611
Hi, I am trying to run a very basic job in PyFlink (getting Data from a Kafka-Topic and printing the stream). In the command line I run: ./bin/flink run \ --python /home/ubuntu/load_kafka.py \ --jarfile /home/ubuntu/flink-connector-kafka_2.12-1.12.2.jar I downloaded the jar from: https://mvnr