convert DataStream to DataStream

Hi, I'm reading from a kafka topic and performing some custom AVRO deserialisation but now I want to create a change log stream from the source kafka topic. I'm currently creating a temporary view and then selecting * from that and finally changing the resultant table to a change log stream via th

Re: Accessing kafka message key from a KafkaSource

argument so that you can extract Kafka message key, > headers, timestamp, etc. > > Then pass that when you create a KafkaSource via "setDeserializer" method. > > On Wed, Dec 7, 2022 at 6:14 AM Noel OConnor wrote: >> >> Hi, >> I'm using a kafka source to re

Accessing kafka message key from a KafkaSource

Hi, I'm using a kafka source to read in messages from kafka into a datastream. However I can't seem to access the key of the kafka message in the datastream. Is this even possible ? cheers Noel

Re: Concatenating a bounded and unbounded stream

3) On Thu, Oct 27, 2022 at 5:14 AM Jin Yi wrote: > > would using a hybrid source work for you if it's the same type between the > sources? > https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/hybridsource/ > > On Wed, Oct 26, 2022 at 8:05

Concatenating a bounded and unbounded stream

Hi, I have a need to create a new stream from a bounded and unbounded stream i.e. create a stream populated with messages from the bounded stream and at the end of the bounded stream add messages from the unbounded stream to the new stream continuously. I know there's stream unions but the key here

Re: Sorting by source event time

descending order, I think you can try to set the > internal configuration `__table.exec.sort.non-temporal.enabled__` to true. > But remember it's just experimental, which may bring unexpect behavior. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Noel OCon

Sorting by source event time

Hi, I have a temporary view created from a datastream. tableEnv.createTemporaryView("productDetailsView", productStream, Schema.newBuilder() .columnByMetadata("eventTime", "TIMESTAMP_LTZ(3)", "rowtime", Boolean.TRUE) .watermar

Re: Enrichment of stream from another stream

mporal join." > > I'd try to use the SQL for the first part of the job to make this join, and > then if I need the DataStream API convert it. > > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/queries/joins/#temporal-joins > > > On Sep 17,

Enrichment of stream from another stream

Hi, I'm trying to determine the best way to enrich the event payload of a fast moving incoming stream with values in another stream which is far more slow moving. I'm converting the second stream into a table for continuous query functionality and I wonder what is the best way to take the values of

Re: DataStream and DataStreamSource

r methods extended from > SingleOutputStreamOperator. > > Best regards, > Jing > > [1] > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/overview/ > > On Wed, Sep 14, 2022 at 3:23 PM Noel OConnor wrote: >> >> Hi, >> I'm new t

DataStream and DataStreamSource

Hi, I'm new to flink and I'm trying to integrate it with apache pulsar. I've gone through the demos and I get how they work but one aspect that I can't figure out is what's the difference between a DataStream and a DataStreamSource. When would you use one over the other? cheers Noel