yea I tried this with two pulsar streams but I'm hitting a runtime exception shown below.
I think it's related to https://issues.apache.org/jira/browse/FLINK-25444 ----------------------------------------------------------- The program finished with the following exception: The implementation of the BlockElement is not serializable. The object probably contains or references non serializable fields. org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:164) org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:132) org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:132) org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:132) org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:132) org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:69) org.apache.flink.connector.base.source.hybrid.HybridSource$HybridSourceBuilder.addSource(HybridSource.java:237) org.apache.flink.connector.base.source.hybrid.HybridSource$HybridSourceBuilder.addSource(HybridSource.java:224) org.apache.flink.connector.base.source.hybrid.HybridSource.builder(HybridSource.java:103) On Thu, Oct 27, 2022 at 5:14 AM Jin Yi <j...@promoted.ai> wrote: > > would using a hybrid source work for you if it's the same type between the > sources? > https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/hybridsource/ > > On Wed, Oct 26, 2022 at 8:05 AM Noel OConnor <noel.ocon...@gmail.com> wrote: >> >> Hi, >> I have a need to create a new stream from a bounded and unbounded >> stream i.e. create a stream populated with messages from the bounded >> stream and at the end of the bounded stream add messages from the >> unbounded stream to the new stream continuously. >> I know there's stream unions but the key here is that the order of >> messages is important. >> >> I was looking at using a source function as per this >> https://stackoverflow.com/a/48711260 but it seems that source >> functions are being deprecated. >> >> Is there an alternative method to do this ? >> >> cheers >> Noel
