Re: Custom source with multiple, differently typed outputs

2021-02-11 Thread Arvid Heise
Hi Roman, In general, the use of inconsistent types is discouraged but there is little that you can do on your end. I think your approach with SourceFunction is good but I'd probably not use Row already but rather some POJO or source format record. Note, that I have never seen side-outputs in a s

Custom source with multiple, differently typed outputs

2021-02-09 Thread Roman Karlstetter
Hi everyone, I want to connect to a proprietary data stream, which sends different types of messages (maybe interpreted as a table), intertwined in the stream. Every type of message (or table) can have a different schema, but for each type this schema is known when connecting (i.e., at runtime) an