Sorry, I mean you can create a UDTF where you can cache data from your files
and then enrich your stream with LATERAL TABLE grammar,
BTW, you can reference FileSystemLookupFunction.java[1]. If we plan to support
Lookup for filesystem, we should use this function too.
Best,
Leonard
[1]
https:/
Thx Leonard,
by UDF you mean a custom table source on s3?
Le jeu. 4 mars 2021 à 05:31, Leonard Xu a écrit :
> Hi, Eric
>
> what will be the best workaround to enrich stream of data from a kafka
> topics with statical data based on id?
>
> Currently you can put your statical data in Hive/JDBC/HBa
Hi, Eric
> what will be the best workaround to enrich stream of data from a kafka topics
> with statical data based on id?
Currently you can put your statical data in Hive/JDBC/HBase which supports
lookup the data in full table env as a workaround,.
You can also write a UDF which caches the s3 f
Hi Leonard,
Thx for your reply,
Not problem to help on the JIRA topic,
In my situation, in a full sql env, what will be the best workaround to
enrich stream of data from a kafka topics with statical data based on id?
i know how to do t in stream.
eric
Le sam. 27 févr. 2021 à 05:15, Leonard Xu a é
Hi, Eric
Firstly FileSystemTableSource doe not implement LookupTableSource which means
we cannot directly lookup a Filesystem table.
In FLINK-19830, we plan to support Processing-time temporal join any
table/views by lookup the data in join operator state which scanned from the
filesystem tabl
Hi Eric,
it looks like you ran into FLINK-19830 [1]. I'm gonna add Leonard to the
thread. Maybe, he has a workaround for your case.
Best,
Matthias
[1] https://issues.apache.org/jira/browse/FLINK-19830
On Fri, Feb 26, 2021 at 11:40 AM eric hoffmann
wrote:
> Hello
> Working with flink 1.12.1 i r
