Hi Jason,
The best option would indeed be to make the dimension data available in
something like a database which you can access via JDBC, HBase or Hive.
Those do support lookups.
Best regards,
Martijn
On Thu, 20 Jan 2022 at 22:11, Jason Yi <93t...@gmail.com> wrote:
> Thanks for the quick resp
Thanks for the quick response.
Is there any best or suggested practice for the use case of when we have
data sets in a filesystem that we want to use in Flink as reference data
(like dimension data)?
- Would making dimension data a Hive table or loading it into a table in
RDBMS (like MySQL)
Hi Jason,
It's not (properly) supported and we should update the documentation.
There is no out of the box possibility to use a file from filesystem as a
lookup table as far as I know.
Best regards,
Martijn
Op do 20 jan. 2022 om 18:44 schreef Jason Yi <93t...@gmail.com>
> Hello,
>
> I have da
Hello,
I have data sets in s3 and want to use them as lookup tables in Flink. I
defined tables with the filesystem connector and joined the tables to a
table, defined with the Kinesis connector, in my Flink application. I
expected its output to be written to s3, but no data was written to a sink
t
