an" , g.g.m.5...@web.de, "user"
Betreff: Re: JSON source for pyflink stream
Hi Giacomo,
All the connectors supported in the Table & SQL connectors could be used in PyFlink Table API and so you could use file system connector in PyFlink Table API. AFAIK, it supports new line de
Hi Giacomo,
All the connectors supported in the Table & SQL connectors could be used in
PyFlink Table API and so you could use file system connector in PyFlink
Table API. AFAIK, it supports new line delimited json in the
filesystem connector in Flink 1.12. You could refer to [1] for more details.
Hi,
We are loading our JSON from a Mongo Database. But we also found no readily
available way to stream JSON Data into a Flink Pipeline. I guess this would be
hard to implement since you have to know details about the JSON structure to do
this. So I guess your best bet would be to implement you
Hi Giacomo,
I think you can try using Flink SQL connector. For JSON input such as {"a":
1, "b": {"c": 2, {"d": 3}}}, you can do:
CREATE TABLE data (
a INT,
b ROW>
) WITH (...)
Let me know if that helps.
Best,
Yik San
On Wed, Apr 14, 2021 at 2:00 AM wrote:
> Hi,
> I'm new to Flink and I a
Hi,
I'm new to Flink and I am trying to create a stream from locally downloaded tweets. The tweets are in json format, like in this example:
{"data":{"text":"Polsek Kakas Cegah Covid-19 https://t.co/ADjEgpt7bC","public_metrics":"retweet_count":0,"reply_count":0,"like_count":0,"quote_count":0},
"a
