Re: Pyflink 1.13.2 convert datastream into table BIG_INT type

Hi Kamil, You need to use Types.LONG() for bigint type in Python DataStream API. See [1] for more details. Regards, Dian [1] https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/python/datastream/data_types/#supported-data-types On Sun, Nov 28, 2021 at 11:26 PM Kamil ty wrote:

Re: Field names must be unique. Found duplicates

Hi, Thanks for reporting this BUG. It seems to be a duplicate with FLINK-23919 [1] which would be solved in 1.13.4. [1] https://issues.apache.org/jira/browse/FLINK-23919 Best, Jing Zhang Ivan Budanaev 于2021年11月28日周日 下午7:18写道： > I am getting the *Field names must be unique. Found duplicates* er

How to Fan Out to 100s of Sinks

Hi all, we current have a Flink job that retrieves jsonl data from GCS and writes to Iceberg Tables. We are using Flink 13.2 and things are working fine. We now have to fan out that same data in to 100 different sinks - Iceberg Tables on s3. There will be 100 buckets and the data needs to be sen

Pyflink 1.13.2 convert datastream into table BIG_INT type

Hello I'm trying to convert a datastream into a table using: table_env.from_datastream(ds) The ds contains some fields with the Types.BIG_INT() type. Those fields seem to be converted to: RAW('java.math.BigInteger', '...'). This is seen as an error by flink which is resulting in table query and si

Field names must be unique. Found duplicates

I am getting the *Field names must be unique. Found duplicates* error when aggregating over the descriptor columns in HOP windowing function. A full description of the error can be found here . Is there a way to use the descriptor column in aggrega