Flink 1.20.x does not allow me to unpack/repack the json as a string into
the array of rows as a complex structure...
my inbound json payload is packed into a column called "data" as type
jsonb...
with the 1.20.x functionality I can't unpack jsonify it... and the
functionality needed is only in 2
Hi,
I am trying to figure out why AutoScaler is not working. I have deployed my
Flink job on Yarn using AWS EMR.
My configurations are:
job.autoscaler.enabled: 'true'
job.autoscaler.decision.interval: 10m
job.autoscaler.stabilization.interval: 50m
job.autoscaler.vertex.min-parallelism: 35
jobmana
Hi there
Had a look was/is using this setting on the CDC source, see below.
CREATE OR REPLACE TABLE postgres_catalog.inbound.adults (
id BIGINT -- This is a postgresql Serial generated field
,nationalid VARCHAR(14) -- NOT NULL
,data STRING -- JSONB Payload
,created_at TIMESTAMP_LTZ(3)
,WATERMARK
Thank you.Will give this a try and see if using 2.0 gives me the extra functionality to unpack my payload. Although if I follow the docs the extra functionality is only part of 2.2.Sent from my iPhoneGeorge Leonard__george...@gmail.com+27 82 655 2466On 18 Sep 2025, at 03:55,
Hi George,
Please use ,'scan.incremental.snapshot.enabled'= 'true' . The old
SouceFunction has been removed in flink 2.0. Otherwise, you can use flink
1.20.
Best,
Hongshun
On Sun, Sep 14, 2025 at 11:48 PM George wrote:
> Hi all...
>
> Below is the jars included in my flink 2.0 build. and th
Hi all
Anyone have any ideas here, that can come up with a working solution/sql
for 1.20.2
G
On Tue, Sep 16, 2025 at 9:04 AM George wrote:
> Hi Dylon
>
> Not to worry about the CDC bit, was just background information. Basically
> I'm posting the record/document into a column called data, Flin
Hi Zakelly,
On my side, we've pulled and deployed the fix from the release-1.20
branch[1] in our production canary deployments, and we haven't seen any
NPEs for ~3 days now.
Thanks so much for the quick fix!
Kevin
On Wed, Sep 10, 2025 at 8:24 AM Zakelly Lan wrote:
> Hi Kevin,
>
> We’ve merged
Hi,
We are in the process of upgrading our Flink applications from Flink 1.20.2
to Flink 2.0.
Our application is running in production environments on various sites.
We have not found a working/reliable procedure for migrating the savepoints
from Flink 1.20.2 to Flink 2.0, even though we struggled
