Re: How to write from Flink to a write throttled database?

:48 PM Jing Lu wrote: > Hi Caizhi, > > Here is my current configuration: > > val dynamoDBSinkConfig: DynamoDBSinkConfig = > (new DynamoDBSinkConfig.Builder).batchSize(50).queueLimit(20).build() > > new FlinkDynamoDBSink[Row]( > dynamoDBBuilder, > "

Re: How to write from Flink to a write throttled database?

/src/main/java/com/klarna/flink/connectors/dynamodb/FlinkDynamoDBSink.java#L127 > [2] > https://github.com/klarna-incubator/flink-connector-dynamodb/blob/10e8abaec2ef5473618efba41c31484dadb9ad39/src/main/java/com/klarna/flink/connectors/dynamodb/FlinkDynamoDBSink.java#L202 > > Jing Lu 于2021年1

Re: How to write from Flink to a write throttled database?

ll eventually come to an end and finishes the job) > you might lose the last bit of result. See [1] for detail. > > [1] https://lists.apache.org/thread/qffl2pvnng9kkd51z5xp65x7ssnnm526 > > Jing Lu 于2021年12月8日周三 05:51写道： > >> Hi, community >> >> I have a Kafka stre

How to write from Flink to a write throttled database?

Hi, community I have a Kafka stream and want to use Flink for 10 minutes aggregation. However, the number of events is large, and the writes are throttled for the output database for a few seconds during an hour. I was thinking to write from Flink to another Kafka stream and using another Flink ap

Re: Flink connector sink for DynamoDB (Java8)

for Flink 1.15 >> >> Best regards, >> >> Martijn >> >> [1] >> https://issues.apache.org/jira/browse/FLINK-24229 >> >> Op do 28 okt. 2021 om 20:41 schreef Jing Lu >> >>> Hi folks, >>> >>> Is there any package for

Re: How to solve the target:jvm-1.8 error when run start-scala-shell.sh

learn-flink-sql-the-easy-way-d9d48a95ae57 > > > > Jing Lu 于2021年10月30日周六 上午2:03写道： > >> Hi Flink users, >> >> I am working on testing my code in start-scala-shell.sh. The flink >> version is: flink-1.12.0-bin-scala_2.11.tgz. I put the jar file ( >> https

How to solve the target:jvm-1.8 error when run start-scala-shell.sh

Hi Flink users, I am working on testing my code in start-scala-shell.sh. The flink version is: flink-1.12.0-bin-scala_2.11.tgz. I put the jar file ( https://mvnrepository.com/artifact/software.amazon.awssdk/sts/2.15.65) in the lib folder. Then run the start-scala-shell.sh REPL: scala> import sof

Flink connector sink for DynamoDB (Java8)

Hi folks, Is there any package for writing from flink stream to DynamoDB? I checked: https://github.com/klarna-incubator/flink-connector-dynamodb but, it supports Java11 only. My Java runtime is Java8. Thanks, Jing