Re: Flink Kinesis Producer con't connect with AWS credentials

2022-01-03 Thread Daniel Vol
ev/connectors/kinesis.html#kinesis-producer > > On Fri, Dec 31, 2021 at 1:06 PM Daniel Vol wrote: > >> Hi, >> >> I am trying to run a Flink on GCP with the current source and >> destination on Kinesis on AWS. >> I have configured the access key on AWS to b

Flink Kinesis Producer con't connect with AWS credentials

2021-12-31 Thread Daniel Vol
Hi, I am trying to run a Flink on GCP with the current source and destination on Kinesis on AWS. I have configured the access key on AWS to be able to connect. I am running Flink 1.12.1 In flink I use the following code (Scala 2.12.2) val props = new Properties props.put(AWSConfigConstants.AWS_A

Flink restarts on Checkpoint failure

2021-09-01 Thread Daniel Vol
Hello, I see the following error in my jobmanager log (Flink on EMR): Checking cluster logs I see : 2021-08-21 17:17:30,489 [Checkpoint Timer] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 1 (type=CHECKPOINT) @ 1629566250303 for job c513e9ebbea4ab72d80b133

Re: Odd Serialization exception

2021-08-12 Thread Daniel Vol
e super.open(…) function which would leave the > producer only half initialized > > > > Thias > > > > > > > > > > *From:* Daniel Vol > *Sent:* Donnerstag, 12. August 2021 08:01 > *To:* Guowei Ma > *Cc:* user > *Subject:* Re: Odd Serialization exceptio

Re: Odd Serialization exception

2021-08-11 Thread Daniel Vol
open()" method Thanks! On Thu, Aug 12, 2021 at 8:44 AM Guowei Ma wrote: > Hi, Daniel > Could you tell me the version of Flink you use? I want to look at the > corresponding code. > Best, > Guowei > > > On Wed, Aug 11, 2021 at 11:23 PM Daniel Vol wrote: > >>

Re: Odd Serialization exception

2021-08-11 Thread Daniel Vol
cations (on the mailing list) Cheers Thias *From:* Daniel Vol *Sent:* Mittwoch, 11. August 2021 14:47 *To:* user@flink.apache.org *Subject:* Odd Serialization exception I started to get the following exception: 2021-08-11 09:45:30,299 [Window(EventTimeSessionWindows(180), E

Odd Serialization exception

2021-08-11 Thread Daniel Vol
I started to get the following exception: 2021-08-11 09:45:30,299 [Window(EventTimeSessionWindows(180), EventTimeTrigger, SessionAggregator, PassThroughWindowFunction) -> Sink: Unnamed (1/8)] INFO o.a.f.s.runtime.tasks.SubtaskCheckpointCoordinatorImpl - Could not complete snapshot 134 for ope