Sorry, fat finger send before I finished writing….
Hello,
I’m trying to set up my flink native Kubernetes cluster with High
availability. Here’s the relevant config:
kubernetes.service-account: flink-service-account
high-availability:
org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
high-availability.storageDir:
s3://corvana-target-file-upload-k8s-usw2.dev.sugar.build/flink/recovery
I’m getting an error accessing the bucket.
2021-06-08 14:33:42,189 DEBUG com.amazonaws.services.s3.AmazonS3Client
[] - Bucket region cache doesn't have an entry for
corvana-target-file-upload-k8s-usw2.dev.sugar.build. Trying to get bucket
region from Amazon S3.
2021-06-08 14:33:42,193 DEBUG com.amazonaws.util.json.Jackson
[] - Failed to parse JSON string.
com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map
due to end-of-input
at [Source: (String)""; line: 1, column: 0]
at
com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
~[flink-s3-fs-presto-1.13.0.jar:1.13.0]
Is there an additional config I need for specifying the region for the bucket?
I’ve been searching the doc and haven’t found anything like that.
From: Kurtis Walker <[email protected]>
Date: Tuesday, June 8, 2021 at 10:55 AM
To: user <[email protected]>
Subject: Using s3 bucket for high availability
Hello,
I’m trying to set up my flink native Kubernetes cluster with High
availability. Here’s the relevant config:
