Just to confirm, I would need to use writeAsText instead of the the
FileSink?
On Mon, Mar 14, 2022 at 11:21 AM Martijn Visser
wrote:
> Hi Bobby,
>
> You can already use it for writing in Flink 1.14 [1] as long as you're
> aware of the implications in case of a failure / need to recover.
>
> Best
Hi Bobby,
You can already use it for writing in Flink 1.14 [1] as long as you're
aware of the implications in case of a failure / need to recover.
Best regards,
Martijn
[1]
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/filesystems/gcs/
On Mon, 14 Mar 2022 at 16:00,
Thanks Martijn, are there any alternatives to write to GCS using Flink
1.14? Recoverability isn't important for my current use case.
On Mon, Mar 14, 2022 at 10:58 AM Martijn Visser
wrote:
> Hi Bobby,
>
> That's because Flink 1.14 currently doesn't support the RecoverableWriter
> for GCS. This wi
Hi Bobby,
That's because Flink 1.14 currently doesn't support the RecoverableWriter
for GCS. This will be supported as of Flink 1.15, which you can see in the
relevant Flink Jira ticket [1]. For more details on why RecoverableWriter
is important, the JavaDoc [2] is probably the best source of info
I am receiving the following exception when attempting to write to GCS with
the FileSink in FLink 14.3. Using flink hadoop shaded 2.8.3-10.0 and gcs
connector hadoop2-2.1.1.
java.lang.UnsupportedOperationException: Recoverable writers on Hadoop are
only supported for HDFS
I am able to write chec
