I included the package org.apache.flink.api.common.io.compression in my
intellij project and added the class GzipInflaterInputStreamFactory.

The class just redefined the method `getCommonFileExtensions` to not
recognize "gzip". I need this because of google cloud's transcoding
<https://cloud.google.com/storage/docs/transcoding> which I can't turn off.
Essentially flink see's a .gz file in my cloud bucket and wants to read it
as a gzip, but the google filesystem that gets called is reading it as
inflated and I get the error "Not in Gzip Format".

I tried shading the jar and submitting on k8s but Flink fails to recognize
the new class. I'm wondering if there's a way to go about doing this that
doesn't require rebuilding Flink from scratch?

Warm regards,

Aaron

Reply via email to