Re: Unable to write snapshots to S3 on EMR

Hi Andy, I believe it's because you didn't set your s3 impl correctly. Try to set your core-site.xml by following https://ci.apache.org/ projects/flink/flink-docs-release-1.4/ops/deployment/aws.html#s3afilesystem- recommended Bowen On Fri, Oct 6, 2017 at 7:59 AM, Andy M. wrote: > Hi Till, > >

Issue of Twitter streaming with CustomEndpoint

Hi, I am following Apache Flink Twitter streaming example given in https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/twitter/TwitterExample.java to get the tweets using hashtag, for which I have created a custom en

[jira] [Created] (FLINK-7775) Remove unreferenced method PermanentBlobCache#getNumberOfCachedJobs

Ted Yu created FLINK-7775: - Summary: Remove unreferenced method PermanentBlobCache#getNumberOfCachedJobs Key: FLINK-7775 URL: https://issues.apache.org/jira/browse/FLINK-7775 Project: Flink Issue Ty

Re: Unable to write snapshots to S3 on EMR

Hi Till, Seems like everything is in line there. hadoop-common.jar -> hadoop-common-2.7.3-amzn-3.jar And when i decompiled that jar I see public void addResource(Configuration conf) in org/apache/hadoop/conf/Configuration.java I agree that an incorrect version of the jar is probably being run,

Re: Dependency convergence

+2 ;-) > On 5. Oct 2017, at 11:26, Till Rohrmann wrote: > > +1 for pulling our dependencies straight and guarding it via the > maven-enforcer-plugin. > > On Wed, Oct 4, 2017 at 8:58 PM, Piotr Nowojski > wrote: > >> I meant for whole flink project. >> >>> On Oct 4, 2017, at 8:43 PM, Bowen Li

[jira] [Created] (FLINK-7774) Deserializers are not cleaned up when closing input streams

Nico Kruber created FLINK-7774: -- Summary: Deserializers are not cleaned up when closing input streams Key: FLINK-7774 URL: https://issues.apache.org/jira/browse/FLINK-7774 Project: Flink Issue

[jira] [Created] (FLINK-7773) Test instability in UtilsTest#testYarnFlinkResourceManagerJobManagerLostLeadership

Nico Kruber created FLINK-7773: -- Summary: Test instability in UtilsTest#testYarnFlinkResourceManagerJobManagerLostLeadership Key: FLINK-7773 URL: https://issues.apache.org/jira/browse/FLINK-7773 Project:

Re: Unable to write snapshots to S3 on EMR

Hi Andy, could you check which Hadoop version this jar /usr/lib/hadoop/hadoop-common.jar is? Maybe also checking whether the contained hadoop Configuration class has the method Configuration.addResource(Lorg/apache/hadoop/conf/Configuration;)V. Maybe this jar is the culprit because it comes from a

[jira] [Created] (FLINK-7772) Test instability in BlobCacheDeleteTest

Nico Kruber created FLINK-7772: -- Summary: Test instability in BlobCacheDeleteTest Key: FLINK-7772 URL: https://issues.apache.org/jira/browse/FLINK-7772 Project: Flink Issue Type: Bug C

[jira] [Created] (FLINK-7771) Make the operator state queryable

Kostas Kloudas created FLINK-7771: - Summary: Make the operator state queryable Key: FLINK-7771 URL: https://issues.apache.org/jira/browse/FLINK-7771 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7769) Move Queryable State outside the runtime.

Kostas Kloudas created FLINK-7769: - Summary: Move Queryable State outside the runtime. Key: FLINK-7769 URL: https://issues.apache.org/jira/browse/FLINK-7769 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-7770) Hide Queryable State behind a proxy.

Kostas Kloudas created FLINK-7770: - Summary: Hide Queryable State behind a proxy. Key: FLINK-7770 URL: https://issues.apache.org/jira/browse/FLINK-7770 Project: Flink Issue Type: Improvement