Re: [QUESTION] OutOfMemoryError when writing into HDFS

2017-06-11 Thread Mu Kong
Hi Ted, Thanks for the useful link there. Actually, I just found out that the error might be triggered by a kerberos issue in our system. I'll use the ticket cache and execute kinit in crontab to see if it is the case. But thanks for the link you provided. I'll definitely check it :) Best regar

Re: [QUESTION] OutOfMemoryError when writing into HDFS

2017-06-11 Thread Ted Yu
Can you see if the following post helps in troubleshooting ? https://blog.fastthread.io/2016/07/06/troubleshoot-outofmemoryerror-unable-to-create-new-native-thread/ Thanks On Sun, Jun 11, 2017 at 6:01 PM, Mu Kong wrote: > Hi all, > > Thanks a lot for your work for the community! > > This quest

[QUESTION] OutOfMemoryError when writing into HDFS

2017-06-11 Thread Mu Kong
Hi all, Thanks a lot for your work for the community! This question is more like a discuss. Currently, I'm experiencing an *OutOfMemoryError* when writing files from Kafka into HDFS using *BucketingSink*. The log looks like this: 2017-06-10 08:58:42,248 INFO org.apache.flink.runtime.taskmanager

Re: [DISCUSS] GitBox

2017-06-11 Thread Ufuk Celebi
I would also like to see this happening for both flink-web and flink if it allows committers to have control over the respective repos. On Sat, Jun 10, 2017 at 4:05 PM, Chesnay Schepler wrote: > What are the downsides of this? Actually, is there any ASF resource that > outlines what this would en

Re: FlinkML on slack

2017-06-11 Thread Ziyad Muhammed
Hi Stavros Could you please send me an invite to the slack channel? Best Ziyad On Sun, Jun 11, 2017 at 1:53 AM, Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > @Henry @Tao @Martin invitations sent... Thnx @Theo for handling the Apache > compliance issues. > > Best, > Stavros > > On Sa

[jira] [Created] (FLINK-6888) Can not determine TypeInformation of ACC type of AggregateFunction when ACC is a Scala case/tuple class

2017-06-11 Thread Jark Wu (JIRA)
Jark Wu created FLINK-6888: -- Summary: Can not determine TypeInformation of ACC type of AggregateFunction when ACC is a Scala case/tuple class Key: FLINK-6888 URL: https://issues.apache.org/jira/browse/FLINK-6888

[jira] [Created] (FLINK-6887) Split up CodeGenerator into several specific CodeGenerator

2017-06-11 Thread Jark Wu (JIRA)
Jark Wu created FLINK-6887: -- Summary: Split up CodeGenerator into several specific CodeGenerator Key: FLINK-6887 URL: https://issues.apache.org/jira/browse/FLINK-6887 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6886) Fix Timestamp field can not be selected in event time case when toDataStream[T], `T` not a `Row` Type.

2017-06-11 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6886: -- Summary: Fix Timestamp field can not be selected in event time case when toDataStream[T], `T` not a `Row` Type. Key: FLINK-6886 URL: https://issues.apache.org/jira/browse/FLINK-6886