Elasticsearch 5 connector maven artifact

2017-06-08 Thread Dawid Wysakowicz
Hi devs, I tried using flink-connector-elasticsearch5_2.10 dependency: > > > org.apache.flink > > flink-connector-elasticsearch5_2.10 > > 1.3.0 > > > > But it seems it was not published with 1.3.0 release. Was it intended? I filed a JIRA for it: https

[jira] [Created] (FLINK-6876) The comment of DataStream#assignTimestampsAndWatermarks is incorrect

2017-06-08 Thread Dian Fu (JIRA)
Dian Fu created FLINK-6876: -- Summary: The comment of DataStream#assignTimestampsAndWatermarks is incorrect Key: FLINK-6876 URL: https://issues.apache.org/jira/browse/FLINK-6876 Project: Flink Issue

Save the flink KeyStream to oracle db table

2017-06-08 Thread Meera nyjen
Hi, I have started using flink recently in my application. i am trying to save a transformed data stream to an oracle db. I was currently using writeascsv(filepath), to save the data to a file. When i say data, it is the kafka message. This kafka message is a file name. I used kafka consumer to re

答复: About flink 1.3.0 release packages.

2017-06-08 Thread Zhangrucong
Hi Ted: I modify the link http://archive.apache.org/dist/flink/flink-1.2.1/ to http://archive.apache.org/dist/flink/flink-1.3.0/ The http://archive.apache.org/dist/flink/flink-1.3.0/ is exist. But there is no link in downloads html to redirect there. Thanks a lot! 发件人: Zhangrucong 发送时间: 2017年6月

re: About flink 1.3.0 release packages.

2017-06-08 Thread Zhangrucong
Hi Ted: Thanks a lot. I could not see multiple choices under: http://www.apache.org/dyn/closer.lua/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz when the flink 1.3.0 version to archive? Do you know? Thanks! 发件人: Ted Yu [mailto:yuzhih...@gmail.com] 发送时间: 2017年6月8日 21:05 收件人: Zhangrucon

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Haohui Mai
+1 There are several high impacts security vulnerabilities in JDK 7 and will not be addressed. As a result we completely moved away from JDK 7. +1 on separating the tasks of supporting Scala 2.12 and JDK 8 in two steps. On Thu, Jun 8, 2017 at 9:53 AM Greg Hogan wrote: > Is this not two diffe

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Greg Hogan
Is this not two different issues? - adding builds for Scala 2.12 - upgrading to Java version 1.8 It may be time to switch, but I haven’t seen anything in FLINK-5005 which prevents simply adding Scala 2.12 to our supported build matrix and continuing to build 2.10 / 2.11 against Java 1.7. Greg

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Flavio Pompermaier
We're not using Java 7 anymore from last year already. So +1 to upgrade to java 8 from Okkam On 8 Jun 2017 5:39 pm, "Robert Metzger" wrote: > Hi all, > > as promised in March, I want to revive this discussion! > > Our users are begging for Scala 2.12 support [1], migration to Akka 2.4 > would so

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Robert Metzger
Hi all, as promised in March, I want to revive this discussion! Our users are begging for Scala 2.12 support [1], migration to Akka 2.4 would solve a bunch of shading / dependency issues (Akka 2.4 will remove Akka's protobuf dependency [2][3]) and generally Java 8's new language features all spea

Re: FlinkML on slack

2017-06-08 Thread Robert Metzger
I'm happy to see efforts towards machine learning on Apache Flink within the community! I think its okay to have a GitHub repository for the ML stuff, but there are some rules by the ASF you have to follow: https://www.apache.org/foundation/marks/faq/#products As immediate steps, I would remove t

[jira] [Created] (FLINK-6875) Remote DataSet API job submission timing out

2017-06-08 Thread Francisco Rosa (JIRA)
Francisco Rosa created FLINK-6875: - Summary: Remote DataSet API job submission timing out Key: FLINK-6875 URL: https://issues.apache.org/jira/browse/FLINK-6875 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6874) Static and transient fields ignored for POJOs

2017-06-08 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-6874: - Summary: Static and transient fields ignored for POJOs Key: FLINK-6874 URL: https://issues.apache.org/jira/browse/FLINK-6874 Project: Flink Issue Type: Improvement

Re: FlinkML on slack

2017-06-08 Thread Stavros Kontopoulos
@Ted Yu sure. On Thu, Jun 8, 2017 at 5:18 PM, Ted Yu wrote: > Hi Stavros, > Can you add me as well ? > > Thanks > > On Wed, Jun 7, 2017 at 12:56 PM, Stavros Kontopoulos < > st.kontopou...@gmail.com> wrote: > > > Hi all, > > > > We took the initiative to create the organization for FlinkML on sla

Re: Got exception: unable to create new native thread when use BucketingSink writing to HDFS

2017-06-08 Thread Mu Kong
Hi Till Rohrmann, Thanks for the prompt response! Limiting the number of open connections to the HDFS would be great. I created an issue here in JIRA: https://issues.apache.org/jira/browse/FLINK-6873 Best regards, Mu On Thu, Jun 8, 2017 at 7:06 PM, Till Rohrmann wrote: > Hi Mu Kong, > > I thi

[jira] [Created] (FLINK-6873) Limit the number of open writers in file system connector

2017-06-08 Thread Mu Kong (JIRA)
Mu Kong created FLINK-6873: -- Summary: Limit the number of open writers in file system connector Key: FLINK-6873 URL: https://issues.apache.org/jira/browse/FLINK-6873 Project: Flink Issue Type: Impro

Re: FlinkML on slack

2017-06-08 Thread Ted Yu
Hi Stavros, Can you add me as well ? Thanks On Wed, Jun 7, 2017 at 12:56 PM, Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > Hi all, > > We took the initiative to create the organization for FlinkML on slack > (thnx Eron). > There is now a channel for model-serving >

Re: FlinkML on slack

2017-06-08 Thread Roberto Bentivoglio
Hi Pat, I've sent you the invitation. Best, Roberto On 8 June 2017 at 15:46, Pattarawat Chormai wrote: > Hi Stavros, > > Could you please also send me an invitation? > > Best, > Pat > > > On Jun 8, 2017, at 11:46 AM, Stavros Kontopoulos < > st.kontopou...@gmail.com> wrote: > > > > @Till done.

[jira] [Created] (FLINK-6872) Add MissingOverride to checkstyle

2017-06-08 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-6872: - Summary: Add MissingOverride to checkstyle Key: FLINK-6872 URL: https://issues.apache.org/jira/browse/FLINK-6872 Project: Flink Issue Type: New Feature Affects

Re: FlinkML on slack

2017-06-08 Thread Pattarawat Chormai
Hi Stavros, Could you please also send me an invitation? Best, Pat > On Jun 8, 2017, at 11:46 AM, Stavros Kontopoulos > wrote: > > @Till done. I am thinking that slack is a bit inconvenient with the > self-invite restriction, people often use > https://github.com/rauchg/slackinas as a workaro

[jira] [Created] (FLINK-6871) Obsolete instruction for changing scala version for build

2017-06-08 Thread William Saar (JIRA)
William Saar created FLINK-6871: --- Summary: Obsolete instruction for changing scala version for build Key: FLINK-6871 URL: https://issues.apache.org/jira/browse/FLINK-6871 Project: Flink Issue T

Re: About flink 1.3.0 release packages.

2017-06-08 Thread Ted Yu
Do you not see multiple choices under: http://www.apache.org/dyn/closer.lua/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz If not, try using the following link: http://www-us.apache.org/dist/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz Or this: http://www-eu.apache.org/d

[jira] [Created] (FLINK-6870) Combined batch and stream TableSource can not produce same time attributes

2017-06-08 Thread Timo Walther (JIRA)
Timo Walther created FLINK-6870: --- Summary: Combined batch and stream TableSource can not produce same time attributes Key: FLINK-6870 URL: https://issues.apache.org/jira/browse/FLINK-6870 Project: Flink

Re: Got exception: unable to create new native thread when use BucketingSink writing to HDFS

2017-06-08 Thread Till Rohrmann
Hi Mu Kong, I think this is a problem with how the BucketingSink works. It keeps for each file a writer which has an open file stream. I think we should limit the number of open writers such that we don't run into the problem of too many open file handles/open HDFS connections. Could you open a J

Re: [DISCUSS]: Integrating Flink Table API & SQL with CEP

2017-06-08 Thread Till Rohrmann
Thanks for sharing your ideas with the community. I really like the design document and think that it's a good approach to follow Oracle's SQL extension for pattern matching. Looking forward to having support for SQL with CEP capabilities :-) Cheers, Till On Thu, Jun 8, 2017 at 8:57 AM, Jark Wu

Re: FlinkML on slack

2017-06-08 Thread Stavros Kontopoulos
@Till done. I am thinking that slack is a bit inconvenient with the self-invite restriction, people often use https://github.com/rauchg/slackinas as a workaround. I raised the question on slack if it makes sense to move to gitter or stay with slack for now (as any in the slack team can also send in

Re: FlinkML on slack

2017-06-08 Thread Till Rohrmann
HI Stavros, could you also send me an invite. Thanks. Cheers, Till On Thu, Jun 8, 2017 at 11:28 AM, Aljoscha Krettek wrote: > Thanks! > > > On 8. Jun 2017, at 11:21, Stavros Kontopoulos > wrote: > > > > Hi Aljoscha, > > > > Slack is invite only to the best of my knowledge, I just sent you an

Re: FlinkML on slack

2017-06-08 Thread Aljoscha Krettek
Thanks! > On 8. Jun 2017, at 11:21, Stavros Kontopoulos > wrote: > > Hi Aljoscha, > > Slack is invite only to the best of my knowledge, I just sent you an > invitation. > > Best, > Stavros > > > On Thu, Jun 8, 2017 at 11:31 AM, Aljoscha Krettek > wrote: > >> Hi, >> >> Is the slack invite

Re: FlinkML on slack

2017-06-08 Thread Stavros Kontopoulos
Hi Aljoscha, Slack is invite only to the best of my knowledge, I just sent you an invitation. Best, Stavros On Thu, Jun 8, 2017 at 11:31 AM, Aljoscha Krettek wrote: > Hi, > > Is the slack invite based? If yes, could you please send me one? > > Best, > Aljoscha > > > On 7. Jun 2017, at 21:56,

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-08 Thread Aljoscha Krettek
Yes, there is a workaround, as mentioned in the other thread: https://lists.apache.org/thread.html/eb7e256146fbe069a4210e1690fac5d3453208fab61515ab1a2f6bf7@%3Cuser.flink.apache.org%3E

Re: FlinkML on slack

2017-06-08 Thread Aljoscha Krettek
Hi, Is the slack invite based? If yes, could you please send me one? Best, Aljoscha > On 7. Jun 2017, at 21:56, Stavros Kontopoulos > wrote: > > Hi all, > > We took the initiative to create the organization for FlinkML on slack > (thnx Eron). > There is now a channel for model-serving >

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-08 Thread Till Rohrmann
There should be an easy work-around for this problem. Start a standalone cluster and run the queries against this cluster. But I also see that it might be annoying for users who used to do it differently. The basic question here should be whether we want the users to use the LocalFlinkMiniCluster i

Got exception: unable to create new native thread when use BucketingSink writing to HDFS

2017-06-08 Thread Mu Kong
Hi all, I am new to flink. I tried to start a cluster over 3 servers, and the process speed was GREAT. However, after several hours' streaming, I got this error: *java.lang.OutOfMemoryError: unable to create new native thread* From: at org.apache.flink.streaming.connectors.fs.StreamWriterBase

[jira] [Created] (FLINK-6869) Scala serializers do not have the serialVersionUID specified

2017-06-08 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6869: -- Summary: Scala serializers do not have the serialVersionUID specified Key: FLINK-6869 URL: https://issues.apache.org/jira/browse/FLINK-6869 Project: Flink