"Unable to find registrar for hdfs" on Flink cluster

2017-08-28 Thread P. Ramanjaneya Reddy
Hi All, build jar file from the beam quickstart. while run the jar on Flinkcluster got below error.? anybody got this error? Could you please help how to resolve this? root1@master:~/NAI/Tools/flink-1.3.0$ *bin/flink run -c org.apache.beam.examples.WordCount /home/root1/NAI/Tools/word-count-beam

[jira] [Created] (FLINK-7548) Support watermark generation for TableSource

2017-08-28 Thread Jark Wu (JIRA)
Jark Wu created FLINK-7548: -- Summary: Support watermark generation for TableSource Key: FLINK-7548 URL: https://issues.apache.org/jira/browse/FLINK-7548 Project: Flink Issue Type: Bug Comp

[jira] [Created] (FLINK-7547) o.a.f.s.api.scala.async.AsyncFunction is not declared Serializable

2017-08-28 Thread Elias Levy (JIRA)
Elias Levy created FLINK-7547: - Summary: o.a.f.s.api.scala.async.AsyncFunction is not declared Serializable Key: FLINK-7547 URL: https://issues.apache.org/jira/browse/FLINK-7547 Project: Flink I

[jira] [Created] (FLINK-7546) Support SUBMULTISET_OF Operator for Multiset SQL type

2017-08-28 Thread Shuyi Chen (JIRA)
Shuyi Chen created FLINK-7546: - Summary: Support SUBMULTISET_OF Operator for Multiset SQL type Key: FLINK-7546 URL: https://issues.apache.org/jira/browse/FLINK-7546 Project: Flink Issue Type: New

[jira] [Created] (FLINK-7545) Support MEMBER OF Operator for Multiset SQL type

2017-08-28 Thread Shuyi Chen (JIRA)
Shuyi Chen created FLINK-7545: - Summary: Support MEMBER OF Operator for Multiset SQL type Key: FLINK-7545 URL: https://issues.apache.org/jira/browse/FLINK-7545 Project: Flink Issue Type: New Feat

Re: [DISCUSS] NOTICE

2017-08-28 Thread Nico Kruber
I actually ran into the same thing again, when I needed to copy a file from Netty's tests (an abstract test base class) and was not quite sure what 4d) under the ASL 2.0 meant: 4. Redistribution. You may reproduce and distribute copies of the Work or Derivative Works thereof in any medium, wit

[jira] [Created] (FLINK-7544) Make all PathParameters mandatory

2017-08-28 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7544: --- Summary: Make all PathParameters mandatory Key: FLINK-7544 URL: https://issues.apache.org/jira/browse/FLINK-7544 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7543) Simplify REST parameter access.

2017-08-28 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-7543: - Summary: Simplify REST parameter access. Key: FLINK-7543 URL: https://issues.apache.org/jira/browse/FLINK-7543 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7542) Some tests in AggregateITCase fail for some Time Zones

2017-08-28 Thread Usman Younas (JIRA)
Usman Younas created FLINK-7542: --- Summary: Some tests in AggregateITCase fail for some Time Zones Key: FLINK-7542 URL: https://issues.apache.org/jira/browse/FLINK-7542 Project: Flink Issue Type

[jira] [Created] (FLINK-7541) Redistribute operator state using OperatorID

2017-08-28 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-7541: - Summary: Redistribute operator state using OperatorID Key: FLINK-7541 URL: https://issues.apache.org/jira/browse/FLINK-7541 Project: Flink Issue Type: Impr

Re: Serialization Issue

2017-08-28 Thread Alexx
Thanks! I tested the KeyedSerializationSchema and it indeed works. I tried to use TypeInformationKeyValueSerializationSchema just to make things a bit more automated :) -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Serialization-Issue-tp19400p

[jira] [Created] (FLINK-7540) submit a job on yarn-cluster mode or start a yarn-session failed,in hadoop cluster with capitalized hostname

2017-08-28 Thread Tong Yan Ou (JIRA)
Tong Yan Ou created FLINK-7540: -- Summary: submit a job on yarn-cluster mode or start a yarn-session failed,in hadoop cluster with capitalized hostname Key: FLINK-7540 URL: https://issues.apache.org/jira/browse/FLINK-

Re: Sync Flink

2017-08-28 Thread Aljoscha Krettek
Hi, This is not possible out-of-box, but you could use a ProcessFunction (or rather CoProcessFunction) to buffer elements and set a timer so that you only emit when the watermarks advances on both inputs. Best, Aljoscha > On 28. Aug 2017, at 08:10, ziv wrote: > > People, > > I have two so

Re: Serialization Issue

2017-08-28 Thread Aljoscha Krettek
Hi, TypeInformationKeyValueSerializationSchema uses Flink TypeSerializers to serialize those Strings. What you're seeing is the binary representation of those Strings which, admittedly, resembles the original Strings. If you want to have the data in Kafka with real Strings, I think you need to

Sync Flink

2017-08-28 Thread ziv
People, I have two sources: 1) DataStream int1 = env.addSource(new intWithDelat1()): generates series of integers in streaming of 1 sec delay between elemets. 2) DataStream long3 = env.addSource(new longWithDelay3()): generates series of longs in streaming of 3 sec delay. I want to: