[jira] [Created] (FLINK-4707) Including flink-connector-filesystem as dependency fails build

2016-09-28 Thread Melmoth (JIRA)
Melmoth created FLINK-4707: -- Summary: Including flink-connector-filesystem as dependency fails build Key: FLINK-4707 URL: https://issues.apache.org/jira/browse/FLINK-4707 Project: Flink Issue Type:

Re: ClassNotFoundException

2016-09-28 Thread Olga Golovneva
Hi Vasia, Thanks a lot for your help! It worked out! Best regards, Olga Best regards, Olga Golovneva On Wed, Sep 28, 2016 at 6:12 PM, Vasiliki Kalavri wrote: > Hi Olga, > > have you copied the flink-gelly jar to your TaskManagers? See the > instructions in [1] on how you can make the gelly cl

[jira] [Created] (FLINK-4706) Is there a way to load user classes first?

2016-09-28 Thread JIRA
刘喆 created FLINK-4706: - Summary: Is there a way to load user classes first? Key: FLINK-4706 URL: https://issues.apache.org/jira/browse/FLINK-4706 Project: Flink Issue Type: New Feature Componen

Re: FailureRate Restart Strategy is not picked from Config file

2016-09-28 Thread Deepak Jha
Hi Till, yes, I have enabled checkpointing from my job. Thanks for your help :) On Mon, Sep 26, 2016 at 3:18 AM, Till Rohrmann wrote: > Hi Deepak, > > are you running Flink streaming jobs with checkpointing enabled? In this > case Flink will check if you've set a restart strategy at your job and

Re: ClassNotFoundException

2016-09-28 Thread Vasiliki Kalavri
Hi Olga, have you copied the flink-gelly jar to your TaskManagers? See the instructions in [1] on how you can make the gelly classes available during execution and let us know if you have any problems. Best, -Vasia, [1]: https://ci.apache.org/projects/flink/flink-docs-master/dev/cluster_executio

Use specific worker for heavy computations

2016-09-28 Thread Mariano Gonzalez
I need to load a PFA (portable format for analytics) that can be around 30 GB and later process it with hadrian which is the java implementation for PFA's (https://github.com/opendatagroup/hadrian). I would like to execute this transformation step inside a specific worker of the cluster (since I d

ClassNotFoundException

2016-09-28 Thread Olga Golovneva
Hi devs, I'm trying to run Gelly ClusteringCoefficient example on a cluster using this command: flink run -C file://home/ubuntu/flink/flink-libraries/flink-gelly/target/flink-gelly_2.10-1.2-SNAPSHOT.jar -c org.apache.flink.graph.examples.ClusteringCoefficient flink-gelly-examples_2.10-1.2-SNAPSHO

[jira] [Created] (FLINK-4705) Instrument FixedLengthRecordSorter

2016-09-28 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-4705: - Summary: Instrument FixedLengthRecordSorter Key: FLINK-4705 URL: https://issues.apache.org/jira/browse/FLINK-4705 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Mesos Dispatcher (FF2016)

2016-09-28 Thread Maximilian Michels
Hi Eron, Great to see so much progress on the Mesos implementation! Thank you for sharing the code with us. I'm not entirely sure whether we actually wait on the completion of FLIP-6. We might complete the Mesos support for the 1.2.0 release and port its code to the new RPC abstraction that comes

Re: Regarding `flink-streaming` project dependencies

2016-09-28 Thread Maximilian Michels
Hi Liwei, I created this a while ago which is pretty much what you want as well: https://issues.apache.org/jira/browse/FLINK-3276 Cheers, Max On Tue, Sep 27, 2016 at 11:09 AM, Liwei Lin wrote: > Thanks Stephan for the prompt response! > > Glad to know it's targeted for Flink 2.0. Is there any J

Re: DataInputStream read vs. readFully

2016-09-28 Thread Maximilian Michels
Hi Ufuk, `read(buf)` is not always `read(buf, 0, buf.length)`. Whereas `readFully(buf)` ensures `read(buf, 0, buf.length)`, right? The method is clearly documented but these mistakes can happen like a forgotten null pointer check. If we want to prevent mistakes like this, we can replace `read(buf

[jira] [Created] (FLINK-4704) Move Table API to org.apache.flink.table

2016-09-28 Thread Timo Walther (JIRA)
Timo Walther created FLINK-4704: --- Summary: Move Table API to org.apache.flink.table Key: FLINK-4704 URL: https://issues.apache.org/jira/browse/FLINK-4704 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Removing delete*Timer from the WindowOperator.Context

2016-09-28 Thread Maximilian Michels
What are the use cases where you actually need to delete a timer? How about we only let users delete timers which they created themselves? I guessing most of these use cases will be obsolete with the new Trigger DSL because the trigger logic can be expressed more easily. So +1 for removing the del

Re: 答复: 答复: [DISCUSS] add netty tcp/restful pushed source support

2016-09-28 Thread Stephan Ewen
The Bahir-Flink stuff is fairly new - the first release has not yet happened. Robert is pushing that, will probably happen once he is back. On Tue, Sep 27, 2016 at 3:31 PM, shijinkui wrote: > It's nice. Will present flink source connector be pushed to bahir-flink? > I can add netty-source to bah

Re: Exception from in-progress implementation of Python API bulk iterations

2016-09-28 Thread Chesnay Schepler
Hello Geoffrey, this one works for me as well :D Regards, Chesnay On 28.09.2016 05:38, Geoffrey Mon wrote: Hello Chesnay, Thank you for your help. After receiving your message I recompiled my version of Flink completely, and both the NullPointerException listed in the TODO and the ClassCastEx

[jira] [Created] (FLINK-4703) RpcCompletenessTest: Add support for type arguments and subclasss

2016-09-28 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-4703: - Summary: RpcCompletenessTest: Add support for type arguments and subclasss Key: FLINK-4703 URL: https://issues.apache.org/jira/browse/FLINK-4703 Project: Fl

DataInputStream read vs. readFully

2016-09-28 Thread Ufuk Celebi
Hey devs, had a quick discussion with Stephan about usage of DataInputStream read and readFully. In most cases we want to use readFully, but it's easy to accidentally use read instead (happened to me here for example: https://issues.apache.org/jira/browse/FLINK-4332), which only reads as many byte

How to interact with a running flink application?

2016-09-28 Thread Anchit Jatana
Hi All, *Brief:* I have a use case where I need to interact with a running flink application. *Detail:* My Flink application has a *Kafka source*, *an operator processing on the content received* from the Kafka stream(this operator is using a lookup from an external source file to accomplish the