Re: com.esotericsoftware.kryo.KryoException and java.lang.IndexOutOfBoundsException

2016-06-08 Thread Ahmed Nader
; > } > > for (Map.Entry, Class>> entry: > defaultSerializerClasses.entrySet()) { > kryo.addDefaultSerializer(entry.getKey(), entry.getValue()); > } > > // register the type of our class > kryo.register(type); > > // register given types. we do this first so that any registration of a > // more specific serializer overrides this > for (

Re: com.esotericsoftware.kryo.KryoException and java.lang.IndexOutOfBoundsException

2016-06-08 Thread Ahmed Nader
oundsException where you try to access an element of an array > with size 0 at index 32. > > In order to debug the problem it would be helpful to see the full stack > traces of the errors and the complete error message. Additionally, it would > be helpful to see your program so

com.esotericsoftware.kryo.KryoException and java.lang.IndexOutOfBoundsException

2016-06-08 Thread Ahmed Nader
Hello, I have a TwitterSource and I'm applying some transformations as filter and map on the resulting stream from twitter. I'm collecting the output in an iterator: iterator = DataStreamUtils.collect(datastream). Then in a parallel thread i periodically check if this iterator.hasNext() and print t

Collect output of transformations on a custom source in real time

2016-05-26 Thread Ahmed Nader
Hello, I have defined a custom source function for an infinite stream source, where in my overwritten run method I have a while true loop to keep listening for the input. I want to apply some transformations on the resulting datastream from my source and collect the output so far of these transform

Re:

2016-04-17 Thread Ahmed Nader
interface"? The web > interface is started automatically within the JobManager process. > > What is the exact error message. Is there any stack trace? Anny error in > the log files (in directory log/) > > -Matthias > > On 04/17/2016 03:50 PM, Ahmed Nader wrote: >

Re:

2016-04-17 Thread Ahmed Nader
Sorry the error is can't find the path specified* On 17 April 2016 at 15:49, Ahmed Nader wrote: > Thanks, I followed the instructions and when i try to start the web > interface i get an error can't find file specified. I tried to change the > env.java.home variable to the

Re:

2016-04-17 Thread Ahmed Nader
2016 at 12:48, Matthias J. Sax wrote: > You need to download Flink and install it. Follow this instructions: > > https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html > > -Matthias > > On 04/16/2016 04:00 PM, Ahmed Nader wrote: > >

[no subject]

2016-04-16 Thread Ahmed Nader
Hello, I'm new to flink so this might seem a basic question. I added flink to an existing project using maven and can run the program locally with StreamExecutionEnvironment with no problems, however i want to know how can I submit jobs for that project and be able to view these jobs from flink's w

Re: degree of Parallelism

2016-03-19 Thread Ahmed Nader
u submit it to a cluster without specifying the >> parallelism via the cli, then the default parallelism which you've >> specified in flink-conf.yaml will be used. If you use the -p option of the >> cli, then this value will be used as the parallelism. >> >> Cheers,

Convert Datastream to Collector or List

2016-03-19 Thread Ahmed Nader
Hi, I want to pass an object of type DataStream ,after applying map function on it, as a parameter to be used somewhere else. But when i do so, i get an error message of trying to access a null context object. Is there a way that i can convert this DataStream object to a list or a collector so as t

Re: Convert Datastream to Collector or List

2016-03-19 Thread Ahmed Nader
Hello Suneel, Yeah that worked, thanks so much. On 16 March 2016 at 12:50, Suneel Marthi wrote: > DataStream ds = ... > > Iterator iter = DataStreamUtils.collect(ds); > > List list = Lists.newArrayList(iterator); > > Hope that helps. > > > On Wed, Mar 16

degree of Parallelism

2016-03-19 Thread Ahmed Nader
Hi, How can i setParallelism in a generic way that provide better performance on any device not only mine? In this case is it better to be set to a certain value or if i just didn't set it to any value does flink take care of that generically and provide better execution performance? Thanks.

Java I/O exception

2016-03-19 Thread Ahmed Nader
Hi, I'm working on a project using flink with Spring boot, when i run the application i get an exception: Cannot determine the size of the physical memory for Windows host (using 'wmic memorychip'): Cannot run program "wmic": CreateProcess error=2, The system cannot find the file specified java.io