Re: Improving Flink Performance

2017-02-06 Thread Fabian Hueske
ent one, the performance problems are gone. > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Improving-Flink- > Performance-tp11248p11447.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: Improving Flink Performance

2017-02-05 Thread Jonas
.nabble.com/Improving-Flink-Performance-tp11248p11447.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Improving Flink Performance

2017-01-26 Thread Stephan Ewen
@jonas Flink's Fork-Join Pool drives only the actors, which are doing coordination. Unless your job is permanently failing/recovering, they don't do much. On Thu, Jan 26, 2017 at 2:56 PM, Robert Metzger wrote: > Hi Jonas, > > The good news is that your job is completely parallelizable. So if yo

Re: Improving Flink Performance

2017-01-26 Thread Robert Metzger
1:23 PM, Jonas wrote: > JProfiler > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Improving-Flink- > Performance-tp11248p11311.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: Improving Flink Performance

2017-01-26 Thread Jonas
JProfiler -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248p11311.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Improving Flink Performance

2017-01-26 Thread dromitlabs
com/file/n11305/Tv6KnR6.png > > > > -- > View this message in context: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248p11307.html > Sent from the Apache Flink User Mailing List archive. mailing list archive at > Nabble.com.

Re: Improving Flink Performance

2017-01-25 Thread Jonas
.nabble.com/Improving-Flink-Performance-tp11248p11307.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Improving Flink Performance

2017-01-25 Thread Jonas
che-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n11305/Tv6KnR6.png> *Any ideas? * -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248p11305.html Sent from the Apache Flink User Mailing

Re: Improving Flink Performance

2017-01-25 Thread Jonas
I tried and it added a little performance (~10%) but nothing outstanding. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248p11301.html Sent from the Apache Flink User Mailing List archive. mailing list

Re: Improving Flink Performance

2017-01-25 Thread Stephan Ewen
ache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Improving-Flink- > Performance-tp11248p11272.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: Improving Flink Performance

2017-01-24 Thread Jonas
know how to improve that? Might setting the buffer size / timeout be worth exploring? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248p11272.html Sent from the Apache Flink User Mailing List archive. mailing

Re: Improving Flink Performance

2017-01-24 Thread Stephan Ewen
a way to make this >> faster?* >> >> *Measurements were taken with def writeToSocket[?](d: DataStream[?], >> port: Int): Unit = { d.writeToSocket("localhost", port, new >> SerializationSchema[?] { override def serialize(element: ?): Array[Byte] = >> { &quo

Re: Improving Flink Performance

2017-01-24 Thread Aljoscha Krettek
riteToSocket("localhost", port, new > SerializationSchema[?] { override def serialize(element: ?): Array[Byte] = > { "\n".getBytes(CharsetUtil.UTF_8) } }) } and nc -lk PORT | pv --line-mode > --rate --average-rate --format "Current: %r, Avg:%a, Total: %b" > >

Improving Flink Performance

2017-01-24 Thread Jonas
nk-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-tp11248.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Improving Flink performance

2017-01-24 Thread Jonas
I don't even have images in there :O Will delete this thread and create a new one. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-performance-tp11211p11245.html Sent from the Apache Flink User Mailing List archive. ma

Re: Improving Flink performance

2017-01-23 Thread Ted Yu
context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Improving-Flink- > performance-tp11211p11225.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: Improving Flink performance

2017-01-23 Thread Jonas
I received it well-formatted. May it be that the issue is your Mail reader? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-performance-tp11211p11225.html Sent from the Apache Flink User Mailing List archive. mailing list

Re: Improving Flink performance

2017-01-23 Thread Greg Hogan
with > > and / > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Improving-Flink- > performance-tp11211.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Improving Flink performance

2017-01-23 Thread Jonas
ay to make this faster?* /Measurements were taken with and / -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-performance-tp11211.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.