Re: Graph Analytics on HBase With HGraphDB and Apache Flink Gelly

2018-04-04 Thread santoshg
Restarting this thread since it is relevant to us. We are thinking of using HBase/Cassandra to store graph data and then load the data from here into Flink/Gelly. One of the issues we are concerned about is the read performance. So far we tried our tests with data residing on HDFS and that worked f

Re: Delta iteration not spilling to disk

2018-03-05 Thread santoshg
Hi Joshua, I am running into a similar problem. Can you explain your solution a bit more ? A code snippet will help. Thanks -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: accessing flink HA cluster with scala shell/zeppelin notebook

2018-03-01 Thread santoshg
Hi Alexis, Were you able to make this work ? I am also looking for zepplin integration with Flink and this might be helpful. Thanks Santosh -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: TaskManager crashes with PageRank algorithm in Gelly

2018-02-22 Thread santoshg
An update - I was able to overcome these issues by setting the preallocate flag to true. Not sure why this fixes the problem. Need to dig a bit deeper. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

TaskManager crashes with PageRank algorithm in Gelly

2018-02-21 Thread santoshg
Folks, We are running a simple PageRank algorithm in Gelly with about 1M edges and we are seeing that one the TaskManager just crashes. We suspect it is some configuration issue because each TaskManager has a total of 136GB memory and we have 8 of these. So, the total memory is more than enough.