Re: Building Big Data Benchmarking suite for Apache Flink

Hi Slim I will follow this and keep you posted. Thanks. Best regards Hawin On Mon, Jul 13, 2015 at 7:04 PM, Slim Baltagi wrote: > Hi > > BigDataBench is an open source Big Data Benchmarking suite from both > industry and academia. As a subset of BigDataBench, BigDataBench-DCA is > China’

Building Big Data Benchmarking suite for Apache Flink

Hi BigDataBench is an open source Big Data Benchmarking suite from both industry and academia. As a subset of BigDataBench, BigDataBench-DCA is China’s first industry-standard big data benchmark suite: http://prof.ict.ac.cn/BigDataBench/industry-standard-benchmarks/ It comes with real-world dat

Re: bigpetstore flink : parallelizing collections

Absolutely. I see it as a synergistic process too. I just learned about BigTop. As for the packaging, I think Flink doesn't have very different demands compared to the other frameworks already integrated. As for the rest, I'm not familiar enough with BigTop. Currently, Henry is the only Flink commi

Re: bigpetstore flink : parallelizing collections

ok. now ** my thoughts ** on this are that it should be synergistic with flink needs, rather than an orthogonal task that you guys help us with, so please keep us updated what your needs are so that the work is synergistic https://issues.apache.org/jira/browse/BIGTOP-1927 On Mon, Jul 13, 2015 at

Re: DataSet Conversion

Hi Lydia, it might work using new DataSet(javaSet) where DataSet is org.apache.flink.api.scala.DataSet. I'm not sure, however. What is your use case for this? Cheers, Aljoscha On Mon, 13 Jul 2015 at 15:55 Lydia Ickler wrote: > Hi guys, > > is it possible to convert a Java DataSet to a Scala Data

Re: DataSet Conversion

Hi! I think you can simply do "new org.apache.flink.api.scala. DataSet[T](javaSet)" Greetings, Stephan On Mon, Jul 13, 2015 at 3:55 PM, Lydia Ickler wrote: > Hi guys, > > is it possible to convert a Java DataSet to a Scala Dataset? > Right now I get the following error: > Error:(102, 29) java:

DataSet Conversion

Hi guys, is it possible to convert a Java DataSet to a Scala Dataset? Right now I get the following error: Error:(102, 29) java: incompatible types: 'org.apache.flink.api.java.DataSet cannot be converted to org.apache.flink.api.scala.DataSet‘ Thanks in advance, Lydia

Re: HBase & Machine Learning

Hi Lydia, Here are some examples of how to read/write data from/to HBase: https://github.com/apache/flink/tree/master/flink-staging/flink-hbase/src/test/java/org/apache/flink/addons/hbase/example Hope that helps you to develop your Flink job. If not feel free to ask! Best, Max On Sat, Jul 11, 2

Re: local web-client error

Sure, this is it Actually it usually happens when i see the graph, go back change a little the program and recreate the package with maven (same name for the jar) re-upload the package and try to re-start it killing e restarting the web-client solve the problem An error occurred while invoking

Re: bigpetstore flink : parallelizing collections

Hi Jay, Great to hear there is effort to integrate Flink with BigTop. Please let us know if any questions come up in the course of the integration! Best, Max On Sun, Jul 12, 2015 at 3:57 PM, jay vyas wrote: > awesome thanks ! i ll try it out. > > This is part of a wave of jiras for bigtop f

Re: local web-client error

Hi Michele, Sorry to hear you are experiencing problems with the web client. Which version of Flink are you using? Could you paste the whole error message you see? Thank you. Best regards, Max On Sun, Jul 12, 2015 at 11:21 AM, Michele Bertoni < michele1.bert...@mail.polimi.it> wrote: > I think

Re: UI for flink

Hey Till, thank you for the answer. Cheers Am 13.07.2015 um 14:23 schrieb Till Rohrmann: Hi Hermann, when you start a Flink cluster, then also the web interface is started. It is reachable under |http://:8081|. The web interface tells you a lot about the current state of your cluster and

Re: UI for flink

If you would search a graphical interface for data analytics like Jupyter, you should look Apache Zeppelin [1]. Apache Zeppelin is a web-based notebook. It supports Scala, Spark and Flink. Regards, Chiwan Park [1] https://zeppelin.incubator.apache.org > On Jul 13, 2015, at 9:23 PM, Till Rohrman

Re: UI for flink

Hi Hermann, when you start a Flink cluster, then also the web interface is started. It is reachable under http://:8081. The web interface tells you a lot about the current state of your cluster and the currently executed Flink jobs. Additionally, you can start the web client via ./start-webclient

UI for flink

Hello Flinkers, I'm wondering if a UI Solution for Flink already exist when starting Sincerly, Hermann

Re: DelimitedInputFormat reads entire buffer when splitLength is 0

Hi Stephan, I figured as much, since 128k is a plit size that is not commonly used in large scale data processing engines. I will go for increasing the split size to reduce coordination overhead for Flink. It just so happened that my small toy example brought up the issue. Thanks for clearing this