Re: Queryable State max number of clients

2017-08-14 Thread Ziyad Muhammed
hose should be able to easily handle multiple > > queries at the same time. > > > > I'm cc'ing Ufuk and Kostas who might know more about this. > > > > Best, > > Aljoscha > > > > On 9. Aug 2017, at 17:19, Ziyad Muhammed wrote: > > > >

Re: Naming operators to reflect in UI

2017-08-09 Thread Ziyad Muhammed
Hi, You can set the name of any operator explicitly by calling .name(String customName)on the operator. For details: https://ci.apache.org/projects/flink/flink-docs-release-1.3/api/java/org/apache/flink/api/java/op

Queryable State max number of clients

2017-08-09 Thread Ziyad Muhammed
Hi all, I'm trying to understand how many parallel clients will be supported by the queryable state. - query.server.network-threads: number of network (event loop) threads for the KvStateServer (0 => #slots) - query.server.query-threads: number of asynchronous query threads for the K

Re: Type erasure exception

2017-07-24 Thread Ziyad Muhammed
Hi Gabriele Type extraction of java 8 lambdas is not yet supported in IntelliJ Idea IDE. You may solve the issues by following one of the below options. 1. Provide type hints https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/types_serialization.html#type-hints-in-the-java-api 2. Se

Re: Not able to read Kafka Messages with FlinkKafkaConsumer010

2017-07-11 Thread Ziyad Muhammed
plit(",")), new LogDeserializationSchema(), parameterTool.getProperties()); Make sure that the correct properties are passed to FlinkKafkaConsumer. Best Ziyad Best Regards *Ziyad Muhammed Mohiyudheen * 407, Internationales Studienzentrum Berlin Theodor-Heuss-Platz 5 14052 Berlin *Ph: +49 176 6587

FlinkML ALS is taking too long to run

2017-07-07 Thread Ziyad Muhammed
Dear all I'm trying to run Flink ALS against Yahoo-R2 data set[1] on HDFS. The program is running without showing any errors, but it does not finish. The operators running indefinitely are: CoGroup (CoGroup at org.apache.flink.ml.recommendation.ALS$.updateFactors(ALS.scala:606))(11/240) Join(Joi

QueryableStateClient configurations

2017-07-04 Thread Ziyad Muhammed
Dear all, QueryableStateClient class is modified a little in the latest flink release (1.3.1), and I'm having difficulty to understand some of the options. Can someone explain the below options? 1. How do I set the below options in QueryableStateClient ? - query.client.network-threads - q

Re: confusing RocksDBStateBackend parameters

2017-06-17 Thread Ziyad Muhammed
0010/flink/checkpoints) as the checkpointDataURI. Hope that helps. Best Ziyad Best Regards *Ziyad Muhammed Mohiyudheen * 407, Internationales Studienzentrum Berlin Theodor-Heuss-Platz 5 14052 Berlin *Ph: +49 176 6587 3343 <%2B49%20176%206587%203343>* *Mail to*: *mmzi...@gmail.com * On Fri, J

Re: Unable to use Flink RocksDB state backend due to endianness mismatch

2017-06-15 Thread Ziyad Muhammed
, I would conclude you are using a different CPU > architecture that is big endian. In this case, you would have to compile > RocksDB yourself on your native platform and replace the jar that ships > with Flink. > > Best, > Stefan > > Am 03.06.2017 um 14:16 schrieb Ziyad Muham

Unable to use Flink RocksDB state backend due to endianness mismatch

2017-06-03 Thread Ziyad Muhammed
Dear all, My Flink Job reads from a kafka topic and store the data in a RocksDB state backend, in order to make use of the queryable state. I'm able to run the job and query the state in my local machine. But when deploying on the cluster, I'm getting the below error: Caused by: org.apache.flink.