Multiclass classification example

Hi; I am trying to learn Flink Ml lib. Where can i find detailed multiclass classification example?

Re: Issue while restarting from SavePoint

Hi, The issue seems to be connected with trying to restart the job in the detached mode. The stack trace is as follows: -bash-3.2$ bin/flink run -d -s jobmanager://savepoints/1 -c com.tfs.rtdp.precompute.Flink.FlinkTest /tmp/flink-web-upload-2155906f-be54-47f3-b9f7-7f6f0f54f74b/448724f9-f69f-45

Issue while restarting from SavePoint

Hi, I am relatively new to Flink and I was experimenting with the save points feature. I have an HA cluster running with 1 Master and 4 Workers. The flink-config.yaml is as follows : #== # Common #===

Re: Read Apache Kylin from Apache Flink

Great to see Alberto. Thanks for sharing it with the community :-) Cheers, Till On Tue, Oct 18, 2016 at 7:40 PM, Alberto Ramón wrote: > Hello > > I made a small contribution / manual about: > *"How-to Read Apache Kylin data from Apache Flink With Scala" >

Read Apache Kylin from Apache Flink

Hello I made a small contribution / manual about: *"How-to Read Apache Kylin data from Apache Flink With Scala" * For any suggestions, feel free to contact me Thanks, Alberto

Re: Queryable state using JDBC

Sorry, this seems to be a private repository. Then you could take a look at QueryableStateITCase in the Flink code base. Cheers, Till On Tue, Oct 18, 2016 at 4:33 PM, Alberto Ramón wrote: > I don't have acess or link don't work :( > > 2016-10-18 16:15 GMT+02:00 Till Rohrmann : > >> Oh now

Re: Queryable state using JDBC

I don't have acess or link don't work :( 2016-10-18 16:15 GMT+02:00 Till Rohrmann : > Oh now I understand. Sorry for my confusion. Flink does not offer a JDBC > interface to query its state. The only way to do that is to use Flink's > proprietary interface. Since this feature is highly exper

Re: Queryable state using JDBC

Oh now I understand. Sorry for my confusion. Flink does not offer a JDBC interface to query its state. The only way to do that is to use Flink's proprietary interface. Since this feature is highly experimental there is not a lot of documentation out there. I can recommend you this github repo [1] w

Re: Queryable state using JDBC

Hi :) *SQL Client ---> JDBC ---> Flink (queryable state)* (I don't read from Flink a JDBC Source) I want the opposite: See Flink as "realtime database" from my SQL Client ... for example: Tableau ---> Flink states 2016-10-18 14:52 GMT+02:00 Till Rohrmann : > Hi Alberto, > > have you checked

Re: Distributing Tasks over Task manager

Hi Robert, Do you already had a chance to look on it? If you need more information just let me know. Regards, Jürgen On 12.10.2016 21:12, Jürgen Thomann wrote: Hi Robert, Thanks for your suggestions. We are using the DataStream API and I tried it with disabling it completely, but that did

Re: Queryable state using JDBC

Hi Alberto, have you checked out Flink's JDBCInputFormat? As far as I can tell, Kylin has support for JDBC and, thus, you should be able to read from it with this input format. Cheers, Till On Tue, Oct 18, 2016 at 11:28 AM, Alberto Ramón wrote: > Hello > > I'm investigating about Flink + Calci

Re: ContinuousFileMonitoringFunction - deleting file after processing

Hi Maciek, I agree with you that 1ms is often too long :P This is the reason why I will open a discussion to have all the ideas/ requirements / shortcomings in a single place. This way the community can track and influence what is coming next. Hopefully I will do it in the afternoon and I will

Re: ContinuousFileMonitoringFunction - deleting file after processing

Hi Kostas, thanks for quick answer. I wouldn't dare to delete files in InputFormat if they were splitted and processed in parallel... As for using notifyCheckpointComplete - thanks for suggestion, it looks pretty interesting, I'll try to try it out. Although I wonder a bit if relying only o

Queryable state using JDBC

Hello I'm investigating about Flink + Calcite, StreamSQL, Queryable State Is possible connect to Kylin using SQL Client *via JDBC *? (I always see API examples) BR

Re: "Slow ReadProcessor" warnings when using BucketSink

Hi Robert, thanks for your reply. I also didn't find anything helpful on Google. I checked all GC Times, they look OK. Here are GC Times for the Job Manager (the job is running fine since 5 days): Collector Count Time PS-MarkSweep 3 1s PS-Scavenge 5814 2m 12s I have no window or any computation

Re: Flink SQL Stream Parser based on calcite

Thank you. Great presentation about the high-level translation process. Regards, Pedro -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-SQL-Stream-Parser-based-on-calcite-tp9592p9608.html Sent from the Apache Flink User Mailing List arc

Re: ContinuousFileMonitoringFunction - deleting file after processing

Hi Maciek, Just a follow-up on the previous email, given that splits are read in parallel, when the ContinuousFileMonitoringFunction forwards the last split, it does not mean that the final splits is going to be processed last. If the node it gets assigned is fast enough then it may be proces

Re: ContinuousFileMonitoringFunction - deleting file after processing

Hi Maciek, Currently this functionality is not supported but this seems like a good addition. Actually, give that the feature is rather new, we were thinking of opening a discussion in the dev mailing list in order to i) discuss some current limitations of the Continuous File Processing sourc

Re: Flink Metrics

https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html Or this: https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/metrics.html if you prefer Flink 1.1 On Mon, 17 Oct 2016 at 19:16 amir bahmanyari wrote: > Hi colleagues, > Is there a link that described

ContinuousFileMonitoringFunction - deleting file after processing

Hi, we want to monitor hdfs (or local) directory, read csv files that appear and after successful processing - delete them (mainly not to run out of disk space...) I'm not quite sure how to achieve it with current implementation. Previously, when we read binary data (unsplittable files) we m