Re: mirror links don't work

2017-07-04 Thread AndreaKinn
Yes, I found it googling. Ufuk Celebi wrote > Thanks for reporting this. Did you find these pages by Googling for > the Flink docs? They are definitely very outdated versions of Flink. > > On Tue, Jul 4, 2017 at 4:46 PM, AndreaKinn < > kinn6aer@ > > wrote: >> I found it clicking on "download

Re: mirror links don't work

2017-07-04 Thread Ufuk Celebi
Thanks for reporting this. Did you find these pages by Googling for the Flink docs? They are definitely very outdated versions of Flink. On Tue, Jul 4, 2017 at 4:46 PM, AndreaKinn wrote: > I found it clicking on "download flink for hadoop 1.2" button: > https://ci.apache.org/projects/flink/flink-

Re: QueryableStateClient configurations

2017-07-04 Thread Aljoscha Krettek
Hi Ziyad, You should be able to set the options in the Configuration that you hand to the constructor of QueryableStateClient, i.e.: Configuration config = new Configuration(); config.setInteger(QueryableStateOptions.CLIENT_NETWORK_THREADS, 5); … The executor that you specify when creating the

QueryableStateClient configurations

2017-07-04 Thread Ziyad Muhammed
Dear all, QueryableStateClient class is modified a little in the latest flink release (1.3.1), and I'm having difficulty to understand some of the options. Can someone explain the below options? 1. How do I set the below options in QueryableStateClient ? - query.client.network-threads - q

Re: mirror links don't work

2017-07-04 Thread AndreaKinn
I found it clicking on "download flink for hadoop 1.2" button: https://ci.apache.org/projects/flink/flink-docs-release-0.8/setup_quickstart.html -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/mirror-links-don-t-work-tp14114p14116.html Sent f

Re: mirror links don't work

2017-07-04 Thread Chesnay Schepler
Where did you get that link? You can find working links for all src/binary releases here: http://flink.apache.org/downloads.html#all-releases On 04.07.2017 16:30, AndreaKinn wrote: Hi, I tried to download apache flink from the page: http://www.apache.org/dyn/closer.cgi/flink/flink-0.8.1/flink

mirror links don't work

2017-07-04 Thread AndreaKinn
Hi, I tried to download apache flink from the page: http://www.apache.org/dyn/closer.cgi/flink/flink-0.8.1/flink-0.8.1-bin-hadoop1.tgz but all links lead to a 404 error. Can you fix it please? Thank you Andrea -- View this message in context: http://apache-flink-user-mailing-list-archive.2336

Re: Managed operator state treating state of all parallel operators as the same

2017-07-04 Thread Gyula Fóra
Hi, +1 to what Stefan is suggesting , we have been using similar logic for a while: @Override public void snapshotState(StateSnapshotContext context) throws Exception { updateBroadcastState(); super.snapshotState(context); } @Override public void initializeState(StateInitialization

Re: Managed operator state treating state of all parallel operators as the same

2017-07-04 Thread Stefan Richter
What I mean is that you could obtain such a state in initializeState(FunctionInitializationContext context) { context.getOperatorStateStore().getUnionListState(…); } and in snapshotState(…), you will just insert the state in only one of the parallel instances. Which instance can be base

Re: Managed operator state treating state of all parallel operators as the same

2017-07-04 Thread gerardg
Thanks Fabian, I'll keep an eye to that JIRA. I'm not sure I follow you Stefan. You mean that I could implement my own OperatorStateStore and override its methods (e.g. snapshot and restore) to achieve this functionality? I think I don't have enough knowledge about Flink's internals to implement t

Re: Writing groups of Windows to files

2017-07-04 Thread Niels Basjes
I think I understand. Since the entrie session must fit into memory anyway I'm going to try to create a new datastructure which simply contains the 'entire session' and simply use a Window/BucketingSink construct to ship them to files. I do need to ensure noone can OOM the system by capping the ma

Re: Writing groups of Windows to files

2017-07-04 Thread Fabian Hueske
You are right. Building a large record might result in an OOME. But I think, that would also happen with a regular SessionWindow, RocksDBStatebackend, and a WindowFunction that immediately ships the records it receives from the Iterable. As far as I know, a SessionWindow stores all elements in an i

Re: Writing groups of Windows to files

2017-07-04 Thread Niels Basjes
Hi Fabian, On Fri, Jun 30, 2017 at 6:27 PM, Fabian Hueske wrote: > If I understand your use case correctly, you'd like to hold back all > events of a session until it ends/timesout and then write all events out. > So, instead of aggregating per session (the common use case), you'd just > like to