Re: [FLINK-4309] - Need a shepherd

2016-08-15 Thread Sunny T
Thanks! Best, Sunny On Sun, Aug 14, 2016 at 11:26 PM, Aljoscha Krettek wrote: > I'll have a look. Thanks for working on this! > > On Mon, 15 Aug 2016 at 06:22 Sunny T wrote: > > > Hi, > > > > I have created a pull request for FLINK-4309 > > . C

[jira] [Created] (FLINK-4394) RMQSource: The QueueName is not accessible to subclasses

2016-08-15 Thread Dominik Bruhn (JIRA)
Dominik Bruhn created FLINK-4394: Summary: RMQSource: The QueueName is not accessible to subclasses Key: FLINK-4394 URL: https://issues.apache.org/jira/browse/FLINK-4394 Project: Flink Issue

[jira] [Created] (FLINK-4395) Eager processing of late arrivals in CEP operator

2016-08-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4395: Summary: Eager processing of late arrivals in CEP operator Key: FLINK-4395 URL: https://issues.apache.org/jira/browse/FLINK-4395 Project: Flink Issue Type: I

Re: [DISCUSS] Breaking Savepoint Compatibility from 1.1 to 1.2

2016-08-15 Thread Ufuk Celebi
I agree that it is acceptable to break it (again). At the moment, we already prohibit users from resuming 1.0 savepoints with 1.1 and so far (~1 week since release) no one complained. I think that at this point most users use it only with the same major version as they used when triggering the save

Re: Some thoughts about the lower-level Flink APIs

2016-08-15 Thread Aljoscha Krettek
Hi All, I also thought about this recently. A good think would be to add a good user facing operator that behaves more or less like an enhanced FlatMap with multiple inputs, multiple outputs, state access and keyed timers. I'm a bit hesitant, though, since users rarely think about the implications

Re: [DISCUSS] API breaking change in DataStream Windows

2016-08-15 Thread Robert Metzger
I would like have a decision on this so that we can merge the pull request. If we can not come up with a solution everybody agrees, and nobody rejects the VOTE, I'll start a VOTE thread in 24 hours. On Tue, Aug 9, 2016 at 3:57 PM, Till Rohrmann wrote: > That is a tough call but I'm personally

Re: [DISCUSS] Streaming connector contributions

2016-08-15 Thread Robert Metzger
Hi, I just wanted to let you know that I've started a discussion at the Bahir dev list [1]. They seem to be very open to give some of our streaming connectors a new home. We are currently discussing some specifics there (whether to put the code into the same repository or into separate ones). Also

Re: [DISCUSS] (Meta)data Driven Window Triggers

2016-08-15 Thread Robert Metzger
Hi Kevin, I'm happy to hear that Flink performs well for your use-cases! I'm not sure if I understand what you mean by a metadata driven window trigger. What is an example of a metadata that would trigger a window? Why would you need global state to filter duplicates from a stream? I assume that

Re: TaskManager Transfer buffers

2016-08-15 Thread Ufuk Celebi
Hey David! Yes, sure. - The NettyServer handles these requests in the server pipeline (see PartitionRequestProtocol#getServerChannelHandlers()) - The main handler for these requests is PartitionRequestServerHandler: it gets the requests, forwards it to the ResultPartitionProvider and queues it for

[jira] [Created] (FLINK-4396) MetricRegistry class not found at startup of jobmanager

2016-08-15 Thread RWenden (JIRA)
RWenden created FLINK-4396: -- Summary: MetricRegistry class not found at startup of jobmanager Key: FLINK-4396 URL: https://issues.apache.org/jira/browse/FLINK-4396 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-4398) Unstable test KvStateServerHandlerTest.testSimpleQuery

2016-08-15 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-4398: - Summary: Unstable test KvStateServerHandlerTest.testSimpleQuery Key: FLINK-4398 URL: https://issues.apache.org/jira/browse/FLINK-4398 Project: Flink Issue

[jira] [Created] (FLINK-4397) Unstable test SlotCountExceedingParallelismTest.tearDown

2016-08-15 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-4397: - Summary: Unstable test SlotCountExceedingParallelismTest.tearDown Key: FLINK-4397 URL: https://issues.apache.org/jira/browse/FLINK-4397 Project: Flink Issu

Re: Some thoughts about the lower-level Flink APIs

2016-08-15 Thread Till Rohrmann
Hi, I'm also not sure whether we should start teaching Flink by demonstrating the low-level APIs. According to my experience, people new to Flink should first learn a very basic set of primitive operations. Usually this is map, flatmap, join, windows, etc. The semantics of these operations is well

[jira] [Created] (FLINK-4399) Add support for oversized messages

2016-08-15 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4399: --- Summary: Add support for oversized messages Key: FLINK-4399 URL: https://issues.apache.org/jira/browse/FLINK-4399 Project: Flink Issue Type: Sub-task

Jenkins and Travis CI failing

2016-08-15 Thread Sunny T
Hi, I created a pull request for FLINK-4309 last night. Here is the pull request: https://github.com/apache/flink/pull/2371. The jenkins and Travis CI are failing. But the Travis CI passed on my forked repository. Can anyone help me understand what is wrong here? Thanks, Sunny

Custom Tumbling Window Assigner

2016-08-15 Thread dan bress
I am interesting in writing a custom tumbling window assigner to do the following: As soon as the first event for that keyed stream comes in, create a window from that point going forward N milli seconds. Is it possible to do that using flink? What I want to do is get all events that occurred in

Re: Jenkins and Travis CI failing

2016-08-15 Thread Ivan Mushketyk
Hi, Some Flink tests are flaky and fail on some platforms, so failures may have nothing to do with your changes. Since your build passes on most platforms, I would assume that the code is fine, but it is up to someone more experienced in Flink to decide. Flink community is working towards improvin

Re: Jenkins and Travis CI failing

2016-08-15 Thread Sunny T
Hi, Thanks for the information. Any idea whom I should contact to have a look at the pull request and get it approved? Thanks, Sunny T On Mon, Aug 15, 2016 at 12:07 PM Ivan Mushketyk < mailto:Ivan Mushketyk > wrote: a, pre, code, a:link, body { word-wrap: break-word !important; } Hi, Som

Re: Some thoughts about the lower-level Flink APIs

2016-08-15 Thread Jamie Grier
You lost me at lattice, Aljoscha ;) I do think something like the more powerful N-way FlatMap w/ Timers Aljoscha is describing here would probably solve most of the problem. Often Flink's higher level primitives work well for people and that's great. It's just that I also spend a fair amount of t

<无主题>

2016-08-15 Thread Renkai
Hi all:    I’m interested in Table API and SQL.As far as I know, the SQL supports is very limited currently. I want to help improving related features, such as distinct aggregates for SQL on batch tables, and aggregations for SQL on stream tables. I don’t have much experience in developing

[jira] [Created] (FLINK-4400) Leadership Election among JobManagers

2016-08-15 Thread Xiaogang Shi (JIRA)
Xiaogang Shi created FLINK-4400: --- Summary: Leadership Election among JobManagers Key: FLINK-4400 URL: https://issues.apache.org/jira/browse/FLINK-4400 Project: Flink Issue Type: Sub-task