[jira] [Created] (FLINK-4091) flink-connector-cassandra has conflicting guava version

Dominik Bruhn created FLINK-4091: Summary: flink-connector-cassandra has conflicting guava version Key: FLINK-4091 URL: https://issues.apache.org/jira/browse/FLINK-4091 Project: Flink Issue T

offheap memory allocation and memory leak bug

Hi, I am making some test about offheap memory usage and encounter an odd behavior. My taskmanager heap limit is 12288 Mb and when i set "taskmanager.memory.off-hep:true" for every job it allocates 11673 Mb off heap area at most which is heapsize*0.95(value of taskmanager.memory.fraction). But whe

[jira] [Created] (FLINK-4090) Close of OutputStream should be in finally clause in FlinkYarnSessionCli#writeYarnProperties()

Ted Yu created FLINK-4090: - Summary: Close of OutputStream should be in finally clause in FlinkYarnSessionCli#writeYarnProperties() Key: FLINK-4090 URL: https://issues.apache.org/jira/browse/FLINK-4090 Projec

[jira] [Created] (FLINK-4089) Ineffective null check in YarnClusterClient#getApplicationStatus()

Ted Yu created FLINK-4089: - Summary: Ineffective null check in YarnClusterClient#getApplicationStatus() Key: FLINK-4089 URL: https://issues.apache.org/jira/browse/FLINK-4089 Project: Flink Issue Typ

Re: [PROPOSAL] Structure the Flink Open Source Development

Hello, You can also add me to the DataStream API. Kostas > On Jun 16, 2016, at 7:02 PM, Robert Metzger wrote: > > Cool, thank you. > > So now we have at least one shepherd for each component. > Since there were no other comments / complaints about this proposal, I > assume its "active" now.

[jira] [Created] (FLINK-4088) Add interface to save and load TableSources

Fabian Hueske created FLINK-4088: Summary: Add interface to save and load TableSources Key: FLINK-4088 URL: https://issues.apache.org/jira/browse/FLINK-4088 Project: Flink Issue Type: Improve

Re: Scheduling task slots in round-robin

Hi Till, Thanks for the pointers, I started looking into this and it does not seem to be too complicated add a new strategy :) I will try to put together a PR but I would greatly appreciate if you could check it out once I'm done as I don't have too much experience with these components. Cheers,

[jira] [Created] (FLINK-4087) JMXReporter can't handle port conflicts

Chesnay Schepler created FLINK-4087: --- Summary: JMXReporter can't handle port conflicts Key: FLINK-4087 URL: https://issues.apache.org/jira/browse/FLINK-4087 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-4086) Hide internal Expression methods from Table API

Fabian Hueske created FLINK-4086: Summary: Hide internal Expression methods from Table API Key: FLINK-4086 URL: https://issues.apache.org/jira/browse/FLINK-4086 Project: Flink Issue Type: Imp

[jira] [Created] (FLINK-4085) Set Kinesis Consumer Agent to Flink

Robert Metzger created FLINK-4085: - Summary: Set Kinesis Consumer Agent to Flink Key: FLINK-4085 URL: https://issues.apache.org/jira/browse/FLINK-4085 Project: Flink Issue Type: Sub-task

Re: How to contribute to Streaming Table API and StreamSQL

If we want to have it in Stream SQL yes. Although we can also think about extending the Calcite parser ourselves. IMO, it makes sense to talk to them first, also to get more feedback on the feature. 2016-06-17 13:18 GMT+02:00 Jark Wu : > Hi Fabian, > > Yea, we can immediately start to work on no

Re: How to contribute to Streaming Table API and StreamSQL

Hi Fabian, Yea, we can immediately start to work on non-windowed aggregates. But it seems that Calcite’s StreamSQL doesn’t support non-windowed aggregates (also not included in roadmap). So we may need to propose this function back to Calcite community? - Jark Wu > 在 2016年6月17日，下午5:41，Fabi

Re: Scheduling task slots in round-robin

Hi Gyula, the scheduler actually deploys independent tasks in a round-robin fashion across the cluster. So for example, your source sub tasks should be spread evenly. However, whenever a sub-task has an input, it tries to deploy this task on the same machine as one of the input sub-tasks (preferre

Re: How to contribute to Streaming Table API and StreamSQL

Hi Jark Wu, I agree about the non-windowed aggregates. If there are actual use cases for this operator, we should definitely support it. Since it does not depend on windows or time, we can immediately start to work on it. In principle, it should be rather easy to implement. However, we have to che

Re: Adding a Histogram Metric

Hi Steve, I thought again about the thread-safe counters and I'm not so sure anymore whether we should add them or not. The reason is that we could also mark the Counter class as not final. Then it would be possible to define your user-defined counters which could be thread-safe. This would reduce

Re: Kafka doesn't work in very simple test

Other jobs works fine in Flink (like batch wordcount) but this doesn't. I use "bin/flink run -m analytics1:6123 -c KafkaWordCountFlink ../benchmark_Spark-Flink-assembly-1.0.jar wordCount2" Thanks Adrian 2016-06-17 11:10 GMT+02:00 Aljoscha Krettek : > Hi, > could you please provide a complete mi

Re: Kafka doesn't work in very simple test

Hi, could you please provide a complete minimal example and the commands that you use to start the cluster and run the job? Cheers, Aljoscha On Fri, 17 Jun 2016 at 10:53 Adrian Portabales wrote: > Hi everyone, > I wrote this post in stackoverflow > > http://stackoverflow.com/questions/37841342/

Kafka doesn't work in very simple test

Hi everyone, I wrote this post in stackoverflow http://stackoverflow.com/questions/37841342/flink-with-kafka-consumer-doesnt-work What's happening? Thanks

Re: How to contribute to Streaming Table API and StreamSQL

Hi Fabian, There are a lot of our business are using non-windowed aggregations. And there is a little difference between non-windowed aggregate and Row window operator, as the later is bound to a certain window and emit the result of the N rows preceding for every incoming row. However the form