Re: the Table API `limit` is confused

2017-10-11 Thread John Fang
Now the Table don't support the limit operator without orderBy operator. On Thu, Oct 12, 2017 at 2:30 PM, John Fang wrote: > Hi, > >In order to support ORDER BY OFFSET FETCH, we add the Table API > `limit`. But the api is confused. For example: "table.limit(3)" means > unlimited number of

the Table API `limit` is confused

2017-10-11 Thread John Fang
Hi, In order to support ORDER BY OFFSET FETCH, we add the Table API `limit`. But the api is confused. For example: "table.limit(3)" means unlimited number of records beginning with the 4th record. In fact I prefer "table.limit(3)" means taking the first `3` rows. So I prefer to use the API "

[jira] [Created] (FLINK-7820) remove text related to FoldingState and FoldingStateDescriptor from doc

2017-10-11 Thread Bowen Li (JIRA)
Bowen Li created FLINK-7820: --- Summary: remove text related to FoldingState and FoldingStateDescriptor from doc Key: FLINK-7820 URL: https://issues.apache.org/jira/browse/FLINK-7820 Project: Flink

[jira] [Created] (FLINK-7819) Check object to clean is closure

2017-10-11 Thread Hai Zhou UTC+8 (JIRA)
Hai Zhou UTC+8 created FLINK-7819: - Summary: Check object to clean is closure Key: FLINK-7819 URL: https://issues.apache.org/jira/browse/FLINK-7819 Project: Flink Issue Type: Bug Co

[jira] [Created] (FLINK-7818) Synchronize MetricStore access in the TaskManagersHandler

2017-10-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7818: Summary: Synchronize MetricStore access in the TaskManagersHandler Key: FLINK-7818 URL: https://issues.apache.org/jira/browse/FLINK-7818 Project: Flink Issue

[jira] [Created] (FLINK-7817) Add TaskManagerDetailsHandler

2017-10-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7817: Summary: Add TaskManagerDetailsHandler Key: FLINK-7817 URL: https://issues.apache.org/jira/browse/FLINK-7817 Project: Flink Issue Type: Sub-task Co

[jira] [Created] (FLINK-7816) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2017-10-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-7816: --- Summary: Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner Key: FLINK-7816 URL: https://issues.apache.org/jira/browse/FLINK-7816 Project: Flink

[jira] [Created] (FLINK-7815) Remove grouping from MultipleJobsDetails

2017-10-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7815: Summary: Remove grouping from MultipleJobsDetails Key: FLINK-7815 URL: https://issues.apache.org/jira/browse/FLINK-7815 Project: Flink Issue Type: Sub-task

Re: got Warn message - "the expected leader session ID did not equal the received leader session ID " when using LocalFlinkMiniCluster to interpret scala code

2017-10-11 Thread Aljoscha Krettek
Hi, I think you can make it start the Web Frontend via conf.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true); In the future, this will become moot, though, when the JobManager has a proper REST API that is always there. Best, Aljoscha > On 27. Sep 2017, at 11:40, XiangWei Huang wrote

Re: Get pattern events

2017-10-11 Thread Erdem erdfem
Hello again, I can get context values. But pattern alarm gives combinations of matchedevents. How can i disable it? .followedBy("second").where(new IterativeCondition() { @Override public boolean filter(ObjectNode jsonNodes, Context context) throws Exception { int count = jsonNode

[jira] [Created] (FLINK-7814) Add BETWEEN expression to Table API

2017-10-11 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-7814: Summary: Add BETWEEN expression to Table API Key: FLINK-7814 URL: https://issues.apache.org/jira/browse/FLINK-7814 Project: Flink Issue Type: Improvement

Re: System resource logger

2017-10-11 Thread Piotr Nowojski
I have decided to drop this static logged once part. Those are static informations, that user can obtain in some more conventional way. For now I have left cpu, memory, swap and network interfaces stats. Piotrek > On 5 Oct 2017, at 18:45, Bowen Li wrote: > > System and processor info, marked

[jira] [Created] (FLINK-7813) Replace MetricRegistryThreadFactory

2017-10-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7813: --- Summary: Replace MetricRegistryThreadFactory Key: FLINK-7813 URL: https://issues.apache.org/jira/browse/FLINK-7813 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-7812) Log system resources as metrics

2017-10-11 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-7812: - Summary: Log system resources as metrics Key: FLINK-7812 URL: https://issues.apache.org/jira/browse/FLINK-7812 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-7811) Add support for Scala 2.12

2017-10-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-7811: --- Summary: Add support for Scala 2.12 Key: FLINK-7811 URL: https://issues.apache.org/jira/browse/FLINK-7811 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7810) Switch from custom Flakka to Akka 2.4.x

2017-10-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-7810: --- Summary: Switch from custom Flakka to Akka 2.4.x Key: FLINK-7810 URL: https://issues.apache.org/jira/browse/FLINK-7810 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-7809) Drop support for Scala 2.10

2017-10-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-7809: --- Summary: Drop support for Scala 2.10 Key: FLINK-7809 URL: https://issues.apache.org/jira/browse/FLINK-7809 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7808) JobDetails constructor should check length of tasksPerState array

2017-10-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7808: --- Summary: JobDetails constructor should check length of tasksPerState array Key: FLINK-7808 URL: https://issues.apache.org/jira/browse/FLINK-7808 Project: Flink

[jira] [Created] (FLINK-7807) HandlerUtils methods should log errors

2017-10-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7807: --- Summary: HandlerUtils methods should log errors Key: FLINK-7807 URL: https://issues.apache.org/jira/browse/FLINK-7807 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7806) Move CurrentJobsOverviewHandler to jobs/overview

2017-10-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7806: Summary: Move CurrentJobsOverviewHandler to jobs/overview Key: FLINK-7806 URL: https://issues.apache.org/jira/browse/FLINK-7806 Project: Flink Issue Type: Su

Re: Unable to write snapshots to S3 on EMR

2017-10-11 Thread Aljoscha Krettek
Hi Andy, I remember that I was testing a job with almost exactly the same setup as part of the Flink 1.3.2 release testing. The command I used to start my job is roughly this: HADOOP_CONF_DIR=/etc/hadoop/conf bin/flink run -c my.main.Class -m yarn-cluster -yn 5 -ys 2 ... i.e. I export the pro

Re: Not being able to log from Flink to Kafka

2017-10-11 Thread Chesnay Schepler
Is the KafkaLog4jAppender in the user-jar, or in the /lib directory of the flink distribution? On 10.10.2017 22:36, Jose Gonzalez Torres wrote: Hi Guys I am trying to use log4j to log all the info from my Flink Application into a Kafka Topic. The Flink application is running in cluster mode. b

[jira] [Created] (FLINK-7805) Add HA capabilities to YarnResourceManager

2017-10-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7805: Summary: Add HA capabilities to YarnResourceManager Key: FLINK-7805 URL: https://issues.apache.org/jira/browse/FLINK-7805 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-7804) YarnResourceManager does not execute AMRMClientAsync callbacks in main thread

2017-10-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7804: Summary: YarnResourceManager does not execute AMRMClientAsync callbacks in main thread Key: FLINK-7804 URL: https://issues.apache.org/jira/browse/FLINK-7804 Project:

[jira] [Created] (FLINK-7803) Update savepoint Documentation

2017-10-11 Thread Razvan (JIRA)
Razvan created FLINK-7803: - Summary: Update savepoint Documentation Key: FLINK-7803 URL: https://issues.apache.org/jira/browse/FLINK-7803 Project: Flink Issue Type: Bug Components: Document