Re: [DISCUSS] Flink SQL DDL Design

2018-12-13 Thread Jark Wu
Hi all, Here are a bunch of my thoughts: 8). support row/map/array data type That's fine with me if we want to support them in the MVP. In my mind, we can have the field type syntax like this: ``` filedType ::= { simpleType | MAP | ARRAY

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-13 Thread Xianda Ke
Hi Folks, To avoid polluting the survey thread with discussions, we started separate thread and maybe we can continue the discussion over there. Regards, Xianda On Wed, Dec 12, 2018 at 3:34 AM Stephan Ewen wrote: > I like that we are having a general discussion about how to use Python and > Fli

[DISCUSS] Python (and Non-JVM) Language Support in Flink

2018-12-13 Thread Xianda Ke
Currently there is an ongoing survey about Python usage of Flink [1]. Some discussion was also brought up there regarding non-jvm language support strategy in general. To avoid polluting the survey thread, we are starting this discussion thread and would like to move the discussions here. In the i

[jira] [Created] (FLINK-11147) Add document for TableAggregate Function

2018-12-13 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-11147: --- Summary: Add document for TableAggregate Function Key: FLINK-11147 URL: https://issues.apache.org/jira/browse/FLINK-11147 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-11148) Rescaling operator regression in Flink 1.7

2018-12-13 Thread Truong Duc Kien (JIRA)
Truong Duc Kien created FLINK-11148: --- Summary: Rescaling operator regression in Flink 1.7 Key: FLINK-11148 URL: https://issues.apache.org/jira/browse/FLINK-11148 Project: Flink Issue Type:

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-13 Thread Stephan Ewen
You are right. Let's refocus this on the python user survey and spin out another thread. On Thu, Dec 13, 2018 at 9:56 AM Xianda Ke wrote: > Hi Folks, > To avoid polluting the survey thread with discussions, we started separate > thread and maybe we can continue the discussion over there. > > Reg

Re: Connection leak with flink elastic Sink

2018-12-13 Thread Chesnay Schepler
Specifically which connector are you using, and which Flink version? On 12.12.2018 13:31, Vijay Bhaskar wrote: Hi We are using flink elastic sink which streams at the rate of 1000 events/sec, as described in https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/elasticsearch.ht

Re: Connection leak with flink elastic Sink

2018-12-13 Thread Tzu-Li (Gordon) Tai
Hi, Besides the information that Chesnay requested, could you also provide a stack trace of the exception that caused the job to terminate in the first place? The Elasticsearch sink does indeed close the internally used Elasticsearch client, which should in turn properly release all resources [

Re: [DISCUSS] Python (and Non-JVM) Language Support in Flink

2018-12-13 Thread Shaoxuan Wang
RE: Stephen's options ( http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/SURVEY-Usage-of-flink-python-and-flink-streaming-python-td25793.html ) * Option (1): Language portability via Apache Beam * Option (2): Implement own Python API * Option (3): Implement own portability layer Hi S

[jira] [Created] (FLINK-11149) Flink will request too more containers than it actually needs

2018-12-13 Thread Fan Xinpu (JIRA)
Fan Xinpu created FLINK-11149: - Summary: Flink will request too more containers than it actually needs Key: FLINK-11149 URL: https://issues.apache.org/jira/browse/FLINK-11149 Project: Flink Issu

Re: Connection leak with flink elastic Sink

2018-12-13 Thread Vijay Bhaskar
Hi Gordon, We are using flink cluster 1.6.1, elastic search connector version: flink-connector-elasticsearch6_2.11 Attached the stack trace. Following are the max open file descriptor limit of theTask manager process and open connections to the elastic search cluster Regards Bhaskar *#lsof -p 620

[jira] [Created] (FLINK-11150) Check exception messages in ValidationTest of flink-table

2018-12-13 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-11150: --- Summary: Check exception messages in ValidationTest of flink-table Key: FLINK-11150 URL: https://issues.apache.org/jira/browse/FLINK-11150 Project: Flink Issue

[jira] [Created] (FLINK-11151) FileUploadHandler stops working if the upload directory is removed

2018-12-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-11151: Summary: FileUploadHandler stops working if the upload directory is removed Key: FLINK-11151 URL: https://issues.apache.org/jira/browse/FLINK-11151 Project: F

[jira] [Created] (FLINK-11152) ClosureCleanerTest fails with IllegalStateException

2018-12-13 Thread Gary Yao (JIRA)
Gary Yao created FLINK-11152: Summary: ClosureCleanerTest fails with IllegalStateException Key: FLINK-11152 URL: https://issues.apache.org/jira/browse/FLINK-11152 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-11153) UdfAnalyzerTest fails with CodeAnalyzerException

2018-12-13 Thread Gary Yao (JIRA)
Gary Yao created FLINK-11153: Summary: UdfAnalyzerTest fails with CodeAnalyzerException Key: FLINK-11153 URL: https://issues.apache.org/jira/browse/FLINK-11153 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-11154) Upgrade Netty to 4.1.32

2018-12-13 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-11154: --- Summary: Upgrade Netty to 4.1.32 Key: FLINK-11154 URL: https://issues.apache.org/jira/browse/FLINK-11154 Project: Flink Issue Type: Improvement Compo

[jira] [Created] (FLINK-11155) HadoopFreeFsFactoryTest fails with ClassCastException

2018-12-13 Thread Gary Yao (JIRA)
Gary Yao created FLINK-11155: Summary: HadoopFreeFsFactoryTest fails with ClassCastException Key: FLINK-11155 URL: https://issues.apache.org/jira/browse/FLINK-11155 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-11156) ZooKeeperCompletedCheckpointStoreMockitoTest fails with IncompatibleClassChangeError

2018-12-13 Thread Gary Yao (JIRA)
Gary Yao created FLINK-11156: Summary: ZooKeeperCompletedCheckpointStoreMockitoTest fails with IncompatibleClassChangeError Key: FLINK-11156 URL: https://issues.apache.org/jira/browse/FLINK-11156 Project:

[jira] [Created] (FLINK-11157) Web UI should show timestamps relative to server time zone

2018-12-13 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-11157: --- Summary: Web UI should show timestamps relative to server time zone Key: FLINK-11157 URL: https://issues.apache.org/jira/browse/FLINK-11157 Project: Flink Issu

[jira] [Created] (FLINK-11158) Do not show empty page for unknown jobs

2018-12-13 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-11158: --- Summary: Do not show empty page for unknown jobs Key: FLINK-11158 URL: https://issues.apache.org/jira/browse/FLINK-11158 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Creating last bug fix release for 1.5 branch

2018-12-13 Thread Thomas Weise
Hi, I would be interested to try my hand at being the release manger for this. There are currently still 5 in-progress issues [1], all except [2] with an open PR. Nico, Chesnay, Till: Can you please take a look and see if these can be completed? Thanks, Thomas [1] https://issues.apache.org/ji

[jira] [Created] (FLINK-11159) Allow configuration whether to fall back to savepoints for restore

2018-12-13 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-11159: --- Summary: Allow configuration whether to fall back to savepoints for restore Key: FLINK-11159 URL: https://issues.apache.org/jira/browse/FLINK-11159 Project: Flink

[jira] [Created] (FLINK-11160) Confluent Avro Serialization Schema

2018-12-13 Thread Zhenhao Li (JIRA)
Zhenhao Li created FLINK-11160: -- Summary: Confluent Avro Serialization Schema Key: FLINK-11160 URL: https://issues.apache.org/jira/browse/FLINK-11160 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Creating last bug fix release for 1.5 branch

2018-12-13 Thread Chesnay Schepler
FLINK-11023: will not be fixed for 1.5.6; this would take significantly longer to implement, and TBH I'm not really keen on doing that for a final bugfix release. FLINK-7991: This is just a minor cleanup; the issue doesn't affect users in any way. It is thus not particularly important to have fo

Create version 1.7.1 in JIRA

2018-12-13 Thread Thomas Weise
Hi, Can a PMC member please create the version number 1.7.1. There are already some JIRAs with 1.7.2 version that may have to updated as well. https://issues.apache.org/jira/projects/FLINK?selectedItem=com.atlassian.jira.jira-projects-plugin:release-page&status=released-unreleased Thanks

Re: Create version 1.7.1 in JIRA

2018-12-13 Thread Chesnay Schepler
The 1.7.1 version already exists. As I'Ve already started the release process for 1.1 I have archived this version temporarily to save me the hassle of updating JIRAs that people now mark as fixed for 1.7.1 even though they aren't included. On 13.12.2018 21:17, Thomas Weise wrote: Hi, Can a

Thanks for hiding ASF GitHub Bot logs on JIRA

2018-12-13 Thread Tzu-Li Chen
Not sure how we arrive here but comments a bit noisy made by ASF GitHub Bot are now hidden to Work Log. Thank you! Best, tison.

Re: Thanks for hiding ASF GitHub Bot logs on JIRA

2018-12-13 Thread Chesnay Schepler
ehhfrom what I can tell this is not the case. On 13.12.2018 22:00, Tzu-Li Chen wrote: Not sure how we arrive here but comments a bit noisy made by ASF GitHub Bot are now hidden to Work Log. Thank you! Best, tison.

Re: Thanks for hiding ASF GitHub Bot logs on JIRA

2018-12-13 Thread Tzu-Li Chen
hmm..then what is it Chesnay Schepler 于2018年12月14日周五 上午5:07写道: > ehhfrom what I can tell this is not the case. > > On 13.12.2018 22:00, Tzu-Li Chen wrote: > > Not sure how we arrive here but comments a bit noisy made by ASF GitHub > Bot > > are now hidden to Work Log. Thank you! > > > > Bes

[jira] [Created] (FLINK-11161) Unable to import java packages in scala-shell

2018-12-13 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-11161: -- Summary: Unable to import java packages in scala-shell Key: FLINK-11161 URL: https://issues.apache.org/jira/browse/FLINK-11161 Project: Flink Issue Type: Improve

Apply for flink contributor permission

2018-12-13 Thread 宋辛童(五藏)
Hi there, Could anyone kindly give me the contributor permission? My JIRA id is: wuzang Thank You, Tony Xintong Song

[jira] [Created] (FLINK-11162) Provide a rest API to list all logical operators

2018-12-13 Thread vinoyang (JIRA)
vinoyang created FLINK-11162: Summary: Provide a rest API to list all logical operators Key: FLINK-11162 URL: https://issues.apache.org/jira/browse/FLINK-11162 Project: Flink Issue Type: New Feat

[jira] [Created] (FLINK-11163) RestClusterClientTest#testSendIsNotRetriableIfHttpNotFound with BindException

2018-12-13 Thread TisonKun (JIRA)
TisonKun created FLINK-11163: Summary: RestClusterClientTest#testSendIsNotRetriableIfHttpNotFound with BindException Key: FLINK-11163 URL: https://issues.apache.org/jira/browse/FLINK-11163 Project: Flink