Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread Dawid Wysakowicz
Hi all, Thank you very much Jincheng for the very thorough proposal. I was following the discussion very briefly, but I have an impression that the consensus in the previous discussion[1] was that we do not want to have an independent, flink specific multi language support but we want to collabora

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread Shaoxuan Wang
David, This proposal does not contradict with what we have discussed. Please check my reply in https://lists.apache.org/thread.html/f6f8116b4b38b0b2d70ed45b990d6bb1bcb33611fde6fdf32ec0e840@%3Cdev.flink.apache.org%3E on 2019/02/21. "Beam Python API and Flink Python TableAPI describe the DAG/pipeline

[jira] [Created] (FLINK-12109) Flink SQL hangs in StreamTableEnvironment.sqlUpdate, finally lead to java.lang.StackOverflowError

2019-04-04 Thread xu (JIRA)
xu created FLINK-12109: -- Summary: Flink SQL hangs in StreamTableEnvironment.sqlUpdate, finally lead to java.lang.StackOverflowError Key: FLINK-12109 URL: https://issues.apache.org/jira/browse/FLINK-12109 Project

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread Dawid Wysakowicz
Hi Shaoxuan, Yes, I've seen your message and I am not saying it already contradicts. I agree as long as we just define DAG/pipeline/logical plan it is a reasonable thing to do. No doubts about that. I have a feeling though it mentions at some points things that might be in the area of responsibili

Re: contributor permission

2019-04-04 Thread Chesnay Schepler
You know have contributor permissions. On 04/04/2019 07:10, 邵志鹏 wrote: Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is shaozhipeng. Thank you very much.

[jira] [Created] (FLINK-12110) Introduce API point for ShuffleService to get estimation of locally required memory

2019-04-04 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-12110: --- Summary: Introduce API point for ShuffleService to get estimation of locally required memory Key: FLINK-12110 URL: https://issues.apache.org/jira/browse/FLINK-12110

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread jincheng sun
Hi Thomas, Glad to see your feedback! Yes, we can add use case examples in both google doc and FLIP, I had already add the simple usage in the google doc, here I want to know which kind of examples you want? :) The very short answer to UDF support is Yes. As you said, we need UDF support on the

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread jincheng sun
Hi Dawid, Thanks for your feedback! Yes, you are right, there is no problem with two-way communication in our proposal. The two solutions proposed already support for two-way communication between Python and Java. Similar to the interface of from_collection/from_elements, our proposal can solve t

[jira] [Created] (FLINK-12111) TaskManagerProcessFailureBatchRecoveryITCase fails due to removed Slot

2019-04-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12111: Summary: TaskManagerProcessFailureBatchRecoveryITCase fails due to removed Slot Key: FLINK-12111 URL: https://issues.apache.org/jira/browse/FLINK-12111 Projec

[jira] [Created] (FLINK-12112) AbstractTaskManagerProcessFailureRecoveryTest process output logging does not work properly

2019-04-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12112: Summary: AbstractTaskManagerProcessFailureRecoveryTest process output logging does not work properly Key: FLINK-12112 URL: https://issues.apache.org/jira/browse/FLINK-1211

[Discuss] Semantics of event time for state TTL

2019-04-04 Thread Andrey Zagrebin
Hi All, As you might have already seen there is an effort tracked in FLINK-12005 [1] to support event time scale for state with time-to-live (TTL) [2]. While thinking about design, we realised that there can be multiple options for semantics of this feature, depending on use case. There is also so

[jira] [Created] (FLINK-12113) User code passing to fromCollection(Iterator, Class) not cleaned

2019-04-04 Thread yankai zhang (JIRA)
yankai zhang created FLINK-12113: Summary: User code passing to fromCollection(Iterator, Class) not cleaned Key: FLINK-12113 URL: https://issues.apache.org/jira/browse/FLINK-12113 Project: Flink

[jira] [Created] (FLINK-12114) Try to perform UDF By Reflection

2019-04-04 Thread dong (JIRA)
dong created FLINK-12114: Summary: Try to perform UDF By Reflection Key: FLINK-12114 URL: https://issues.apache.org/jira/browse/FLINK-12114 Project: Flink Issue Type: Improvement Components

Re: [Discuss] Semantics of event time for state TTL

2019-04-04 Thread Elias Levy
My 2c: Timestamp stored with the state value: Event timestamp Timestamp used to check expiration: Last emitted watermark That follows the event time processing model used elsewhere is Flink. E.g. events are segregated into windows based on their event time, but the windows do not fire until the

[jira] [Created] (FLINK-12115) Add support in Flink to persist state in Azure's blob store

2019-04-04 Thread Piyush Narang (JIRA)
Piyush Narang created FLINK-12115: - Summary: Add support in Flink to persist state in Azure's blob store Key: FLINK-12115 URL: https://issues.apache.org/jira/browse/FLINK-12115 Project: Flink

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread Shuyi Chen
Hi Thomas, I agreed that UDF support is important. As some of us might not be familiar with the effort on Apache Beam, It will be great if you can share some design documents on Beam's portability layer and multi-language support, and the current status. Thanks a lot. Regards Shuyi On Wed, Apr 3

New contributor to Apache Flink

2019-04-04 Thread Aizhamal Nurmamat kyzy
Hello everyone, My name is Aizhamal (pronounced as ai-ja-mal), I am a Program Manager in the Open Source Strategy team at Google. I was at Flink Forward in San Francisco a few days ago, and had the fortune to meet some of you in person. I would like to start contributing to Apache Flink. Could any

[jira] [Created] (FLINK-12116) Args autocast will cause exception for plan transformation in TableAPI

2019-04-04 Thread Xingcan Cui (JIRA)
Xingcan Cui created FLINK-12116: --- Summary: Args autocast will cause exception for plan transformation in TableAPI Key: FLINK-12116 URL: https://issues.apache.org/jira/browse/FLINK-12116 Project: Flink

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread Thomas Weise
Hi Jincheng, > > Yes, we can add use case examples in both google doc and FLIP, I had > already add the simple usage in the google doc, here I want to know which > kind of examples you want? :) > Do you have use cases where the Python table API can be applied without UDF support? (And where the

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-04 Thread Thomas Weise
Hu Shuyi, I would recommend to start with the following: https://docs.google.com/presentation/d/1AkU-QXSflau-RSeolB4TSLy0_mg0xwb398Czw7aqVGw/edit#slide=id.p https://www.youtube.com/watch?v=VsGQ2LFeTHY&list=PL4dEBWmGSIU_9JTGnkGVg6-BwaV0FMxyJ&index=12&t=0s For follow-up, there is plenty of knowled

Re: New contributor to Apache Flink

2019-04-04 Thread Thomas Weise
Done and welcome! On Thu, Apr 4, 2019 at 7:31 PM Aizhamal Nurmamat kyzy wrote: > Hello everyone, > > My name is Aizhamal (pronounced as ai-ja-mal), I am a Program Manager in > the Open Source Strategy team at Google. > I was at Flink Forward in San Francisco a few days ago, and had the fortune

Re: [VOTE] Release 1.8.0, release candidate #5

2019-04-04 Thread Rong Rong
+1 (non-binding) * Verified checksums and GPG files matches release files * Verified that the source archives do not contain any binaries * Built the source with Maven to ensure all source files have Apache headers * Checked that all POM files point to the same version * `mvn clean verify` against