Re: Blink Planner HBaseUpsertTableSink Exception

2019-09-12 Thread Jark Wu
Hi Lake, This is not a problem of HBaseUpsertTableSink. This is because the query loses primary key (e.g. concat(key1, key2) will lose the primary key information [key1, key2] currently.), but the validation of inserting checks the upsert query should have a primary key. That’s why the exception i

Re: Blink Planner HBaseUpsertTableSink Exception

2019-09-12 Thread LakeShen
Thank you , Jark . I have added the primary key in my flink sql before , and it throwed the * Primary key and unique key are not supported yet. *Now I know it ,thank you sincerely to reply me . Best wishes, LakeShen Jark Wu 于2019年9月12日周四 下午3:15写道: > Hi Lake, > > This is not a problem of HBas

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

2019-09-12 Thread Stephan Ewen
Agreed, if we check in the old code, we should make it clear that it will be removed as soon as the FLIP-27 based version of the connector is there. We should not commit to maintaining the old version, that would be indeed too much overhead. On Thu, Sep 12, 2019 at 3:30 AM Becket Qin wrote: > Hi

[jira] [Created] (FLINK-14066) bug of building pyflink in master and 1.9.0 version

2019-09-12 Thread Xu Yang (Jira)
Xu Yang created FLINK-14066: --- Summary: bug of building pyflink in master and 1.9.0 version Key: FLINK-14066 URL: https://issues.apache.org/jira/browse/FLINK-14066 Project: Flink Issue Type: Bug

Re: Interested in contributing and looking for good first issues

2019-09-12 Thread Till Rohrmann
Hi Anoop, welcome to the Flink community. I think you've already read the right things in order to get started. As far as I know, the Flink community does not maintain a list of starter issues. Hence, I would recommend to take a look at the open issues and ask on issues which are interesting to y

Re: Interested in contributing and looking for good first issues

2019-09-12 Thread Zili Chen
Hi Anoop, Welcome to the Flick community. Although we don't maintain a list of starter issues so far, it would be helpful if you provide more information about which topic you are interested in. Flink servers stateful computations over data streams based on a series of layered concepts, such as S

Re: [DISCUSS] FLIP-56: Dynamic Slot Allocation

2019-09-12 Thread Xintong Song
Added implementation steps for this FLIP on the wiki page [1]. Thank you~ Xintong Song [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-56%3A+Dynamic+Slot+Allocation On Tue, Aug 20, 2019 at 3:43 PM Xintong Song wrote: > @Zili > > As far as I know, Timo is drafting a FLIP that ha

[jira] [Created] (FLINK-14067) Decouple PlanExecutor from JSON plan generation

2019-09-12 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-14067: Summary: Decouple PlanExecutor from JSON plan generation Key: FLINK-14067 URL: https://issues.apache.org/jira/browse/FLINK-14067 Project: Flink Issue

[jira] [Created] (FLINK-14068) Use Java's Duration instead of Flink's Time

2019-09-12 Thread TisonKun (Jira)
TisonKun created FLINK-14068: Summary: Use Java's Duration instead of Flink's Time Key: FLINK-14068 URL: https://issues.apache.org/jira/browse/FLINK-14068 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Use Java's Duration instead of Flink's Time

2019-09-12 Thread Zili Chen
Hi, I've given it a try to switch to Java's Duration for all runtime Java code. Generally, most of its usages are for @RpcTimeout and testing timeout. However, do a clean work without touch public interface possibly introduce bridge codes convert runtime Java Duration to Flink's Time. I don't thi

Re: [DISCUSS] FLIP-64: Support for Temporary Objects in Table module

2019-09-12 Thread Zhenghua Gao
Thanks david for pushing this forward. I have one concern about temporary objects and non-persistent catalog(e.g., GenericInMemoryCatalog). In SQL, temporary objects exist at the session level. They are only visible to the session in which they were created and are automatically dropped when that s

[jira] [Created] (FLINK-14069) Enable TimeUtils to parse all time units labels supported by scala Duration

2019-09-12 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14069: --- Summary: Enable TimeUtils to parse all time units labels supported by scala Duration Key: FLINK-14069 URL: https://issues.apache.org/jira/browse/FLINK-14069 Project: Flink

[SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Zhu Zhu
Hi everyone, I wanted to reach out to you and ask how many of you are using a customized RestartStrategy[1] in production jobs. We are currently developing the new Flink scheduler[2] which interacts with restart strategies in a different way. We have to re-design the interfaces for the new restar

[jira] [Created] (FLINK-14070) Use TimeUtils to parse duration configs

2019-09-12 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14070: --- Summary: Use TimeUtils to parse duration configs Key: FLINK-14070 URL: https://issues.apache.org/jira/browse/FLINK-14070 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14071) [for Documents Improvement] Add explicit&recommend path where jars files should be put for pyflink development

2019-09-12 Thread Xu Yang (Jira)
Xu Yang created FLINK-14071: --- Summary: [for Documents Improvement] Add explicit&recommend path where jars files should be put for pyflink development Key: FLINK-14071 URL: https://issues.apache.org/jira/browse/FLINK-140

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Zhu Zhu
Thanks Oytun for the reply! Sorry for not have stated it clearly. When saying "customized RestartStrategy", we mean that users implement an *org.apache.flink.runtime.executiongraph.restart.RestartStrategy* by themselves and use it by configuring like "restart-strategy: org.foobar.MyRestartStrategy

[jira] [Created] (FLINK-14072) Add a third-party maven repository for flink-shaded .

2019-09-12 Thread Jeff Yang (Jira)
Jeff Yang created FLINK-14072: - Summary: Add a third-party maven repository for flink-shaded . Key: FLINK-14072 URL: https://issues.apache.org/jira/browse/FLINK-14072 Project: Flink Issue Type: B

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Oytun Tez
Hi Zhu, We are using custom restart strategy like this: environment.setRestartStrategy(failureRateRestart(2, Time.minutes(1), Time.minutes(10))); --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Sep 12, 2019 at 7:11

Re: [DISCUSS] Use Java's Duration instead of Flink's Time

2019-09-12 Thread Stephan Ewen
I would deprecate "org.apache.flink.api.common.time.Time" only if we have alternative methods for the window api. If users can only write code by using a deprecated class, that would not be a good experience. Otherwise sound good. Best, Stephan On Thu, Sep 12, 2019 at 11:23 AM Zili Chen wrote:

Re: Checkpoint metrics.

2019-09-12 Thread Stephan Ewen
Hi Jamie! Did you mean to attach a screenshot? If yes, you need to share that through a different channel, the mailing list does not support attachments, unfortunately. Seth is right how the time is measured. One important bit to add to the interpretation: - For non-source tasks, the time inclu

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-12 Thread Zili Chen
Thanks a lot everyone for the warm welcome. Happy Mid-autumn Festival! Best, tison. Leonard Xu 于2019年9月12日周四 上午11:05写道: > Congratulations Zili Chen ! ! > > Best, > Leonard Xu > > On 2019年9月12日, at 上午11:02, Yun Tang wrote: > > > > Congratulations Zili > > > > Best > > Yun Tang > >