Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-24 Thread Canbin Zheng
Congratulations !! Dawid Wysakowicz 于2020年2月24日周一 下午3:55写道: > Congratulations Jingsong! > > Best, > > Dawid > > On 24/02/2020 08:12, zhenya Sun wrote: > > Congratulations!!! > > | | > > zhenya Sun > > | > > | > > toke...@126.com > > | > > 签名由网易邮箱大师定制 > > > > > > On 02/24/2020 14:35,Yu Li wrote:

Re: [DISCUSS] Support notFollowedBy with interval as the last part of a Pattern

2020-02-24 Thread Dawid Wysakowicz
Hi Shuai, First of all let me apologize for a late reply. Unfortunately I don't have enough capacity to properly review and help with the proposal at this time. If there is another committer in the community willing to shepherd the proposal feel free to proceed with it. Another suggestion I may h

Re: [VOTE] FLIP-101: Add Pending Slots Detail

2020-02-24 Thread lining jing
Currently, users can't define slot resources. If there are pending slots, the main reason is that there are not enough slots, so the slot size is mainly displayed without more details. If slot resources can be set dynamically later, more information could be shown. Zhijiang 于2020年2月21日周五 下午11:22写

[jira] [Created] (FLINK-16255) Docs don't build

2020-02-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16255: Summary: Docs don't build Key: FLINK-16255 URL: https://issues.apache.org/jira/browse/FLINK-16255 Project: Flink Issue Type: Bug Components

Re: [VOTE] FLIP-100: Add Attempt Information

2020-02-24 Thread lining jing
I agree with Jark. The user can find the previous taskmanager according to the log link in the history of the attempt. The reason for adding attempts' information to the timeline is that for some reason, the job failover failed or took a long time. This problem is challenging to locate. As the cur

[jira] [Created] (FLINK-16256) HiveTableSourceTest / TableEnvHiveConnectorTest are failing on optimizer plan validation

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16256: -- Summary: HiveTableSourceTest / TableEnvHiveConnectorTest are failing on optimizer plan validation Key: FLINK-16256 URL: https://issues.apache.org/jira/browse/FLINK-16256

[jira] [Created] (FLINK-16257) Remove useless ResultPartitionID from AddCredit message

2020-02-24 Thread Zhijiang (Jira)
Zhijiang created FLINK-16257: Summary: Remove useless ResultPartitionID from AddCredit message Key: FLINK-16257 URL: https://issues.apache.org/jira/browse/FLINK-16257 Project: Flink Issue Type: I

Re: [DISCUSS] FLINK-16194: Refactor the Kubernetes architecture design

2020-02-24 Thread Yang Wang
It seems that we could benefit a lot from the "Parameters Parser". Let's start to add the dedicated jobmanager/taskmanager config parser classes. Best, Yang Canbin Zheng 于2020年2月24日周一 上午10:39写道: > Hi, Yang Wang, > > Thanks for the feedback. > > > Parameters Parser > > I can think of many benef

Re: [VOTE] FLIP-104: Add More Metrics to Jobmanager

2020-02-24 Thread Jark Wu
Hi Yadong, > what is the boundary between red and green? Yes. I think that's the point we need to discuss. My gut feeling is "<60%" => green, "60%~80%" => yellow, ">80%" => red. But I guess directed memory is always 100%, so it is not suitable for that? Maybe @Xintong Song has a better understand

Re: [DISCUSS] FLINK-16194: Refactor the Kubernetes architecture design

2020-02-24 Thread tison
Thank Canbin for starting the discussion and thanks for participating so far. I agree that we can start with the "Parameters Parser" part and actually split it into a self-contained issue. Best, tison. Yang Wang 于2020年2月24日周一 下午8:38写道: > It seems that we could benefit a lot from the "Paramete

[jira] [Created] (FLINK-16258) Update test utilities to FLIP-65

2020-02-24 Thread Timo Walther (Jira)
Timo Walther created FLINK-16258: Summary: Update test utilities to FLIP-65 Key: FLINK-16258 URL: https://issues.apache.org/jira/browse/FLINK-16258 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16259) Drop interface/impl separation for checkpoint Metadata and rename MetadataV2 to CheckpointMetadata

2020-02-24 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-16259: Summary: Drop interface/impl separation for checkpoint Metadata and rename MetadataV2 to CheckpointMetadata Key: FLINK-16259 URL: https://issues.apache.org/jira/browse/FLINK-1625

[jira] [Created] (FLINK-16260) Add Java 11 based version of the docker images

2020-02-24 Thread Jira
Ismaël Mejía created FLINK-16260: Summary: Add Java 11 based version of the docker images Key: FLINK-16260 URL: https://issues.apache.org/jira/browse/FLINK-16260 Project: Flink Issue Type: Ne

[jira] [Created] (FLINK-16261) Avoid unnecessary casting in TypeInferenceOperandChecker

2020-02-24 Thread Timo Walther (Jira)
Timo Walther created FLINK-16261: Summary: Avoid unnecessary casting in TypeInferenceOperandChecker Key: FLINK-16261 URL: https://issues.apache.org/jira/browse/FLINK-16261 Project: Flink Issu

[jira] [Created] (FLINK-16262) Class loader problem with FlinkKafkaProducer.Semantic.EXACTLY_ONCE and usrlib directory

2020-02-24 Thread Jira
Jürgen Kreileder created FLINK-16262: Summary: Class loader problem with FlinkKafkaProducer.Semantic.EXACTLY_ONCE and usrlib directory Key: FLINK-16262 URL: https://issues.apache.org/jira/browse/FLINK-16262

[jira] [Created] (FLINK-16263) BaseRowArrowReaderWriterTest/RowArrowReaderWriterTest sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16263: -- Summary: BaseRowArrowReaderWriterTest/RowArrowReaderWriterTest sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available Key: FLINK-16263 URL: https://issues.apac

[jira] [Created] (FLINK-16264) SQLClientKafkaITCase fails with: Could not map the schema field 'rowtime' to a field from source.

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16264: -- Summary: SQLClientKafkaITCase fails with: Could not map the schema field 'rowtime' to a field from source. Key: FLINK-16264 URL: https://issues.apache.org/jira/browse/FLINK-16

[jira] [Created] (FLINK-16265) TPC-H end-to-end test (Blink Planner): Encodings that differ from the schema are not supported yet for CsvTableSources.

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16265: -- Summary: TPC-H end-to-end test (Blink Planner): Encodings that differ from the schema are not supported yet for CsvTableSources. Key: FLINK-16265 URL: https://issues.apache.or

[jira] [Created] (FLINK-16266) es6 & 7 table sql connector conflicts each other

2020-02-24 Thread Benchao Li (Jira)
Benchao Li created FLINK-16266: -- Summary: es6 & 7 table sql connector conflicts each other Key: FLINK-16266 URL: https://issues.apache.org/jira/browse/FLINK-16266 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16267) Flink uses more memory than taskmanager.memory.process.size in Kubernetes

2020-02-24 Thread 陳昌倬
ChangZhuo Chen (陳昌倬) created FLINK-16267: Summary: Flink uses more memory than taskmanager.memory.process.size in Kubernetes Key: FLINK-16267 URL: https://issues.apache.org/jira/browse/FLINK-16267

[jira] [Created] (FLINK-16268) Failed to run rank over window with Hive built-in functions

2020-02-24 Thread Rui Li (Jira)
Rui Li created FLINK-16268: -- Summary: Failed to run rank over window with Hive built-in functions Key: FLINK-16268 URL: https://issues.apache.org/jira/browse/FLINK-16268 Project: Flink Issue Type:

Re: [VOTE] FLIP-103: Better TM/JM Log Display

2020-02-24 Thread Yadong Xie
Thanks all for the votes. So far, we have - 4 binding +1 votes (Kurt, Jark, jincheng, Zhu Zhu) - 5 non-binding +1 votes (Yang Wang, Xintong Song, lining, Yangze, zhenya) - No -1 votes The voting time has past and there are enough +1 votes to consider the FLIP-103 approved. Thank you all. Zhu Zh

Re: [VOTE] FLIP-98: Better Back Pressure Detection

2020-02-24 Thread Yadong Xie
Thanks all for the votes. So far, we have - 3 binding +1 votes (Kurt, Jark, zhijiang) - 4 non-binding +1 votes (Congxian, Wangyang, Benchao, Yun Gao) - No -1 votes The voting time has past and there are enough +1 votes to consider the FLIP-98 approved. Thank you all. Yun Gao 于2020年2月24日周一 上午10

[jira] [Created] (FLINK-16269) Generic type can not be matched when convert table to stream.

2020-02-24 Thread xiemeilong (Jira)
xiemeilong created FLINK-16269: -- Summary: Generic type can not be matched when convert table to stream. Key: FLINK-16269 URL: https://issues.apache.org/jira/browse/FLINK-16269 Project: Flink Is

Re: [DISCUSS] FLINK-16194: Refactor the Kubernetes architecture design

2020-02-24 Thread Canbin Zheng
Thanks, Yang Wang and tison, Since we have reached a consensus on the decorator design evolution and the parameters parser, and after an offline discussion with tison and Yang Wang, we have agreed on attaching one PR instead of two to avoid repeated code adapting and reviewing. Thanks for all the

[jira] [Created] (FLINK-16270) Use LogicalType to equals/hashcode in TableSchema

2020-02-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16270: Summary: Use LogicalType to equals/hashcode in TableSchema Key: FLINK-16270 URL: https://issues.apache.org/jira/browse/FLINK-16270 Project: Flink Issue Type:

[jira] [Created] (FLINK-16271) Introduce ArrowScalarFunctionOperator for vectorized Python UDF execution

2020-02-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-16271: --- Summary: Introduce ArrowScalarFunctionOperator for vectorized Python UDF execution Key: FLINK-16271 URL: https://issues.apache.org/jira/browse/FLINK-16271 Project: Flink

[jira] [Created] (FLINK-16272) Move Stateful Functions end-to-end test framework classes to common module

2020-02-24 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-16272: --- Summary: Move Stateful Functions end-to-end test framework classes to common module Key: FLINK-16272 URL: https://issues.apache.org/jira/browse/FLINK-16272

[DISCUSS] FLIP-106: Support Python UDF in SQL Function DDL

2020-02-24 Thread Wei Zhong
Hi everyone, I would like to start discussion about how to support Python UDF in SQL Function DDL. The SQL Function DDL(FLIP-79[1]) is a great feature which was introduced in the release of 1.10.0. However, it currently only supports creating Java/Scala UDF in the SQL Function DDL. Although FL

Re: [VOTE] FLIP-104: Add More Metrics to Jobmanager

2020-02-24 Thread Yadong Xie
Hi all we have updated the POC web, and added unit to GC metrics check it here http://101.132.122.69:8081/web/#/job-manager/metrics thanks for all the response Jark Wu 于2020年2月24日周一 下午8:48写道: > Hi Yadong, > > > what is the boundary between red and green? > Yes. I think that's the point we need t

Re: [VOTE] FLIP-102: Add More Metrics to TaskManager

2020-02-24 Thread Yadong Xie
Hi Xintong thanks for your advice, the POC web and the FLIP doc was updated now here is the new link: http://101.132.122.69:8081/web/#/task-manager/7e7cf0293645c8537caab915c829aa73/metrics Xintong Song 于2020年2月21日周五 下午12:00写道: > > > > 1. Should the managed memory be part of direct memory? > > >

Re: [VOTE] FLIP-101: Add Pending Slots Detail

2020-02-24 Thread Yadong Xie
Hi all Thanks for all your suggestions! > Hi Jark and Kurt I have redesigned the UI and move the pending slots information from the tab to the vertex graph > Hi Zhijiang The slots id could not be used to associated with slot detail in the current version as lining said, we can add more detaile

[jira] [Created] (FLINK-16273) Solve "sun.misc.Unseafe or java.nio.DirectByteBuffer.(long, int) not available" problem for users

2020-02-24 Thread Hequn Cheng (Jira)
Hequn Cheng created FLINK-16273: --- Summary: Solve "sun.misc.Unseafe or java.nio.DirectByteBuffer.(long, int) not available" problem for users Key: FLINK-16273 URL: https://issues.apache.org/jira/browse/FLINK-16273

Re: [VOTE] FLIP-100: Add Attempt Information

2020-02-24 Thread Yadong Xie
Hi Jark and Benchao The link to taks manager log was added to the attempt timeline now, here is the new POC url check it here: http://101.132.122.69:8081/web/#/job/9d651769488466d33e7a607e85203543/timeline thanks for your suggestions! lining jing 于2020年2月24日周一 下午5:16写道: > I agree with Jark. >

[jira] [Created] (FLINK-16274) Add typed builder methods for setting dynamic configuration on StatefulFunctionsAppContainers

2020-02-24 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-16274: --- Summary: Add typed builder methods for setting dynamic configuration on StatefulFunctionsAppContainers Key: FLINK-16274 URL: https://issues.apache.org/jira/browse/FL

Re: [VOTE] FLIP-104: Add More Metrics to Jobmanager

2020-02-24 Thread Xintong Song
@Jark First, let me try to clarify that, while this FLIP is about adding JM metrics, the discussion of having different colors distinguishing the memory usage applies for both JM and TM. IMO, I don't think there's a good way to define how should memory utilization be mapped to colors in general.