[jira] [Created] (FLINK-15566) Flink implicitly order the fields in PojoTypeInfo

Jeff Zhang created FLINK-15566: -- Summary: Flink implicitly order the fields in PojoTypeInfo Key: FLINK-15566 URL: https://issues.apache.org/jira/browse/FLINK-15566 Project: Flink Issue Type: Imp

[jira] [Created] (FLINK-15567) Add documentation for INSERT statements for Flink SQL

Jark Wu created FLINK-15567: --- Summary: Add documentation for INSERT statements for Flink SQL Key: FLINK-15567 URL: https://issues.apache.org/jira/browse/FLINK-15567 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-15568) RestartPipelinedRegionStrategy: not ensure the EXACTLY_ONCE semantics

Andrew.D.lin created FLINK-15568: Summary: RestartPipelinedRegionStrategy: not ensure the EXACTLY_ONCE semantics Key: FLINK-15568 URL: https://issues.apache.org/jira/browse/FLINK-15568 Project: Flink

[jira] [Created] (FLINK-15569) Incorrect sample code in udf document

Jeff Zhang created FLINK-15569: -- Summary: Incorrect sample code in udf document Key: FLINK-15569 URL: https://issues.apache.org/jira/browse/FLINK-15569 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-15570) Support inserting into non-empty csv tables

Caizhi Weng created FLINK-15570: --- Summary: Support inserting into non-empty csv tables Key: FLINK-15570 URL: https://issues.apache.org/jira/browse/FLINK-15570 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-15571) Create a Redis Streams Connector for Flink

Tugdual Grall created FLINK-15571: - Summary: Create a Redis Streams Connector for Flink Key: FLINK-15571 URL: https://issues.apache.org/jira/browse/FLINK-15571 Project: Flink Issue Type: New

Re: [VOTE] FLIP-92: Add N-Ary Stream Operator in Flink

Hi, I was checking the official list of FLIP’s [1] and just took the “Next FLIP Number: 93” (which was 92 at that time), that’s why I didn’t notice your mailing list thread from the same day. Please next time first claim the number there and update the wiki. First edit [1] by reserving the num

[jira] [Created] (FLINK-15572) Function DDL is not compliant with FLIP-64

Timo Walther created FLINK-15572: Summary: Function DDL is not compliant with FLIP-64 Key: FLINK-15572 URL: https://issues.apache.org/jira/browse/FLINK-15572 Project: Flink Issue Type: Bug

[ANNOUNCE] Flink Forward San Francisco 2020 Call for Presentation extended!

Hi everyone, We know some of you only came back from holidays last week. To give you more time to submit a talk, we decided to extend the Call for Presentations for Flink Forward San Francisco 2020 until Sunday January 19th. The conference takes place on March 23-25 with two days of talks and one

Re:Re: [VOTE] FLIP-92: Add N-Ary Stream Operator in Flink

+1 (non-binding) Best, Haibo At 2020-01-13 11:36:12, "Yun Gao" wrote: >+1 (non-binding). > >Very thanks for introducing this topic back, and it should be able to bring >improvements in the discussed scenarios. > >Best, >Yun > > >

Re: [DISCUSS] Integrate Flink Docker image publication into Flink release process

Hey all, first of all a big thank you for driving many of the Docker image releases in the last two years. *(1) Moving docker-flink/docker-flink to apache/docker-flink* +1 to do this as you outlined. I would propose to aim for a first integration with the 1.10 release without major changes to th

[jira] [Created] (FLINK-15573) Let Flink SQL PlannerExpressionParserImpl#FieldRefrence use Unicode as its default charset

Lsw_aka_laplace created FLINK-15573: --- Summary: Let Flink SQL PlannerExpressionParserImpl#FieldRefrence use Unicode as its default charset Key: FLINK-15573 URL: https://issues.apache.org/jira/browse/FLINK-1557

[jira] [Created] (FLINK-15574) DataType to LogicalType conversion issue

Benoit Hanotte created FLINK-15574: -- Summary: DataType to LogicalType conversion issue Key: FLINK-15574 URL: https://issues.apache.org/jira/browse/FLINK-15574 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-15575) Azure Filesystem Shades Wrong Package "httpcomponents"

Konstantin Knauf created FLINK-15575: Summary: Azure Filesystem Shades Wrong Package "httpcomponents" Key: FLINK-15575 URL: https://issues.apache.org/jira/browse/FLINK-15575 Project: Flink

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

Hi all, While working on changing process memory to Flink memory in default configuration, Xintong encountered a problem. When -tm option is used to rewrite container memory, basically process memory, it can collide with the default Flink memory. For legacy users it should not be a problem as we a

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

I think we need an interpretation of "-tm" regardless of what is in the default configuration, because we can always have a modified configuration and then a user passes the "-tm" flag. I kind of like the first proposal: Interpret "-tm" as "override memory size config and set the Yarn TM container

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

Would be good to hear the thoughts of some more Yarn users, though. On Mon, Jan 13, 2020 at 7:23 PM Stephan Ewen wrote: > I think we need an interpretation of "-tm" regardless of what is in the > default configuration, because we can always have a modified configuration > and then a user passes

Understanding watermark

Hello Flink expert, We have a pipeline that read both bounded and unbounded sources and our understanding is that when the bounded sources complete they should get a watermark of +inf and then we should be able to take a savepoint and safely restart the pipeline. However, we have source that never

Re: [Discuss] Tuning FLIP-49 configuration default values.

Hi all! Thanks a lot, Xintong, for this thorough analysis. Based on your analysis, here are some thoughts: +1 to change default JVM metaspace size from 128MB to 64MB +1 to change default JVM overhead min size from 128MB to 196MB Concerning the managed memory fraction, I am not sure I would chang

[jira] [Created] (FLINK-15576) remove isTemporary property from CatalogFunction API

Bowen Li created FLINK-15576: Summary: remove isTemporary property from CatalogFunction API Key: FLINK-15576 URL: https://issues.apache.org/jira/browse/FLINK-15576 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-15577) LoggicalWindowAggregate Rel nodes missing Window specs in digest

Benoit Hanotte created FLINK-15577: -- Summary: LoggicalWindowAggregate Rel nodes missing Window specs in digest Key: FLINK-15577 URL: https://issues.apache.org/jira/browse/FLINK-15577 Project: Flink

[jira] [Created] (FLINK-15578) Implement exactly-once JDBC sink

Roman Khachatryan created FLINK-15578: - Summary: Implement exactly-once JDBC sink Key: FLINK-15578 URL: https://issues.apache.org/jira/browse/FLINK-15578 Project: Flink Issue Type: New Fe

Re: [Discuss] Tuning FLIP-49 configuration default values.

HI Xingtong, IIRC during our tpc-ds 10T benchmark, we have suffered by JM's metaspace size and full gc which caused by lots of classloadings of source input split. Could you check whether changing the default value from 128MB to 64MB will make it worse? Correct me if I misunderstood anything, als

Re: Re: [VOTE] FLIP-92: Add N-Ary Stream Operator in Flink

+1 (non-binding). Thanks for driving this. It's an important improvement in the discussed scenarios. *Best Regards,* *Zhenghua Gao* On Mon, Jan 13, 2020 at 6:13 PM Haibo Sun wrote: > +1 (non-binding) > > > Best, > Haibo > > At 2020-01-13 11:36:12, "Yun Gao" wrote: > >+1 (non-binding). > > > >

Re: [Discuss] Tuning FLIP-49 configuration default values.

Thanks for the feedback, Stephan and Kurt. @Stephan Regarding managed memory fraction, - It makes sense to keep the default value 0.4, if we assume rocksdb memory is limited by default. - AFAIK, currently rocksdb by default does not limit its memory usage. And I'm positive to change it. - Persona

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

True, even we have "process.size" rather than "flink.size" in the default config file, user can still have "flink.size" in their custom config file. If we consider "-tm" as a shortcut for users to override the TM memory size, then it makes less sense to require users to remove "flink.size" from the

Re: [DISCUSS] Add N-Ary Stream Operator

Hi I noticed that previous design doc [1] also talked about the topic of introducing new KeyedStreamOperatorNG, I wonder is that a must-do to introduce N-ary stream operator? [1] https://docs.google.com/document/d/1ZFzL_0xGuUEnBsFyEiHwWcmCcjhd9ArWsmhrgnt05RI Best Yun Tang ___

Re: Storing offsets in Kafka

Hi jiangjie, Yeah I am using the second case. (Flink 1.7.1, Kafka 0.10.2, FlinkKafkaConsumer010) But now there is a problem, the data is consumed normally, but the commit offset is not continued. The following exception is found: [image: image.png] Becket Qin 于2019年9月5日周四 上午11:32写道： > Hi Do

[jira] [Created] (FLINK-15579) Can not use jdbc connector on Blink batch mode

Shu Li Zheng created FLINK-15579: Summary: Can not use jdbc connector on Blink batch mode Key: FLINK-15579 URL: https://issues.apache.org/jira/browse/FLINK-15579 Project: Flink Issue Type: B

[jira] [Created] (FLINK-15580) Add baseurl to docs/build_docs.sh

Benchao Li created FLINK-15580: -- Summary: Add baseurl to docs/build_docs.sh Key: FLINK-15580 URL: https://issues.apache.org/jira/browse/FLINK-15580 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-15581) SpillingResettableMutableObjectIterator data overflow

Piotr Nowojski created FLINK-15581: -- Summary: SpillingResettableMutableObjectIterator data overflow Key: FLINK-15581 URL: https://issues.apache.org/jira/browse/FLINK-15581 Project: Flink Iss

Re: Data overflow in SpillingResettableMutableObjectIterator

Hi Jian, Thank your for reporting the issue. I see that you have already created a ticket for this [1]. Piotrek [1] https://issues.apache.org/jira/browse/FLINK-15549 > On 9 Jan 2020, at 09:10, Jian Cao wrote: > > Hi all: > We are using fl