Apply for becoming a contributor of Flink

2019-07-10 Thread Caizhi Weng
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is TsReaper, my fullname is Caizhi Weng. Thanks a lot.

Confused by the `projectFields` Method in `ProjectableTableSource` Interface

2019-07-11 Thread Caizhi Weng
Hi Flink developers, When implementing `JDBCTableSource` with `ProjectableTableSource` interface I'm confused by the `projectFields` method. The java doc of the `projectFields` states that (It also has a typo... poduced -> produced): > Creates a copy of the {@link TableSource} that projects its

Re: Confused by the `projectFields` Method in `ProjectableTableSource` Interface

2019-07-12 Thread Caizhi Weng
" > > I am not 100% sure since it has been sometime since I look at the code, but > my understanding is: > the projectFields will be invoked twice. and generate 2 new instances of > the table source, with the same table schema > but one with produced type {a: Int, c: String}

Re: blink planner issue

2019-07-16 Thread Caizhi Weng
Hi Kaka and Jark, On a side note, `RowTypeInfo` only compares field types in its `equals` method. I think our new logical row type shouldn't break this behavior. kaka chen 于2019年7月16日周二 下午10:53写道: > Hi Jark, > > Thanks! > > Thanks, > Kaka Chen > > Jark Wu 于2019年7月16日周二 下午10:30写道: > > > Hi Kaka

Re: Issue running basic example locally

2019-07-18 Thread Caizhi Weng
Hi Andres, `provided` of flink-streaming-java seems suspicious, can you remove it and see what happens? Andres Angel 于2019年7月19日周五 上午3:10写道: > Hello everyone, > > I'm using IntelliJ in a ubuntu environment with java 1.8 to run my Flink > framworks. My goal is consume few kinesis stream services

Re: Probing of simple repartition hash join

2019-07-23 Thread Caizhi Weng
Hi Benjamin, As you mentioned hash join I assume that you are referring to `HashJoinOperator` in blink planner. The input is selected by `nextSelection` method. As you can see, it will first read all records in the build side then read all records in the probe side. So the probing will only start

[DISCUSS] Support "create [temporary] table" and "create [temporary] view" statements

2020-02-20 Thread Caizhi Weng
Hi dear Flink developers, I'm quite confused by the "create view" statement in SQL client. >From traditional database we expect that a view behaves just like a table except that it will be computed when used. We also expect that a view should be created under a database just like a table. But wh

Re: Contribution

2020-04-23 Thread Caizhi Weng
Hi Manish! Glad to hear that you're willing to contribute! All of our current tasks are on the JIRA issue list ( https://issues.apache.org/jira/projects/FLINK/issues). Feel free to pick what you like and start discussing and coding. Manish G 于2020年4月23日周四 下午7:35写道: > Hi All, > > I have just joi

Re: JIRA Contributor

2020-04-24 Thread Caizhi Weng
Hi shx, Glad to hear that you're willing to contribute! Flink currently does not have contributor permissions. To contribute to an issue, just reply to the issue with your thoughts and create a PR after the discussion with community about the issue. shx <17611022...@163.com> 于2020年4月24日周五 下午3:59写

Re: I love Flink

2019-12-03 Thread Caizhi Weng
Hi Boqi, It's really nice to hear that you would like to contribute. However community contribution rules have changed and now we don't have contributor permissions. To contribute, you can just open up a JIRA and share your ideas. Committers will assign it to you after the discussion in JIRA tick

Re: [DISCUSSION] Scan mode in Table Store for Flink Stream and Batch job

2022-12-11 Thread Caizhi Weng
Thanks Shammon for bringing up the discussion. My opinion is to combine everything into scan.mode so that we don't have orthogonal options. You first mention that there are two disadvantages for this solution. *1. The behaviors of some StartupModes in Stream and Batch jobs are inconsistent* This

Re: [DISCUSSION] Scan mode in Table Store for Flink Stream and Batch job

2022-12-14 Thread Caizhi Weng
ch as "full" in scan.mode looks nice. In this way, the > definition will be clearer, and the read mode will be unified through > scan.mode. Thanks > > > Best, > Shammon > > > On Mon, Dec 12, 2022 at 2:49 PM Caizhi Weng wrote: > >> Thanks Shammon for

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #1

2022-04-27 Thread Caizhi Weng
Hi all! -1 for this release. Currently we cannot write array and map types into table store due to this commit . Run the following SQL in SQL client and an exception will be thrown: create table if not ex

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-04-29 Thread Caizhi Weng
Hi all! +1 for the release (non-binding). I've tested the jar with a standalone cluster and SQL client. - Compiled the sources; - Run through quick start guide; - Test all supported data types; - Check that table store jar has no conflict with orc / avro format and kafka connector;

Re: [DISCUSS] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-09 Thread Caizhi Weng
Hi all! +1 for this FLIP. By adding schema information into data files we can not only support schema evolution, which is a very useful feature for data storages, but also make it easier for table store to integrate with other systems. For example timestamp type in Hive does not support precision

Re: [DISCUSS] Releasing Flink 1.14.1

2021-12-08 Thread Caizhi Weng
Hi devs! Sorry for the interruptions, but I just found an issue [1] (which I think is a blocking one) in every Flink version, including Flink 1.14.1. For Flink < 1.15, this issue will cause incorrect result when user cast two strings to numerics and compare the numerics. I'm planning for a quick

Re: Developing multiple Flink Pieplines

2022-01-24 Thread Caizhi Weng
Hi! If I should deploy these pipelines in one repository (one application where > I run the multiple services) or deploy each one individually? This depends on your use case. Running multiple jobs in one deployment is the session mode [1] which shares the job manager and task managers across all

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-06 Thread Caizhi Weng
Hi Gyula! Thanks for raising this discussion. I agree that this will be an interesting feature but I actually have some doubts about the motivation and use case. If there are multiple individual subgraphs in the same job, why not just distribute them to multiple jobs so that each job contains only

Re: 来自高大余的邮件

2022-02-08 Thread Caizhi Weng
Hi! Thanks for your interest in contributing to Flink! Currently there is no need (and actually there does not exist) a contributor permission. Feel free to open or reply to a JIRA ticket you're interested in, or to discuss in the mailing list with others. If you'd like to be assigned a JIRA ticke

Re: Flink restarts after hitting outOfMemory

2022-02-14 Thread Caizhi Weng
Hi! Heap memory usage depends heavily on your job and your state backend. Which state backend are you using and if possible could you share your user code or explain what operations your job is doing? Misha Hungyo 于2022年2月14日周一 16:56写道: > Hi, > I have a flink job that runs continuously(the job

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-27 Thread Caizhi Weng
-1 We're testing this version on batch jobs with large (600~1000) parallelisms and the following exception messages appear with high frequency: 2021-04-27 21:27:26 org.apache.flink.util.FlinkException: An OperatorEvent from an OperatorCoordinator to a task was lost. Triggering task failover to en

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-28 Thread Caizhi Weng
there is some incorrect reporting of failed events? > > On Wed, Apr 28, 2021 at 8:53 AM Caizhi Weng wrote: > > > -1 > > > > We're testing this version on batch jobs with large (600~1000) > parallelisms > > and the following exception messages appea

Re: [DISCUSS] Change Default Jira Priority from "Major" to "Minor"

2021-07-26 Thread Caizhi Weng
Hi Konstantin! Thanks for raising this up. From my point of view it is a reasonable change. But I think it would be better to handle different types of tickets respectively. For example, for bugs a default major seems to be better, while for others the default shall be minor. Konstantin Knauf 于2

Re: FW: Time windowing

2021-07-26 Thread Caizhi Weng
Hi! Window aggregations will only output results when the watermark rises above the end of window. Let's say the end of window is at 00:01, only when recvdTime is larger or equal than 00:06 will this window emit (because there is a 5 minutes out of orderness). If it is not the case then it indeed

Re: contribute to Apache Flink

2021-09-01 Thread Caizhi Weng
Hi! Thanks for your interest in contributing to Flink! Starting from a long time ago contributing to Flink does not need contributor permissions. If you have any issue you're interested in, just comment in that issue that you want to contribute and ask a committer to assign that issue to you. Alt

Re: [ANNOUNCE] Apache Flink 1.14.0 released

2021-09-30 Thread Caizhi Weng
Congratulations! As a side note, I notice that the MigrationVersion enum class is missing a 1.14 version, which should be added by the release managers. 在 2021年9月30日星期四,Etienne Chauchot 写道: > Thanks and congrats to everyone involved! > > Best > > Etienne Chauchot > > > On 29/09/2021 15:59, Dawi

Re: dataStream can not use multiple classloaders

2021-10-17 Thread Caizhi Weng
Hi! There is only one classloader for user code by default in runtime. The main method of your code is only executed on the client side. It generates a job graph and sends it to the cluster. To avoid class loading conflict it is recommended to shade the dependencies of your source and sink functi

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-11 Thread Caizhi Weng
Congrats, Leonard! Shuo Cheng 于2021年11月12日周五 下午3:12写道: > Congrats, Leonard! > > On Fri, Nov 12, 2021 at 2:35 PM godfrey he wrote: > > > Congrats & well deserved, Leonard! > > > > Best, > > Godfrey > > > > Yuepeng Pan 于2021年11月12日周五 下午2:28写道: > > > > > > Congrats. > > > > > > Best, > > > Yuepen

[DISCUSS] Allow user to unsubscribe by sending "Unsubscribe" directly to user mailing list

2021-11-15 Thread Caizhi Weng
Hi devs! I've seen unsubscribe emails coming into the mailing lists now and then these days (both user and user-zh mailing lists). Instead of telling the user to send emails to some specific email addresses again and again, can we allow user to unsubscribe by sending "Unsubscribe" directly to use

[DISCUSS] Shall casting functions return null or throw exceptions for invalid input

2021-11-17 Thread Caizhi Weng
Hi devs! We're discussing the behavior of casting functions (including cast, to_timestamp, to_date, etc.) for invalid input in https://issues.apache.org/jira/browse/FLINK-24924. As this topic is crucial to compatibility and usability we'd like to continue discussing this publicly in the mailing li

Re: [VOTE] Apache Flink Table Store 0.2.0, release candidate #2

2022-08-24 Thread Caizhi Weng
Hi all! -1 for this release candidate as Hive catalog and Hive connector fail to support Hive CDH. See https://issues.apache.org/jira/browse/FLINK-29071 for more detail. Yu Li 于2022年8月23日周二 17:31写道: > +1 (binding) > > - Checked release notes: *Action Required* > - Minor: there're still 25 op

Re: [ANNOUNCE] New Apache Flink Committer - Caizhi Weng

2022-09-10 Thread Caizhi Weng
57写道: > > > > > > > > > Congrats Chaizhi! > > > > > > > > > > Best, > > > > > Kurt > > > > > > > > > > > > > > > On Fri, Sep 9, 2022 at 2:44 PM yuxia > > > > wrot

Re: Questions about Flink Table Store

2022-11-09 Thread Caizhi Weng
Hi Alexander! Thanks for your interest in Flink Table Store and I'm glad to share my thoughts with you. Given that there is always a single writer to a stream, in what situations > can concurrent writes ever happen to Flink Table Store? I'm not the author of FLIP so I'm not sure what "writer" r

[jira] [Created] (FLINK-13198) Introduce TimeLength in configuration package

2019-07-10 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13198: --- Summary: Introduce TimeLength in configuration package Key: FLINK-13198 URL: https://issues.apache.org/jira/browse/FLINK-13198 Project: Flink Issue Type

[jira] [Created] (FLINK-13236) Fix bug and improve performance in TopNBuffer

2019-07-11 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13236: --- Summary: Fix bug and improve performance in TopNBuffer Key: FLINK-13236 URL: https://issues.apache.org/jira/browse/FLINK-13236 Project: Flink Issue Type

[jira] [Created] (FLINK-13258) Add tests for LongHashPartition, StringCallGen and EqualiserCodeGenerator

2019-07-15 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13258: --- Summary: Add tests for LongHashPartition, StringCallGen and EqualiserCodeGenerator Key: FLINK-13258 URL: https://issues.apache.org/jira/browse/FLINK-13258 Project

[jira] [Created] (FLINK-13304) Fix implementation of getString and getBinary method in NestedRow

2019-07-17 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13304: --- Summary: Fix implementation of getString and getBinary method in NestedRow Key: FLINK-13304 URL: https://issues.apache.org/jira/browse/FLINK-13304 Project: Flink

[jira] [Created] (FLINK-13322) Fix serializer snapshot recovery in BaseArray and BaseMap serializers.

2019-07-18 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13322: --- Summary: Fix serializer snapshot recovery in BaseArray and BaseMap serializers. Key: FLINK-13322 URL: https://issues.apache.org/jira/browse/FLINK-13322 Project: Flink

[jira] [Created] (FLINK-13323) Add tests for complex data formats (generic array, generic map, etc.)

2019-07-18 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13323: --- Summary: Add tests for complex data formats (generic array, generic map, etc.) Key: FLINK-13323 URL: https://issues.apache.org/jira/browse/FLINK-13323 Project: Flink

[jira] [Created] (FLINK-13348) Table schema is modified when pushing projection to table source

2019-07-21 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13348: --- Summary: Table schema is modified when pushing projection to table source Key: FLINK-13348 URL: https://issues.apache.org/jira/browse/FLINK-13348 Project: Flink

[jira] [Created] (FLINK-13410) Csv input format does not support LocalDate

2019-07-24 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13410: --- Summary: Csv input format does not support LocalDate Key: FLINK-13410 URL: https://issues.apache.org/jira/browse/FLINK-13410 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-13438) Fix Hive connector with DataTypes.DATE/TIME/TIMESTAMP support

2019-07-26 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13438: --- Summary: Fix Hive connector with DataTypes.DATE/TIME/TIMESTAMP support Key: FLINK-13438 URL: https://issues.apache.org/jira/browse/FLINK-13438 Project: Flink

[jira] [Created] (FLINK-13490) Fix return null in JDBCUtils::getFieldFromResultSet

2019-07-29 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-13490: --- Summary: Fix return null in JDBCUtils::getFieldFromResultSet Key: FLINK-13490 URL: https://issues.apache.org/jira/browse/FLINK-13490 Project: Flink Issue Type

[jira] [Created] (FLINK-13880) The behavior of JobExecutionResult.getAccumulatorResult does not match its java doc

2019-08-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-13880: --- Summary: The behavior of JobExecutionResult.getAccumulatorResult does not match its java doc Key: FLINK-13880 URL: https://issues.apache.org/jira/browse/FLINK-13880

[jira] [Created] (FLINK-15987) SELECT 1.0e0 / 0.0e0 throws NumberFormatException

2020-02-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-15987: --- Summary: SELECT 1.0e0 / 0.0e0 throws NumberFormatException Key: FLINK-15987 URL: https://issues.apache.org/jira/browse/FLINK-15987 Project: Flink Issue Type

[jira] [Created] (FLINK-16541) Document of table.exec.shuffle-mode is incorrect

2020-03-11 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-16541: --- Summary: Document of table.exec.shuffle-mode is incorrect Key: FLINK-16541 URL: https://issues.apache.org/jira/browse/FLINK-16541 Project: Flink Issue Type

[jira] [Created] (FLINK-16543) Support setting schedule mode by config for Blink planner in batch mode

2020-03-11 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-16543: --- Summary: Support setting schedule mode by config for Blink planner in batch mode Key: FLINK-16543 URL: https://issues.apache.org/jira/browse/FLINK-16543 Project: Flink

[jira] [Created] (FLINK-17023) The format checking of extractExecutionParams in config.sh is incorrect

2020-04-06 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17023: --- Summary: The format checking of extractExecutionParams in config.sh is incorrect Key: FLINK-17023 URL: https://issues.apache.org/jira/browse/FLINK-17023 Project: Flink

[jira] [Created] (FLINK-17045) If multiple views are based on tables not defined in the yaml config file, dropping one of the views will throw exception

2020-04-07 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17045: --- Summary: If multiple views are based on tables not defined in the yaml config file, dropping one of the views will throw exception Key: FLINK-17045 URL: https://issues.apache.org

[jira] [Created] (FLINK-17080) Utils.CollectHelper is possible to throw NPE if the sink is up but not initialized when the job fails

2020-04-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17080: --- Summary: Utils.CollectHelper is possible to throw NPE if the sink is up but not initialized when the job fails Key: FLINK-17080 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-17081) Batch test classes in Blink planner does not extend TestLogger

2020-04-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17081: --- Summary: Batch test classes in Blink planner does not extend TestLogger Key: FLINK-17081 URL: https://issues.apache.org/jira/browse/FLINK-17081 Project: Flink

[jira] [Created] (FLINK-17083) Restrict users of accumulators not to return null in Accumulator#getLocalValue

2020-04-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17083: --- Summary: Restrict users of accumulators not to return null in Accumulator#getLocalValue Key: FLINK-17083 URL: https://issues.apache.org/jira/browse/FLINK-17083 Project

[jira] [Created] (FLINK-17197) ContinuousFileReaderOperator might shade the real exception when processing records

2020-04-16 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17197: --- Summary: ContinuousFileReaderOperator might shade the real exception when processing records Key: FLINK-17197 URL: https://issues.apache.org/jira/browse/FLINK-17197

[jira] [Created] (FLINK-17396) Support SHOW MODULES in Flink SQL

2020-04-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17396: --- Summary: Support SHOW MODULES in Flink SQL Key: FLINK-17396 URL: https://issues.apache.org/jira/browse/FLINK-17396 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-14347) YARNSessionFIFOITCase.checkForProhibitedLogContents found a log with prohibited string

2019-10-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-14347: --- Summary: YARNSessionFIFOITCase.checkForProhibitedLogContents found a log with prohibited string Key: FLINK-14347 URL: https://issues.apache.org/jira/browse/FLINK-14347

[jira] [Created] (FLINK-14348) YarnFileStageTestS3ITCase. testRecursiveUploadForYarnS3a fails to delete files

2019-10-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-14348: --- Summary: YarnFileStageTestS3ITCase. testRecursiveUploadForYarnS3a fails to delete files Key: FLINK-14348 URL: https://issues.apache.org/jira/browse/FLINK-14348 Project

[jira] [Created] (FLINK-14960) Dependency shading of table modules test fails on Travis

2019-11-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-14960: --- Summary: Dependency shading of table modules test fails on Travis Key: FLINK-14960 URL: https://issues.apache.org/jira/browse/FLINK-14960 Project: Flink Issue

[jira] [Created] (FLINK-15570) Support inserting into non-empty csv tables

2020-01-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-15570: --- Summary: Support inserting into non-empty csv tables Key: FLINK-15570 URL: https://issues.apache.org/jira/browse/FLINK-15570 Project: Flink Issue Type

[jira] [Created] (FLINK-10036) Flink's CSV output format is not consistent with the standard.

2018-08-02 Thread Caizhi Weng (JIRA)
Caizhi Weng created FLINK-10036: --- Summary: Flink's CSV output format is not consistent with the standard. Key: FLINK-10036 URL: https://issues.apache.org/jira/browse/FLINK-10036 Project:

[jira] [Created] (FLINK-19411) MultipleInputStreamTask fails with RuntimeException when its input contains union

2020-09-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19411: --- Summary: MultipleInputStreamTask fails with RuntimeException when its input contains union Key: FLINK-19411 URL: https://issues.apache.org/jira/browse/FLINK-19411

[jira] [Created] (FLINK-19434) Add StreamJobGraphGenerator support for source chaining

2020-09-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19434: --- Summary: Add StreamJobGraphGenerator support for source chaining Key: FLINK-19434 URL: https://issues.apache.org/jira/browse/FLINK-19434 Project: Flink Issue

[jira] [Created] (FLINK-19621) Introduce Multi-input operator in Blink planner

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19621: --- Summary: Introduce Multi-input operator in Blink planner Key: FLINK-19621 URL: https://issues.apache.org/jira/browse/FLINK-19621 Project: Flink Issue Type

[jira] [Created] (FLINK-19623) Introduce ExecEdge to describe information on input edges for ExecNode

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19623: --- Summary: Introduce ExecEdge to describe information on input edges for ExecNode Key: FLINK-19623 URL: https://issues.apache.org/jira/browse/FLINK-19623 Project: Flink

[jira] [Created] (FLINK-19624) Update deadlock break-up algorithm to cover more cases

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19624: --- Summary: Update deadlock break-up algorithm to cover more cases Key: FLINK-19624 URL: https://issues.apache.org/jira/browse/FLINK-19624 Project: Flink Issue

[jira] [Created] (FLINK-19625) Introduce multi-input exec node

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19625: --- Summary: Introduce multi-input exec node Key: FLINK-19625 URL: https://issues.apache.org/jira/browse/FLINK-19625 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19626) Introduce multi-input operator construction algorithm

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19626: --- Summary: Introduce multi-input operator construction algorithm Key: FLINK-19626 URL: https://issues.apache.org/jira/browse/FLINK-19626 Project: Flink Issue

[jira] [Created] (FLINK-19627) Introduce multi-input operator for batch

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19627: --- Summary: Introduce multi-input operator for batch Key: FLINK-19627 URL: https://issues.apache.org/jira/browse/FLINK-19627 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19628) Introduce multi-input operator for streaming

2020-10-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19628: --- Summary: Introduce multi-input operator for streaming Key: FLINK-19628 URL: https://issues.apache.org/jira/browse/FLINK-19628 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-19641) Optimize parallelism calculating of HiveTableSource by checking file number

2020-10-14 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19641: --- Summary: Optimize parallelism calculating of HiveTableSource by checking file number Key: FLINK-19641 URL: https://issues.apache.org/jira/browse/FLINK-19641 Project

[jira] [Created] (FLINK-19756) Use multi-input optimization by default

2020-10-21 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19756: --- Summary: Use multi-input optimization by default Key: FLINK-19756 URL: https://issues.apache.org/jira/browse/FLINK-19756 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19769) Reuse StreamRecord in SourceOutputWithWatermarks#collect

2020-10-22 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19769: --- Summary: Reuse StreamRecord in SourceOutputWithWatermarks#collect Key: FLINK-19769 URL: https://issues.apache.org/jira/browse/FLINK-19769 Project: Flink Issue

[jira] [Created] (FLINK-19780) FlinkRelMdDistinctRowCount#getDistinctRowCount(Calc) will always return 0 when number of rows are large

2020-10-23 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19780: --- Summary: FlinkRelMdDistinctRowCount#getDistinctRowCount(Calc) will always return 0 when number of rows are large Key: FLINK-19780 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-19811) FlinkRexUtil#simplify should simplify search in conjunctions

2020-10-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19811: --- Summary: FlinkRexUtil#simplify should simplify search in conjunctions Key: FLINK-19811 URL: https://issues.apache.org/jira/browse/FLINK-19811 Project: Flink

[jira] [Created] (FLINK-19870) Fix special case when the reuse of exchange causes the deadlock

2020-10-28 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19870: --- Summary: Fix special case when the reuse of exchange causes the deadlock Key: FLINK-19870 URL: https://issues.apache.org/jira/browse/FLINK-19870 Project: Flink

[jira] [Created] (FLINK-19874) Apply JoinDeriveNullFilterRule after join reorder

2020-10-29 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19874: --- Summary: Apply JoinDeriveNullFilterRule after join reorder Key: FLINK-19874 URL: https://issues.apache.org/jira/browse/FLINK-19874 Project: Flink Issue Type

[jira] [Created] (FLINK-19908) FlinkLogicalTableSourceScan and CommonPhysicalTableSourceScan should respect source reuse config option

2020-10-31 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19908: --- Summary: FlinkLogicalTableSourceScan and CommonPhysicalTableSourceScan should respect source reuse config option Key: FLINK-19908 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-19939) Remove redundant union from multiple input node

2020-11-02 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19939: --- Summary: Remove redundant union from multiple input node Key: FLINK-19939 URL: https://issues.apache.org/jira/browse/FLINK-19939 Project: Flink Issue Type

[jira] [Created] (FLINK-19940) Task names on web UI should change when an operator chain is chained with sources

2020-11-02 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19940: --- Summary: Task names on web UI should change when an operator chain is chained with sources Key: FLINK-19940 URL: https://issues.apache.org/jira/browse/FLINK-19940

[jira] [Created] (FLINK-19959) Multiple input creation algorithm will deduce an incorrect input order if the inputs are related under PIPELINED shuffle mode

2020-11-03 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19959: --- Summary: Multiple input creation algorithm will deduce an incorrect input order if the inputs are related under PIPELINED shuffle mode Key: FLINK-19959 URL: https

[jira] [Created] (FLINK-19990) MultipleInputNodeCreationProcessor#isChainableSource should consider DataStreamScanProvider

2020-11-04 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-19990: --- Summary: MultipleInputNodeCreationProcessor#isChainableSource should consider DataStreamScanProvider Key: FLINK-19990 URL: https://issues.apache.org/jira/browse/FLINK-19990

[jira] [Created] (FLINK-20186) FactoryUtil will give an incorrect error message when multiple factories fit the connector identifier

2020-11-17 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-20186: --- Summary: FactoryUtil will give an incorrect error message when multiple factories fit the connector identifier Key: FLINK-20186 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-20187) FactoryUtil#createTableSource will be confused by a table source and a table sink factory with same identifier

2020-11-17 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-20187: --- Summary: FactoryUtil#createTableSource will be confused by a table source and a table sink factory with same identifier Key: FLINK-20187 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-20256) UDAF type inference will fail if accumulator contains MapView with Pojo value type

2020-11-20 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-20256: --- Summary: UDAF type inference will fail if accumulator contains MapView with Pojo value type Key: FLINK-20256 URL: https://issues.apache.org/jira/browse/FLINK-20256

[jira] [Created] (FLINK-20366) ColumnIntervalUtil#getColumnIntervalWithFilter does not consider the case when the predicate is a false constant

2020-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-20366: --- Summary: ColumnIntervalUtil#getColumnIntervalWithFilter does not consider the case when the predicate is a false constant Key: FLINK-20366 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-20663) Managed memory may not be released in time when operators use managed memory frequently

2020-12-17 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-20663: --- Summary: Managed memory may not be released in time when operators use managed memory frequently Key: FLINK-20663 URL: https://issues.apache.org/jira/browse/FLINK-20663

[jira] [Created] (FLINK-20887) Non-deterministic functions return different values even if it is referred with the same column name

2021-01-07 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-20887: --- Summary: Non-deterministic functions return different values even if it is referred with the same column name Key: FLINK-20887 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-30294) Change table property key 'log.scan' to 'startup.mode' and add a default startup mode in Table Store

2022-12-04 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30294: --- Summary: Change table property key 'log.scan' to 'startup.mode' and add a default startup mode in Table Store Key: FLINK-30294 URL: https://issues.apache.o

[jira] [Created] (FLINK-30410) Rename 'full' to 'latest-full' and 'compacted' to 'compacted-full' for scan.mode in Table Store

2022-12-14 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30410: --- Summary: Rename 'full' to 'latest-full' and 'compacted' to 'compacted-full' for scan.mode in Table Store Key: FLINK-30410 URL: https://i

[jira] [Created] (FLINK-30458) Refactor Table Store Documentation

2022-12-20 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30458: --- Summary: Refactor Table Store Documentation Key: FLINK-30458 URL: https://issues.apache.org/jira/browse/FLINK-30458 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-30504) Fix UnsupportedFileSystemSchemeException when writing Table Store on OSS with other engines

2022-12-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30504: --- Summary: Fix UnsupportedFileSystemSchemeException when writing Table Store on OSS with other engines Key: FLINK-30504 URL: https://issues.apache.org/jira/browse/FLINK-30504

[jira] [Created] (FLINK-30506) Add documentation for writing Table Store with Spark3

2022-12-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30506: --- Summary: Add documentation for writing Table Store with Spark3 Key: FLINK-30506 URL: https://issues.apache.org/jira/browse/FLINK-30506 Project: Flink Issue

[jira] [Created] (FLINK-30573) Table Store dedicated compact job may skip some records when checkpoint interval is long

2023-01-05 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30573: --- Summary: Table Store dedicated compact job may skip some records when checkpoint interval is long Key: FLINK-30573 URL: https://issues.apache.org/jira/browse/FLINK-30573

[jira] [Created] (FLINK-30589) Snapshot expiration should be skipped in Table Store dedicated writer jobs

2023-01-06 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30589: --- Summary: Snapshot expiration should be skipped in Table Store dedicated writer jobs Key: FLINK-30589 URL: https://issues.apache.org/jira/browse/FLINK-30589 Project

[jira] [Created] (FLINK-30620) Table Store Hive catalog supports specifying custom Hive metastore client

2023-01-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30620: --- Summary: Table Store Hive catalog supports specifying custom Hive metastore client Key: FLINK-30620 URL: https://issues.apache.org/jira/browse/FLINK-30620 Project

[jira] [Created] (FLINK-30646) Table Store Hive catalog throws ClassNotFoundException when custom hive-site.xml is presented

2023-01-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30646: --- Summary: Table Store Hive catalog throws ClassNotFoundException when custom hive-site.xml is presented Key: FLINK-30646 URL: https://issues.apache.org/jira/browse/FLINK-30646

[jira] [Created] (FLINK-30861) Table Store Hive Catalog throws java.lang.ClassNotFoundException: org.apache.hadoop.hive.common.ValidWriteIdList under certain environment

2023-01-31 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30861: --- Summary: Table Store Hive Catalog throws java.lang.ClassNotFoundException: org.apache.hadoop.hive.common.ValidWriteIdList under certain environment Key: FLINK-30861 URL: https

[jira] [Created] (FLINK-31429) Support CTAS(create table as) streaming job with schema changes in table store

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31429: --- Summary: Support CTAS(create table as) streaming job with schema changes in table store Key: FLINK-31429 URL: https://issues.apache.org/jira/browse/FLINK-31429 Project

[jira] [Created] (FLINK-31430) Support migrating states between different instances of TableWriteImpl and AbstractFileStoreWrite

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31430: --- Summary: Support migrating states between different instances of TableWriteImpl and AbstractFileStoreWrite Key: FLINK-31430 URL: https://issues.apache.org/jira/browse/FLINK-31430

[jira] [Created] (FLINK-31431) Support copying a FileStoreTable with latest schema

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31431: --- Summary: Support copying a FileStoreTable with latest schema Key: FLINK-31431 URL: https://issues.apache.org/jira/browse/FLINK-31431 Project: Flink Issue Type

[jira] [Created] (FLINK-31432) Introduce a special StoreWriteOperator to deal with schema changes

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31432: --- Summary: Introduce a special StoreWriteOperator to deal with schema changes Key: FLINK-31432 URL: https://issues.apache.org/jira/browse/FLINK-31432 Project: Flink

  1   2   3   >