[jira] [Created] (FLINK-35502) compress the checkpoint metadata ZK/ETCD HA Services

2024-06-01 Thread Ying Z (Jira)
Ying Z created FLINK-35502: -- Summary: compress the checkpoint metadata ZK/ETCD HA Services Key: FLINK-35502 URL: https://issues.apache.org/jira/browse/FLINK-35502 Project: Flink Issue Type

[jira] [Created] (FLINK-27697) Restoring from a checkpoint will start duplicated application when mixing use streaming sinks and sql sinks in code.

2022-05-19 Thread Ying Lin (Jira)
Ying Lin created FLINK-27697: Summary: Restoring from a checkpoint will start duplicated application when mixing use streaming sinks and sql sinks in code. Key: FLINK-27697 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-23304) More detail information in sql validate exception

2021-07-07 Thread YING HOU (Jira)
YING HOU created FLINK-23304: Summary: More detail information in sql validate exception Key: FLINK-23304 URL: https://issues.apache.org/jira/browse/FLINK-23304 Project: Flink Issue Type

[jira] [Created] (FLINK-22205) Does it support gpu coding in flink?

2021-04-11 Thread ying zhang (Jira)
ying zhang created FLINK-22205: -- Summary: Does it support gpu coding in flink? Key: FLINK-22205 URL: https://issues.apache.org/jira/browse/FLINK-22205 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-22204) Does it support rate-limiting in flink 1.12?

2021-04-11 Thread ying zhang (Jira)
ying zhang created FLINK-22204: -- Summary: Does it support rate-limiting in flink 1.12? Key: FLINK-22204 URL: https://issues.apache.org/jira/browse/FLINK-22204 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22086) Read hive

2021-04-01 Thread ying zhang (Jira)
ying zhang created FLINK-22086: -- Summary: Read hive Key: FLINK-22086 URL: https://issues.apache.org/jira/browse/FLINK-22086 Project: Flink Issue Type: Bug Reporter: ying zhang

[jira] [Created] (FLINK-22009) when data type is map,we cannot union

2021-03-29 Thread ying zhang (Jira)
ying zhang created FLINK-22009: -- Summary: when data type is map,we cannot union Key: FLINK-22009 URL: https://issues.apache.org/jira/browse/FLINK-22009 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21683) java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader

2021-03-08 Thread ying zhang (Jira)
ying zhang created FLINK-21683: -- Summary: java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader Key: FLINK-21683 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-21682) java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader

2021-03-08 Thread ying zhang (Jira)
ying zhang created FLINK-21682: -- Summary: java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader Key: FLINK-21682 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-21681) java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader

2021-03-08 Thread ying zhang (Jira)
ying zhang created FLINK-21681: -- Summary: java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl cannot be cast to org.apache.orc.Reader Key: FLINK-21681 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-19244) CsvRowDataDeserializationSchema throws cast exception : Row length mismatch.

2020-09-15 Thread Ying Z (Jira)
Ying Z created FLINK-19244: -- Summary: CsvRowDataDeserializationSchema throws cast exception : Row length mismatch. Key: FLINK-19244 URL: https://issues.apache.org/jira/browse/FLINK-19244 Project: Flink

[jira] [Created] (FLINK-18782) How to retain the column'name when convert a Table to DataStream

2020-07-31 Thread Ying Z (Jira)
Ying Z created FLINK-18782: -- Summary: How to retain the column'name when convert a Table to DataStream Key: FLINK-18782 URL: https://issues.apache.org/jira/browse/FLINK-18782 Project: Flink

[jira] [Created] (FLINK-15719) Exceptions when using scala types directly with the State Process API

2020-01-21 Thread Ying Z (Jira)
Ying Z created FLINK-15719: -- Summary: Exceptions when using scala types directly with the State Process API Key: FLINK-15719 URL: https://issues.apache.org/jira/browse/FLINK-15719 Project: Flink

[jira] [Created] (FLINK-15476) Update StreamingFileSink documentation -- bulk encoded writer now supports customized checkpoint policy

2020-01-03 Thread Ying Xu (Jira)
Ying Xu created FLINK-15476: --- Summary: Update StreamingFileSink documentation -- bulk encoded writer now supports customized checkpoint policy Key: FLINK-15476 URL: https://issues.apache.org/jira/browse/FLINK-15476

[jira] [Created] (FLINK-15301) Flink Kinesis AsyncRecordEmitter needs to handle unchecked exception gracefully

2019-12-17 Thread Ying Xu (Jira)
Ying Xu created FLINK-15301: --- Summary: Flink Kinesis AsyncRecordEmitter needs to handle unchecked exception gracefully Key: FLINK-15301 URL: https://issues.apache.org/jira/browse/FLINK-15301 Project: Flink

[jira] [Created] (FLINK-14508) google protobuf is not shaded

2019-10-23 Thread YING HOU (Jira)
YING HOU created FLINK-14508: Summary: google protobuf is not shaded Key: FLINK-14508 URL: https://issues.apache.org/jira/browse/FLINK-14508 Project: Flink Issue Type: Bug Components

[jira] [Created] (FLINK-14039) Flink Kinesis consumer: configurable per-shard consumption rate when running in adaptive mode

2019-09-10 Thread Ying Xu (Jira)
Ying Xu created FLINK-14039: --- Summary: Flink Kinesis consumer: configurable per-shard consumption rate when running in adaptive mode Key: FLINK-14039 URL: https://issues.apache.org/jira/browse/FLINK-14039

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-06 Thread ying
Congratulations Kostas! On Fri, Sep 6, 2019 at 11:21 PM Gary Yao wrote: > Congratulations Klou! > > On Sat, Sep 7, 2019 at 6:21 AM Thomas Weise wrote: > > > Congratulations! > > > > > > On Fri, Sep 6, 2019 at 9:22 AM zhijiang > .invalid> > > wrote: > > > > > Congratulations Klou! > > > > > > B

Re: Custom type serializer inside Flink state

2019-08-07 Thread Ying Xu
a high-level example. In practice, our app is more complex, with a much larger number of protobuf classes. Messages may be added/deleted across different versions of the Flink app. On Wed, Aug 7, 2019 at 11:23 AM Yun Tang wrote: > Hi Ying > > What version of Flink are you using and please

Custom type serializer inside Flink state

2019-08-07 Thread Ying Xu
Hi Flink community: Our Flink application sends different types of protobuf messages on-the-wire. Since protobuf cannot be handled by Flink type serializer, we had to register custom Kyro serializer: env.getConfig().*registerTypeWithKryoSerializer*(MyProtoClass1.class, ProtobufSerializer.class);

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

2019-07-03 Thread Ying Xu
Hi Kostas: For simplicity FLINK-13027 <https://issues.apache.org/jira/browse/FLINK-13027> has been assigned to my current user ID. I will contribute using that ID. Will circulate with the community once we have initial success with this new rolling policy ! Thank you again. - Ying

Contributor permission

2019-07-01 Thread ying
Dear Flink community: Per an earlier discussion thread, I created FLINK-13027 and would like to contribute to it. Is it possible to grant me the Contributor access? *yxu-apache <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=yxu-apache>* Thanks in advance. - Ying PS:

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

2019-06-28 Thread Ying Xu
d you mind granting me the contributor access for the following account ? This way I can assign the JIRA to myself. *yxu-apache <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=yxu-apache>* Many thanks! <http://www.lyft.com/> - Ying On Fri, Jun 28, 2019 at 2:23

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

2019-06-28 Thread Ying Xu
an happy to contribute if there's no other plan to address this issue. Thanks again. - Bests Ying On Tue, Jun 25, 2019 at 2:24 AM Kostas Kloudas wrote: > Hi Ying, > > You are right! If it is either on checkpoint or on size, then this is > doable even with the current state o

[jira] [Created] (FLINK-13027) StreamingFileSink bulk-encoded writer supports file rolling upon customized events

2019-06-28 Thread Ying Xu (JIRA)
Ying Xu created FLINK-13027: --- Summary: StreamingFileSink bulk-encoded writer supports file rolling upon customized events Key: FLINK-13027 URL: https://issues.apache.org/jira/browse/FLINK-13027 Project

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

2019-06-25 Thread Ying Xu
ing() <https://github.com/apache/flink/blob/3702029f45b7034b767e2b7eb01601c7f76ab35e/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/filesystem/Bucket.java#L275>. Not sure if I miss anything there. - Ying On Mon, Jun 24, 2019 at 2:01 AM Kostas Kloudas

Rolling policy when using StreamingFileSink for bulk-encoded output

2019-06-24 Thread Ying Xu
rantee. Any advises on whether the above idea makes sense? Or perhaps there are pitfalls that one might pay attention when introducing such rolling policy. Thanks a lot! - Ying

[jira] [Created] (FLINK-10358) Flink kinesis connector could throw NPE during getRecords() call

2018-09-17 Thread Ying Xu (JIRA)
Ying Xu created FLINK-10358: --- Summary: Flink kinesis connector could throw NPE during getRecords() call Key: FLINK-10358 URL: https://issues.apache.org/jira/browse/FLINK-10358 Project: Flink

Re: Kinesis connector shard discovery mechanism

2018-09-13 Thread Ying Xu
+1 on separating out the logic relevant to Kinesalite. Kinesalite is likely used in testing environment a lot. On Thu, Sep 13, 2018 at 1:52 AM, Евгений Юшин wrote: > Hi there > > Flink Kinesis consumer checks shards id for a particular pattern: > "^shardId-\\d{12}" > > https://github.com/apache

Re: Consuming data from dynamoDB streams to flink

2018-08-01 Thread Ying Xu
Thank you so much Fabian! Will update status in the JIRA. - Ying On Tue, Jul 31, 2018 at 1:37 AM, Fabian Hueske wrote: > Done! > > Thank you :-) > > 2018-07-31 6:41 GMT+02:00 Ying Xu : > > > Thanks Fabian and Thomas. > > > > Please assign FLINK-4582 to

Re: Consuming data from dynamoDB streams to flink

2018-07-30 Thread Ying Xu
Thanks Fabian and Thomas. Please assign FLINK-4582 to the following username: *yxu-apache <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=yxu-apache>* If needed I can get a ICLA or CCLA whichever is proper. *Ying Xu* Software Engineer 510.368.1252 <+15103681252>

Re: Consuming data from dynamoDB streams to flink

2018-07-30 Thread Ying Xu
granted with a contributor role? Many thanks in advance. *Ying Xu* Software Engineer 510.368.1252 <+15103681252> [image: Lyft] <http://www.lyft.com/> On Fri, Jul 6, 2018 at 6:23 PM, Ying Xu wrote: > Hi Gordon: > > Cool. Thanks for the thumb-up! > > We will include

Re: Consuming data from dynamoDB streams to flink

2018-07-06 Thread Ying Xu
Hi Gordon: Cool. Thanks for the thumb-up! We will include some test cases around the behavior of re-sharding. If needed we can double check the behavior with AWS, and see if additional changes are needed. Will keep you posted. - Ying On Wed, Jul 4, 2018 at 7:22 PM, Tzu-Li (Gordon) Tai wrote

Re: Consuming data from dynamoDB streams to flink

2018-07-03 Thread Ying Xu
HI Gordon: We are starting to implement some of the primitives along this path. Please let us know if you have any suggestions. Thanks! On Fri, Jun 29, 2018 at 12:31 AM, Ying Xu wrote: > Hi Gordon: > > Really appreciate the reply. > > Yes our plan is to build the connecto

Re: Consuming data from dynamoDB streams to flink

2018-06-29 Thread Ying Xu
me e.g, FlinkDynamoStreamConsumer. At best this could simply work. But we would like to hear if there are other situations to take care of. In particular, I am wondering what's the *"resharding behavior"* mentioned in FLINK-4582. Thanks a lot! - Ying On Wed, Jun 27, 2018 at 10:43 PM

Re: Consuming data from dynamoDB streams to flink

2018-06-27 Thread Ying Xu
Thanks Fabian for the suggestion. *Ying Xu* Software Engineer 510.368.1252 <+15103681252> [image: Lyft] <http://www.lyft.com/> On Wed, Jun 27, 2018 at 2:01 AM, Fabian Hueske wrote: > Hi Ying, > > I'm not aware of any effort for this issue. > You could check wit

Consuming data from dynamoDB streams to flink

2018-06-26 Thread Ying Xu
y much. - Ying