[jira] [Created] (FLINK-37327) Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows

2025-02-14 Thread Kevin Lam (Jira)
Kevin Lam created FLINK-37327: - Summary: Debezium Avro Format: Add FormatOption to Optionally Skip emitting UPDATE_BEFORE Rows Key: FLINK-37327 URL: https://issues.apache.org/jira/browse/FLINK-37327

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-14 Thread Kevin Cheng
Hi Xiangyu and Ron, I agree that sink reuse can be enabled by default from Flink Planner perspective. But the planner should be informed by Sink Connector that whether the planner can reuse different sink with different target columns. Take JBDC sink as an example, under partial update circumstan

[jira] [Created] (FLINK-36017) Support Passing Metadata to Formats in KafkaDynamicSink

2024-08-08 Thread Kevin Lam (Jira)
Kevin Lam created FLINK-36017: - Summary: Support Passing Metadata to Formats in KafkaDynamicSink Key: FLINK-36017 URL: https://issues.apache.org/jira/browse/FLINK-36017 Project: Flink Issue Type

[Flink SQL Format] How to Process Metadata Columns in KafkaDynamicSink compatible EncodingFormat

2024-08-07 Thread Kevin Lam
Hi there, I'm looking to add some functionality to a custom Format that reads the `topic` metadata column in the context of serialization using the Flink SQL Kafka Connector. I'm c

[FLINK-22748] Update for "Allow dynamic target topic selection in SQL Kafka sinks"

2024-07-23 Thread Kevin Lam
Hi there, I've spent some time picking up the existing work for FLINK-22748 , and created a PR, building on Nicholas Jiang's work: https://github.com/apache/flink-connector-kafka/pull/109 I saw the issue is marked stale, so I'm starting this mai

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-19 Thread Kevin Lam
Apologies David, here's a temporary link to the image: https://screenshot.click/19-19-0xwls-jfx7s.png On Thu, Jul 18, 2024 at 9:00 AM David Radley wrote: > Hi Kevin, > That sounds good, unfortunately the image did not come through in the > email for me,kind regards, David &

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-07-19 Thread Kevin Lam
mats, > > > there is no schema id in the config, but there is the ability to > specify > > a > > > complete schema. In the protobuf format there is no schema id. > > > > > > I assume the schema id would be used during serialize in the case there > &g

[jira] [Created] (FLINK-35808) Let ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG be overridable by user in KafkaSourceBuilder

2024-07-10 Thread Kevin Lam (Jira)
Kevin Lam created FLINK-35808: - Summary: Let ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG be overridable by user in KafkaSourceBuilder Key: FLINK-35808 URL: https://issues.apache.org/jira/browse/FLINK-35808

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-10 Thread Kevin Lam
e.png] > I assume you would want to add configuration to define where the external > storage lives and authentication. Limitations around stack and heap sizes > would be worth considering. Yes, we're implementing the 'claim check' pattern and this is definitely something

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-10 Thread Kevin Lam
23c216/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/KafkaSourceBuilder.java#L464> to make it overridable. I'm planning to start a separate thread to propose making `value.serializer` overridable. On Mon, Jul 8, 2024 at 11:18 AM Kevin Lam wrote: > Hi Fa

Re: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-08 Thread Kevin Lam
Hi David, Any updates on the Kafka Message Header support? I am also interested in supporting headers with the Flink SQL Formats: https://lists.apache.org/thread/spl88o63sjm2dv4l5no0ym632d2yt2o6 On Fri, Jun 14, 2024 at 6:10 AM David Radley wrote: > Hi everyone, > I have talked with Chesnay and

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-08 Thread Kevin Lam
4 at 10:08 AM Fabian Paul wrote: > Hi Kevin, > > I worked on a project [1] in the past that had a similar purpose. You > should be able to use a similar approach with the existing KafkaSource by > implementing your own KafkaRecordDeserializationSchema that hides the logic > of pullin

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-08 Thread Kevin Lam
currently I was also exploring making this work in Flink. On Mon, Jul 8, 2024 at 3:23 AM Martijn Visser wrote: > Hi Kevin, > > I just want to double check, were you planning to send this proposal to the > Kafka Dev mailing list? Because I don't see directly how this aff

Potential Kafka Connector FLIP: Large Message Handling

2024-07-05 Thread Kevin Lam
Hi all, Writing to see if the community would be open to exploring a FLIP for the Kafka Table Connectors. The FLIP would allow for storing Kafka Messages beyond a Kafka cluster's message limit (1 MB by default) out of band in cloud object storage or another backend. During serialization the messa

Re: Poor Load Balancing across TaskManagers for Multiple Kafka Sources

2024-06-06 Thread Kevin Lam
wrote: > Hi Kevin, > > The problem here is about how to evenly distribute partitions from > multiple Kafka topics to tasks, while FLIP-370 is only concerned about how > to evenly distribute tasks to slots & taskmanagers, so FLIP-370 won't help >

Re: Poor Load Balancing across TaskManagers for Multiple Kafka Sources

2024-06-05 Thread Kevin Lam
I've also just found https://issues.apache.org/jira/browse/FLINK-31762 which tracks the Kafka specific issue. On Wed, Jun 5, 2024 at 3:05 PM Kevin Lam wrote: > cc. panyuep...@apache.org as related to FLIP-370 > > On Wed, Jun 5, 2024 at 2:32 PM Kevin Lam wrote: > >> Hey a

Re: Poor Load Balancing across TaskManagers for Multiple Kafka Sources

2024-06-05 Thread Kevin Lam
cc. panyuep...@apache.org as related to FLIP-370 On Wed, Jun 5, 2024 at 2:32 PM Kevin Lam wrote: > Hey all, > > I'm seeing an issue with poor load balancing across TaskManagers for Kafka > Sources using the Flink SQL API and wondering if FLIP-370 will help with > it, or i

Poor Load Balancing across TaskManagers for Multiple Kafka Sources

2024-06-05 Thread Kevin Lam
Hey all, I'm seeing an issue with poor load balancing across TaskManagers for Kafka Sources using the Flink SQL API and wondering if FLIP-370 will help with it, or if not, interested in any ideas the community has to mitigate the issue. The Kafka SplitEnumerator uses the following logic to assign

Best Practices? Fault Isolation for Processing Large Number of Same-Shaped Input Kafka Topics in a Big Flink Job

2024-05-08 Thread Kevin Lam
Hi everyone, I'm currently prototyping on a project where we need to process a large number of Kafka input topics (say, a couple of hundred), all of which share the same DataType/Schema. Our objective is to run the same Flink SQL on all of the input topics, but I am concerned about doing this in

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-03-26 Thread Kevin Lam
Thanks Anupam! Looking forward to it. On Thu, Mar 14, 2024 at 1:50 AM Anupam Aggarwal wrote: > Hi Kevin, > > Thanks, these are some great points. > Just to clarify, I do agree that the subject should be an option (like in > the case of RegistryAvroFormatFactory). > We could f

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-22 Thread Kevin Lam
Thanks for sharing this work Gyula! That's great to see the FLIP covers some of the limitations already. I will follow the FLIP and associated JIRA ticket. Hi Matthias Pohl. I'd be interested to learn if there has been any progress on the FLIP-360 or associated JIRA issue FLINK-31709. On Fri, Mar

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-21 Thread Kevin Lam
No worries, thanks for the reply Gyula. Ah yes, I see how those points you raised make the feature tricky to implement. Could this be considered for a FLIP (or two) in the future? On Wed, Mar 20, 2024 at 2:21 PM Gyula Fóra wrote: > Sorry for the late reply Kevin. > > I think wha

Efficient Use of Disk Resources (Only Attach Disks to Stateful Task Managers)

2024-03-14 Thread Kevin Lam
I, and only the DataStream API is supported there. Thanks in advance, Kevin

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-14 Thread Kevin Lam
ified object storage URI) and uses that as the initialSavepointPath to restore and run the Flink job. It doesn't require being aware of clusters, or submitting resources to different clusters at all, while still facilitating such fail overs. On Wed, Mar 13, 2024 at 4:51 PM Gyula Fóra wrote: &

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-13 Thread Kevin Lam
ll be interested in hearing the community's thoughts on if we can support this in a more first-class way as part of the Apache Flink Kubernetes Operator. Thanks, Kevin On Wed, Mar 13, 2024 at 9:41 AM Maximilian Michels wrote: > Hi Kevin, > > Theoretically, as long as you move ove

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-03-12 Thread Kevin Lam
Flink LogicalType, we shouldn't renumber the field ids in an incompatible way, so one approach would be to use the subject to look up the most recent version, and use that to evolve the field ids correctly. On Tue, Mar 12, 2024 at 2:33 AM Anupam Aggarwal wrote: > Hi Kevin, > > Thanks for

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-06 Thread Kevin Lam
Another thought could be modifying the operator to have a behaviour where upon first deploy, it optionally (flag/param enabled) finds the most recent snapshot and uses that as the initialSavepointPath to restore and run the Flink job. On Wed, Mar 6, 2024 at 2:07 PM Kevin Lam wrote: > Hi th

Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-06 Thread Kevin Lam
Hi there, We use the Flink Kubernetes Operator, and I am investigating how we can easily support failing over a FlinkDeployment from one Kubernetes Cluster to another in the case of an outage that requires us to migrate a large number of FlinkDeployments from one K8s cluster to another. I underst

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-29 Thread Kevin Lam
Hey Robert, Awesome thanks, that timeline works for me. Sounds good re: deciding on FLIP once we have the PR, and thanks for looking into the field ids. Looking forward to it! On Thu, Feb 29, 2024 at 5:09 AM Robert Metzger wrote: > Hey Kevin, > > Thanks a lot. Then let's

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-27 Thread Kevin Lam
Metzger wrote: > Hi all, > > +1 to support the format in Flink. > > @Kevin: Do you already have an implementation for this inhouse that you are > looking to upstream, or would you start from scratch? > I'm asking because my current employer, Confluent, has a Protobuf S

[DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-21 Thread Kevin Lam
I would love to get some feedback from the community on this JIRA issue: https://issues.apache.org/jira/projects/FLINK/issues/FLINK-34440 I am looking into creating a PR and would appreciate some review on the approach. In terms of design I think we can mirror the `debezium-avro-confluent` and `a

[jira] [Created] (FLINK-34440) Support Debezium Protobuf Confluent Format

2024-02-13 Thread Kevin Lam (Jira)
Kevin Lam created FLINK-34440: - Summary: Support Debezium Protobuf Confluent Format Key: FLINK-34440 URL: https://issues.apache.org/jira/browse/FLINK-34440 Project: Flink Issue Type: New Feature

Re: Impact of redacting UPDATE_BEFORE fields?

2024-02-08 Thread Kevin Lam
ations? I don't have a specific example in mind but just trying to understand the full implications of missing UPDATE_BEFORE messages. On Wed, Feb 7, 2024 at 4:24 PM Yaroslav Tkachenko wrote: > Hey Kevin, > > In my experience it mostly depends on the type of your sinks. If all

Impact of redacting UPDATE_BEFORE fields?

2024-02-07 Thread Kevin Lam
Hi there! I have a question about Changelog Stream Processing with Flink SQL and the Flink Table API. I would like to better understand how UPDATE_BEFORE fields are used by Flink. Our team uses Debezium to extract Change Data Capture events from MySQL databases. We currently redact the `before` f

[jira] [Created] (FLINK-33545) KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching

2023-11-14 Thread Kevin Tseng (Jira)
Kevin Tseng created FLINK-33545: --- Summary: KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching Key: FLINK-33545 URL: https://issues.apache.org

[jira] [Created] (FLINK-33479) Add Rerouting support to KafkaSink

2023-11-07 Thread Kevin Tseng (Jira)
Kevin Tseng created FLINK-33479: --- Summary: Add Rerouting support to KafkaSink Key: FLINK-33479 URL: https://issues.apache.org/jira/browse/FLINK-33479 Project: Flink Issue Type: Improvement

Re: Support AWS SDK V2 for Flink's S3 FileSystem

2023-10-10 Thread Zhao, Kevin
Looks like Maomao was missed from previous replies. Adding back @Maomao<mailto:mimao...@amazon.com>. Thanks everyone for your response. We are having some discussion within AWS EMR team. Will get back to you very soon. Regards, Kevin From: Matthias Pohl Date: Tuesday, October 10, 2023

Re: [DISCUSS] addition of Flink Script Operators

2023-08-07 Thread Kevin Tseng
the user is aware of existing state being used on data produced by new processing logic. In this case we do nothing, and leave the handling to the implementer of the Script Operator. Not sure if this answers the question? Truly appreciate the response! Best regards, Kevin > On Fri, Aug 4, 2023, at

[DISCUSS] addition of Flink Script Operators

2023-08-01 Thread Kevin Tseng
Hello Dev Mailing List, I have a feature proposition that I am interested to hear more and to gather feedback from everyone on the mailing list. (please view this email in monospace font when possible) _*Proposal*_* * Currently, when Flink DataStream API is to be utilized, every data processin

Re: Zero-Downtime Deployments with Flink Operator

2023-05-24 Thread Kevin Lam
Thanks for your response Gyula! >5. This is possible to build on top of the current operator logic externally Do you have any recommendations on how best to approach this? A Custom Operator Plugin? On Wed, May 24, 2023 at 1:38 PM Gyula Fóra wrote: > Hey Kevin! > > I am

Zero-Downtime Deployments with Flink Operator

2023-05-24 Thread Kevin Lam
Hi, Is there any interest or ongoing work around supporting zero-downtime deployments with Flink using the Flink Operator? I saw that https://issues.apache.org/jira/browse/FLINK-24257 existed, but it looks a little stale. I'm interested in learning more about the current state of things. There i

Re: [DISCUSS] Release Flink 1.17.1

2023-05-16 Thread Kevin Lam
Hi! Thanks for doing this release. I'm looking forward to some of the bug fixes, is there a date set for the release of 1.17.1? On Mon, May 15, 2023 at 6:10 AM Lijie Wang wrote: > +1 for the release. > > Best, > Lijie > > Jing Ge 于2023年5月15日周一 17:07写道: > > > +1 for releasing 1.17.1 > > > > Best

[jira] [Created] (FLINK-31951) Mix schema record source creates corrupt record

2023-04-26 Thread Kevin Tseng (Jira)
Kevin Tseng created FLINK-31951: --- Summary: Mix schema record source creates corrupt record Key: FLINK-31951 URL: https://issues.apache.org/jira/browse/FLINK-31951 Project: Flink Issue Type

Re: Flink Operator - Supporting Recovery from Snapshot

2023-02-10 Thread Kevin Lam
hanks! On Fri, Feb 10, 2023 at 12:23 PM Yaroslav Tkachenko wrote: > Hi Kevin! > > In my case, I automated this workflow by first deleting the current Flink > deployment and then creating a new one. So, if the initialSavepointPath is > different it'll use it for recovery. &g

Re: Flink Operator - Supporting Recovery from Snapshot

2023-02-10 Thread Kevin Lam
Thanks for the response Gyula! Those caveats make sense, and I see, there's a bit of a complexity to consider if the feature is implemented. I do think it would be useful, so would also love to hear what others think! On Wed, Feb 8, 2023 at 3:47 AM Gyula Fóra wrote: > Hi Kevin! > &

Flink Operator - Supporting Recovery from Snapshot

2023-02-07 Thread Kevin Lam
Hello, I was reading the Flink Kubernetes Operator documentation and noticed that if you want to redeploy a Flink job from a specific snapshot, you must follow these manual recovery steps. Are there plans to streamline this process? Deploying from a specific snapshot is a relatively common operati

RE: [VOTE] FLIP-265 Deprecate and remove Scala API support

2022-10-19 Thread Kevin Lam
Non-binding -1. Aligned with the objections raised by Yaroslav in https://lists.apache.org/thread/d3borhdzj496nnggohq42fyb6zkwob3h and agree with his recommendation to support Java 17 as a prerequisite. We use the Scala APIs extensively and we would like to have an alternative to Scala so that we

[jira] [Created] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-10 Thread Kevin Li (Jira)
Kevin Li created FLINK-29572: Summary: Flink Task Manager skip loopback interface for resource manager registration Key: FLINK-29572 URL: https://issues.apache.org/jira/browse/FLINK-29572 Project: Flink

Re: Wrong format when passing arguments with space

2022-04-01 Thread Kevin Lee
args, --rate;10;--time;'"2022-03-30 18:46:56"' Sorry for the mistake 姜鑫 于2022年4月1日周五 11:22写道: > Hi Kevin, > > I noticed that the two quotas in your time string looks different. Please > confirm that it is a typo or not. > > Best, > Xin > &

Wrong format when passing arguments with space

2022-03-27 Thread Kevin Lee
Flink version : 1.13 Bug: When I pass an argument with space by single quota. The main function get this argument with a double quota example: ./bin/flink run -c com.lmk.QuotaTest --rate 10 --time ''2022-03-28 11:53:21" The main function get parameters: 1-rate 2---10 3-time 4---"2022-03

问题咨询: Too more data in this partition: 2147483648

2022-03-23 Thread Kevin Lee
Version: 1.13 mode:batch & FlinkSQL 这是什么原因导致的 Error: ``` java.lang.RuntimeException: Too more data in this partition: 2147483648 at org.apache.flink.table.runtime.hashtable.BinaryHashPartition.insertIntoBuildBuffer(BinaryHashPartition.java:264) at org.apache.flink.table.runtime.hashtable.BinaryHa

[jira] [Created] (FLINK-24009) Upgrade to Apache pom parent 24

2021-08-26 Thread Kevin Ratnasekera (Jira)
Kevin Ratnasekera created FLINK-24009: - Summary: Upgrade to Apache pom parent 24 Key: FLINK-24009 URL: https://issues.apache.org/jira/browse/FLINK-24009 Project: Flink Issue Type

[jira] [Created] (FLINK-23229) Translate "Timely Stream Processing" page into Chinese

2021-07-04 Thread kevin (Jira)
kevin created FLINK-23229: - Summary: Translate "Timely Stream Processing" page into Chinese Key: FLINK-23229 URL: https://issues.apache.org/jira/browse/FLINK-23229 Project: Flink

[jira] [Created] (FLINK-23228) Translate "Stateful Stream Processing" page into Chinese

2021-07-04 Thread kevin (Jira)
kevin created FLINK-23228: - Summary: Translate "Stateful Stream Processing" page into Chinese Key: FLINK-23228 URL: https://issues.apache.org/jira/browse/FLINK-23228 Project: Flink

[jira] [Created] (FLINK-23227) Flink Chinese docs [learn-flink/etl]: no translation and mismatch in some place within this doc

2021-07-03 Thread kevin (Jira)
kevin created FLINK-23227: - Summary: Flink Chinese docs [learn-flink/etl]: no translation and mismatch in some place within this doc Key: FLINK-23227 URL: https://issues.apache.org/jira/browse/FLINK-23227

[jira] [Created] (FLINK-23226) Flink Chinese doc learn-flink/etl transformation.svg display issue

2021-07-03 Thread kevin (Jira)
kevin created FLINK-23226: - Summary: Flink Chinese doc learn-flink/etl transformation.svg display issue Key: FLINK-23226 URL: https://issues.apache.org/jira/browse/FLINK-23226 Project: Flink Issue

[jira] [Created] (FLINK-23042) Flink Chinese docs Fraud Detection with the DataStream API page picture display issue

2021-06-19 Thread kevin (Jira)
kevin created FLINK-23042: - Summary: Flink Chinese docs Fraud Detection with the DataStream API page picture display issue Key: FLINK-23042 URL: https://issues.apache.org/jira/browse/FLINK-23042 Project

[jira] [Created] (FLINK-20922) row() function cannot accpet . as arguments

2021-01-10 Thread Kevin Ma (Jira)
Kevin Ma created FLINK-20922: - Summary: row() function cannot accpet . as arguments Key: FLINK-20922 URL: https://issues.apache.org/jira/browse/FLINK-20922 Project: Flink Issue Type: Bug

Re: [DISCUSS] Stop adding new bash-based e2e tests to Flink

2020-11-23 Thread Kevin Kwon
Hi :) For me, it's a bit unclear what it means by not using Docker in e2e tests in K8S context, since K8S require Docker by default Also, for for K8S test orchestration, wouldn't vanilla Python suffice? It has all the K8S, Docker client libraries supported natively by them Might just need to wri

[jira] [Created] (FLINK-19517) Support for Confluent Kafka on table creation

2020-10-06 Thread Kevin Kwon (Jira)
Kevin Kwon created FLINK-19517: -- Summary: Support for Confluent Kafka on table creation Key: FLINK-19517 URL: https://issues.apache.org/jira/browse/FLINK-19517 Project: Flink Issue Type: Wish

[jira] [Created] (FLINK-18493) Make target home directory used to store yarn files configurable

2020-07-05 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-18493: --- Summary: Make target home directory used to store yarn files configurable Key: FLINK-18493 URL: https://issues.apache.org/jira/browse/FLINK-18493 Project: Flink

[jira] [Created] (FLINK-15230) flink1.9.1 table API JSON schema array type exception

2019-12-12 Thread kevin (Jira)
kevin created FLINK-15230: - Summary: flink1.9.1 table API JSON schema array type exception Key: FLINK-15230 URL: https://issues.apache.org/jira/browse/FLINK-15230 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-27 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14539: --- Summary: Unique key metadata should be ketp when using concat or concat_ws in some cases Key: FLINK-14539 URL: https://issues.apache.org/jira/browse/FLINK-14539

[jira] [Created] (FLINK-14436) Add getter for ContextEnvironment instance in StreamContextEnvironment

2019-10-17 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14436: --- Summary: Add getter for ContextEnvironment instance in StreamContextEnvironment Key: FLINK-14436 URL: https://issues.apache.org/jira/browse/FLINK-14436 Project: Flink

About Contributor Permission

2019-06-13 Thread Kevin Liu
Hi, I've been using Apache Flink for a year and I find it quite interesting. Now I really want to make contribution to Apache Flink so that it will become more popular and useful for big data application. Would you please give me the contributor permission? My JIRA ID is lemony. Best, Kevin

apply for contributor permission

2019-06-12 Thread kevin sun
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is kevinsun1000

about contributor permission

2019-06-10 Thread kevin sun
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is kevinsun

about contributor permission

2019-06-10 Thread kevin sun
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is kevinsun2010

about contributor permission

2019-06-10 Thread kevin sun
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is kevinsun

Contributor permission Request

2019-04-15 Thread Kevin Tang
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is tangshangwen ( https://issues.apache.org/jira/secure/ViewProfile.jspa?name=tangshangwen).

Re: Intro

2018-07-25 Thread Kevin Waterson
Thanks Till, I am guessing you have confluence? Kev On Wed, Jul 25, 2018 at 5:43 PM Till Rohrmann wrote: > Hi Kevin, > > welcome to the Flink project :-) > > Currently, there is no single person responsible for the documentation of > Flink. It is more of a swarm effort bu

Intro

2018-07-24 Thread Kevin Waterson
Hi Dev, New to Flink, coming from Metron use. Looking forward to using, and getting involved in the documentation of Flink. Who heads up the docs? Is there another list or use the user or community lists? Thanks, Kev

[jira] [Created] (FLINK-8309) JVM sigsegv crash when enabling async checkpoints

2017-12-22 Thread Kevin Pullin (JIRA)
Kevin Pullin created FLINK-8309: --- Summary: JVM sigsegv crash when enabling async checkpoints Key: FLINK-8309 URL: https://issues.apache.org/jira/browse/FLINK-8309 Project: Flink Issue Type

[DISCUSS] (Meta)data Driven Window Triggers

2016-08-12 Thread Kevin Jacobs
collected by the StateExtractor. One such a use case in which (Meta)data Driven Window Triggers could be useful is for example filtering duplicates from a stream. Just my idea :-), what are your thoughts? Regards, Kevin

Conceptual difference Windows and DataSet

2016-08-04 Thread Kevin Jacobs
ify the process a lot: 1. Window the elements. 2. Apply the same operations as before. Is there a way in Flink to do so? Otherwise, I would like to think of a solution to this problem. Regards, Kevin

Re: Introduction

2016-08-01 Thread Kevin Jacobs
Hi! Welcome to the community :-)! On 01.08.2016 09:51, Ufuk Celebi wrote: On Sun, Jul 31, 2016 at 8:07 PM, Neelesh Salian wrote: I am Neelesh Salian; I recently joined the Flink community and I wanted to take this opportunity to formally introduce myself. Thanks and welcome! :-)

Re: Discard out-of-order events

2016-07-29 Thread Kevin Jacobs
; for (record <- records) { if (record._2 == key) { bestDescription = record._3 } } out.collect((key, bestDescription)) } } } .print() My questions f

Discard out-of-order events

2016-07-28 Thread Kevin Jacobs
Is it possible to discard events that are out-of-order (in terms of event time)?

Use case

2016-07-28 Thread Kevin Jacobs
y one value. Is there a better way to keep track of a largest value in a stream? Regards, Kevin

Re: FlinkKafkaConsumer09

2016-07-28 Thread Kevin Jacobs
. Cheers, Kevin On 28.07.2016 10:39, Maximilian Michels wrote: Hi Kevin, You need to use properties.setProperty("auto.offset.reset", "smallest") for Kafka 9 to start from the smallest offset. Note, that in Kafka 8 you need to use properties.setProperty("auto.offset.rese

FlinkKafkaConsumer09

2016-07-28 Thread Kevin Jacobs
ation.html#newconsumerapi) However, it starts from the latest item in my topic. Is this a bug or am I doing something wrong? Regards, Kevin

Contribute to Flink

2016-07-08 Thread Kevin
Hi, I am relatively new to the development process of Apache Flink. Where can I start to help you developing Flink? Kind regards, Kevin

Re: Evaluating Apache Flink

2016-07-08 Thread Kevin Jacobs
Hi Marton, Thank you for your elaborate answer. I will comment in your e-mail below: On 08.07.2016 15:13, Márton Balassi wrote: Hi Kevin, Thanks for being willing to contribute such an effort. I think it is a completely valid discussion to ask in your organization and please feel free to ask

Evaluating Apache Flink

2016-07-08 Thread Kevin Jacobs
ld be helpful. Regards, Kevin

Re: Contributing

2016-07-08 Thread Kevin Jacobs
Thank you for your answer! I will take a look at it :-). Regards, Kevin On 08.07.2016 13:18, Matthias J. Sax wrote: Done. I replaced KIP -> FLIP and Kafka -> Flink. Still there are some things we need to rework. Please have a look and propose changes. https://cwiki.apache.org/conf

Contributing

2016-07-08 Thread Kevin Jacobs
Hi, I am relatively new to the development process of Apache Flink. Where can I start to help you developing Flink? Kind regards, Kevin

Re: [Discuss] Why different job's tasks can run in the single process.

2016-06-30 Thread Kevin Jacobs
environment. So there is no need to setup a cluster when testing the streaming process. Regards, Kevin On 30-06-16 09:54, Longda Feng wrote: This means Standalone mode is just for prototype. But I think we need a lightweight solution for streaming process, standalone is the best solution. Some times