[jira] [Created] (FLINK-30959) UNIX_TIMESTAMP's return value does not meet expected

Yunfeng Zhou created FLINK-30959: Summary: UNIX_TIMESTAMP's return value does not meet expected Key: FLINK-30959 URL: https://issues.apache.org/jira/browse/FLINK-30959 Project: Flink Issue Ty

Re: Need help how to use Table API to join two Kafka streams

Thanks. If you look at the code, I am defining/creating the table as: create_kafka_source_ddl = """ CREATE TABLE payment_msg( createTime VARCHAR, orderId BIGINT, payAmount DOUBLE, payPlatform INT, provinceId INT ) WITH (

Re: Need help how to use Table API to join two Kafka streams

> The result here is the representation of the statement execution result, NOT > the query output. > You can define a print connector table[1] as your sink table, and insert into > the query output to the sink table to achieve your goal. Correction: you can also iterate the output result from

Re: How to find the root cause of e2e ci failure?

Hi Yanfei, Thanks for your information, I will take a look~ Best Rui Fan On Wed, Feb 8, 2023 at 11:36 AM Yanfei Lei wrote: > Hi Rui, > > In this case I would search the log for `Run Kubernetes test` in > > https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_apis/build/buil

Re: Need help how to use Table API to join two Kafka streams

> 1) *First*: In *payment_msg_proccessing.py > * > code, > I want to run a simple query on Kafka stream (payment_msg table) without > insertion data into the sink table (es_sink here) and do s

[jira] [Created] (FLINK-30958) Rest API doc generation failure caused by JobClientHeartbeatHeaders

Jane Chan created FLINK-30958: - Summary: Rest API doc generation failure caused by JobClientHeartbeatHeaders Key: FLINK-30958 URL: https://issues.apache.org/jira/browse/FLINK-30958 Project: Flink

Re: [Discussion] externalize Hive connector

Hi, Chen. Really appreciated for you efforts. Nowadays, I'm trying to picking up the work of decoupling again for I find some time finally. I think may be you can first read the FLIP-216[1] to understand how we plan to decouple and make sure the pr you open will be on the right way. I think

Re: [DISCUSS] FLIP-289: Support online inference (Flink ML)

Hi Dong, Thanks for driving this effort! This FLIP LGTM overall. I have just a few minor comments regarding the proposed API: 1) For the method `DataFrame.collect()`, why is it named `collect` instead of something else, e.g. `get`? Does it mean that the result will be computed during this method

Re: How to find the root cause of e2e ci failure?

Hi Rui, In this case I would search the log for `Run Kubernetes test` in https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_apis/build/builds/45813/logs/216 first, and then we can see: 2023-02-07T10:25:38.6193935Z X Exiting due to RUNTIME_ENABLE: Temporary Error: sudo /usr/l

Re: How to find the root cause of e2e ci failure?

Hi Yun, Thanks for your quick reply. I have downloaded, however it just has the watchdog log. The flink-logs directory is empty. Best Rui Fan On Wed, Feb 8, 2023 at 11:09 AM Yun Tang wrote: > Hi Rui, > > The detailed logs of flink e2e CI can be found in the published artifacts > [1] which st

Re: How to find the root cause of e2e ci failure?

Hi Rui, The detailed logs of flink e2e CI can be found in the published artifacts [1] which start with "logs-ci-e2e_1_ci". [1] https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=45813&view=artifacts&pathAsName=false&type=publishedArtifacts Best Yun Tang

[RESULT][VOTE] FLIP-274: Introduce metric group for OperatorCoordinator (FLINK-29801)

Hi all, I am happy to announce that FLIP-274: Introduce metric group for OperatorCoordinator (FLINK-29801)[1] has been accepted. There are 5 binding votes and 2 non-binding vote [2]: - Jark Wu (binding) - Chesnay Schepler (binding) - Martijn Visser (binding) - Dong Lin (binding) - Leonard Xu (bi

How to find the root cause of e2e ci failure?

Hi masters: When test_ci core or connect fails, we can see which test failed. But I don't know how to find the root cause of e2e ci failure?[1] And I just see: `'Run Kubernetes test' failed after 4 minutes and 19 seconds! Test exited with exit code 1`. Could any master share some experiences? Th

[jira] [Created] (FLINK-30957) Support other missing features

Fan Hong created FLINK-30957: Summary: Support other missing features Key: FLINK-30957 URL: https://issues.apache.org/jira/browse/FLINK-30957 Project: Flink Issue Type: Sub-task Compone

[jira] [Created] (FLINK-30956) Add Python implementation of GBTClassifer and GBTRegressor.

Fan Hong created FLINK-30956: Summary: Add Python implementation of GBTClassifer and GBTRegressor. Key: FLINK-30956 URL: https://issues.apache.org/jira/browse/FLINK-30956 Project: Flink Issue Ty

[jira] [Created] (FLINK-30955) Support early stopping with validation set.

Fan Hong created FLINK-30955: Summary: Support early stopping with validation set. Key: FLINK-30955 URL: https://issues.apache.org/jira/browse/FLINK-30955 Project: Flink Issue Type: Sub-task

Re: Need help how to use Table API to join two Kafka streams

Dear Yuxia, I have already sent this message in Slack (# troubleshooting). Any, I am writing it here again: In order to understand it better, I was trying to run an existing project from: *https://apache.googlesource.com/flink-playgrounds/ *. I c

[jira] [Created] (FLINK-30954) Add estimator and transformer for GBTRegressor.

Fan Hong created FLINK-30954: Summary: Add estimator and transformer for GBTRegressor. Key: FLINK-30954 URL: https://issues.apache.org/jira/browse/FLINK-30954 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30953) Support intermediate state management and model save/load.

Fan Hong created FLINK-30953: Summary: Support intermediate state management and model save/load. Key: FLINK-30953 URL: https://issues.apache.org/jira/browse/FLINK-30953 Project: Flink Issue Type

[jira] [Created] (FLINK-30952) Add main training and transforming part.

Fan Hong created FLINK-30952: Summary: Add main training and transforming part. Key: FLINK-30952 URL: https://issues.apache.org/jira/browse/FLINK-30952 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30951) Release Testing: Verify FLINK-29635 Hive sink should support merge files in batch mode

luoyuxia created FLINK-30951: Summary: Release Testing: Verify FLINK-29635 Hive sink should support merge files in batch mode Key: FLINK-30951 URL: https://issues.apache.org/jira/browse/FLINK-30951 Projec

[jira] [Created] (FLINK-30950) Remove flink-connector-aws-base from Flink main repo

Hong Liang Teoh created FLINK-30950: --- Summary: Remove flink-connector-aws-base from Flink main repo Key: FLINK-30950 URL: https://issues.apache.org/jira/browse/FLINK-30950 Project: Flink Is

[jira] [Created] (FLINK-30949) Sync flink-connector-aws-base from Flink main to flink-connector-aws

Hong Liang Teoh created FLINK-30949: --- Summary: Sync flink-connector-aws-base from Flink main to flink-connector-aws Key: FLINK-30949 URL: https://issues.apache.org/jira/browse/FLINK-30949 Project: F

[jira] [Created] (FLINK-30948) Remove flink-avro-glue-schema-registry and flink-json-glue-schema-registry from Flink main repo

Hong Liang Teoh created FLINK-30948: --- Summary: Remove flink-avro-glue-schema-registry and flink-json-glue-schema-registry from Flink main repo Key: FLINK-30948 URL: https://issues.apache.org/jira/browse/FLINK-30

[jira] [Created] (FLINK-30947) Sync flink-avro-glue-schema-registry and flink-json-glue-schema-registry to flink-connector-aws

Hong Liang Teoh created FLINK-30947: --- Summary: Sync flink-avro-glue-schema-registry and flink-json-glue-schema-registry to flink-connector-aws Key: FLINK-30947 URL: https://issues.apache.org/jira/browse/FLINK-30

[jira] [Created] (FLINK-30946) Sync master Avro GlueSchemaRegistry formats flink-connector-aws

Hong Liang Teoh created FLINK-30946: --- Summary: Sync master Avro GlueSchemaRegistry formats flink-connector-aws Key: FLINK-30946 URL: https://issues.apache.org/jira/browse/FLINK-30946 Project: Flink

Flink Operator - Supporting Recovery from Snapshot

Hello, I was reading the Flink Kubernetes Operator documentation and noticed that if you want to redeploy a Flink job from a specific snapshot, you must follow these manual recovery steps. Are there plans to streamline this process? Deploying from a specific snapshot is a relatively common operati

Re: Need help how to use Table API to join two Kafka streams

Traceback (most recent call last): File "/Users/amir/PycharmProjects/VariMat/org/varimat/model/test/sample2.py", line 59, in log_processing() File "/Users/amir/PycharmProjects/VariMat/org/varimat/model/test/sample2.py", line 34, in log_processing table_result = t_env.execute_sql("selec

[jira] [Created] (FLINK-30945) FTS does not support multiple writers into the same table and topic

Vicky Papavasileiou created FLINK-30945: --- Summary: FTS does not support multiple writers into the same table and topic Key: FLINK-30945 URL: https://issues.apache.org/jira/browse/FLINK-30945 Pro

[jira] [Created] (FLINK-30944) ExecutionGraphPartitionReleaseTest leaks threads

Matthias Pohl created FLINK-30944: - Summary: ExecutionGraphPartitionReleaseTest leaks threads Key: FLINK-30944 URL: https://issues.apache.org/jira/browse/FLINK-30944 Project: Flink Issue Type

[jira] [Created] (FLINK-30943) Hide sensitive command-line configurations

Bo Cui created FLINK-30943: -- Summary: Hide sensitive command-line configurations Key: FLINK-30943 URL: https://issues.apache.org/jira/browse/FLINK-30943 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-30942) Fix the bug that the decided parallelism by adaptive batch scheduler may be larger than the max parallelism

Lijie Wang created FLINK-30942: -- Summary: Fix the bug that the decided parallelism by adaptive batch scheduler may be larger than the max parallelism Key: FLINK-30942 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-30941) Error when downloading the flink binaries into the Docker container

Matthias Pohl created FLINK-30941: - Summary: Error when downloading the flink binaries into the Docker container Key: FLINK-30941 URL: https://issues.apache.org/jira/browse/FLINK-30941 Project: Flink

[jira] [Created] (FLINK-30940) InterruptedException in ExecutorImplITCase which doesn't fail the test

Matthias Pohl created FLINK-30940: - Summary: InterruptedException in ExecutorImplITCase which doesn't fail the test Key: FLINK-30940 URL: https://issues.apache.org/jira/browse/FLINK-30940 Project: Fli

[jira] [Created] (FLINK-30939) Add public APIs and topmost framework for GBTClassifer

Fan Hong created FLINK-30939: Summary: Add public APIs and topmost framework for GBTClassifer Key: FLINK-30939 URL: https://issues.apache.org/jira/browse/FLINK-30939 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

Weijie Guo created FLINK-30938: -- Summary: Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode Key: FLINK-30938 URL: https://issues.apache.org/jira/browse/FLINK-30938

[jira] [Created] (FLINK-30937) Add Transformer and Estimator for GBTClassifier and GBTRegressor

Fan Hong created FLINK-30937: Summary: Add Transformer and Estimator for GBTClassifier and GBTRegressor Key: FLINK-30937 URL: https://issues.apache.org/jira/browse/FLINK-30937 Project: Flink Iss

Re: [ANNOUNCE] release-1.17 branch cut

Hi, Krzysztof > Could someone set FIX version to 1.17 and 1.16.2 on those tickets: [1] [2] > please? Done，thanks for the contribution. And I’ll find contributor to review the later bugfix PR. Best, Leonard

Re: [ANNOUNCE] release-1.17 branch cut

Hi, Could someone set FIX version to 1.17 and 1.16.2 on those tickets: [1] [2] please? The [1] Was merged to master on Feb 6th and It is present in 1.17 branch, hence we need to merge bug fix [2] to that branch also. [1] https://issues.apache.org/jira/browse/FLINK-27246 [2] https://issues.apache

[jira] [Created] (FLINK-30936) Release Testing: Verify FLINK-29941 Support SQL Client connects to SQL Gateway

Qingsheng Ren created FLINK-30936: - Summary: Release Testing: Verify FLINK-29941 Support SQL Client connects to SQL Gateway Key: FLINK-30936 URL: https://issues.apache.org/jira/browse/FLINK-30936 Proj

[ANNOUNCE] release-1.17 branch cut

Hi devs, The release-1.17 branch has been forked out from the master branch, with commit ID 4bc6d6dac29b1d7d89850a512b8283858824ae21. The version on the master branch has been upgraded to 1.18-SNAPSHOT. From now on, for PRs that should be presented in 1.17.0, please make sure: Merge the PR int

Pull Request for FLINK-30927

Hi community, on Monday Feb 6th, one of my PR was merged to flink master [1]. Shortly after that, one of the community members reported an issue that was caused by my change [2] (please see ticket description and comments for details). After short time I've created a PR with fix for that reported

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

Hi everyone, Let's try to answer the questions one by one. *@ConradJam* when the number of "slots" is insufficient, can we can stop users rescaling > or throw something to tell user "less avaliable slots to upgrade, please > checkout your alivalbe slots" ? > The main property of AdaptiveSchedul

[jira] [Created] (FLINK-30935) Add KafkaSerializer deserialize check when using SimpleVersionedSerializer

Ran Tao created FLINK-30935: --- Summary: Add KafkaSerializer deserialize check when using SimpleVersionedSerializer Key: FLINK-30935 URL: https://issues.apache.org/jira/browse/FLINK-30935 Project: Flink