org.apache.flink.kubernetes.shaded.com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException

2023-09-07 Thread han
Hi flink users, I used three dependencies in my pom.xml in this order:kubernetes-client、flink-clients_2.11、flink-kubernetes_2.11. when i execute DeploymentList deploymentList = client.apps().deployments().inNamespace(namespace).list(); throw exception see below. how can i solve this excep

Re: Flink SQL: HOW to define `ANY` subtype in constructured Constructured Data Types(MAP, ARRAY...)

2022-02-23 Thread Jie Han
There is no built-in LogicType for ’ANY’, it’s a invalid token > 2022年2月23日 下午10:29,zhouhaifengmath 写道: > > > When I define a udf paramters like: > public @DataTypeHint("Row") Row > eval(@DataTypeHint("MAP") Map mapData) > > It gives error: > Please check for implementation mistak

How to run multiple InputFormat on multiple nodes

2019-07-16 Thread HAN QIU
Dears, I have installed the Flink standalone cluster with 3 nodes, and I want to select some data from database. For high performance, I split the one sql to many, and I want these many sqls can run on the 3 nodes distributed.But actually these sqls are runing on the same node. Here is my codes

Flink batch mode does not sort by event timestamp

2022-04-21 Thread Han You
ent/uploads/2018/04/akuna-logo_email-signature_4-3-18.png] Han You | Junior Developer Akuna Capital | www.akunacapital.com <http://www.akunacapital.com> p: | m: | f: | han@akunacapital.com Learn More About the New Wave in Tech and Trading<https://www.youtube.com/watch?v=oAS29_yxVcc&am

Re: jobmaster's fatal error will kill the session cluster

2022-10-14 Thread Jie Han
just because of using a wrong job configuration (set a relative path). > 2022年10月14日 19:53,Matthias Pohl via user 写道: > > Hi Jie Han, > welcome to the community. Just a little side note: These kinds of questions > are more suitable to be asked in the user mailing list. The d

Example of dynamic table

2023-03-07 Thread Jie Han
Hello community! I want to try the feature of dynamic table but do not find examples in the official doc. Is this part missing?

Re: Example of dynamic table

2023-03-07 Thread Jie Han
pts/dynamic_tables/ > [2]: > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sourcessinks/ > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Jie Han" > 收件人: "User" > 发送时间: 星期三, 2023年 3 月 08日 上午 7:54:06 > 主题: Example of dyn

Are metadata columns required to get declared in the table's schema?

2023-03-25 Thread Jie Han
Hi community, I want to query a metadata column from my table t. Do I need to declare it in the table schema explicitly? In spark, metadata columns are hidden columns, which means we don’t need to declare it in the table ddl, we only explicitly reference it in our query. For instance, select *

Re: Are metadata columns required to get declared in the table's schema?

2023-03-26 Thread Jie Han
Thank you for your respond. Actually I noticed that the doc says 'However, declaring a metadata column in a table’s schema is optional’. So, does it mean that we don’t need to declare it when we don't query it rather than we can query it without the declaration? Best, Jay

Install Flink Document as a PDF Book

2023-09-14 Thread Yunhui Han
Hi, all How can I install the latest Flink Document as a PDF book? Best

Flink Gzip Sink with Error

2023-09-20 Thread Yunhui Han
Hi all, I want to write JSON strings with gzip compression by Flink following the demo on StackOverflow. I encountered a problem. There is an ill format string at the be

Re: Is there anyway to control the size of my ListState in my KeyedProcessFunction

2025-06-05 Thread Han Yin
Flink MapState manages the TTL of each map entry independently. If you add/update a “new hash”, the “old hash” that was written one hour ago stays unaffected and can still expire as it should be. So it should meet your requirements of deduplication and size-control. > 2025年6月4日 10:54,Sachin Mi

Re: Unit testing KeyedProcessFunction that uses async state

2025-06-24 Thread Han Yin
Hi Nate, Hi Lasse, FYI, if you're still interested in the test harness for KeyFunctions with State V2, please note that the ticket [1] mentioned earlier has been resolved. Although it hasn't been officially released yet, you can try out the new harness methods. These methods can be found in the

Re: Flink 2.0 Migration RockDBStateBackend

2025-07-15 Thread Han Yin
Hi patricia, ```setPredefinedOptions ``` can still be found in EmbeddedRocksDBStateBackend in Flink 2.0. You can set the option programmatically via config: config.set( RocksDBOptions.PREDEFINED_OPTIONS, PredefinedOptions.FLASH_SSD_OPTIMIZED.name()); Best, Han Yin > 2025年7月15日 13

Re: Correct packages for Fraud Detection tutorial?

2025-06-29 Thread Han Yin
ink/flink-docs-release-2.0/docs/dev/datastream/fault-tolerance/state_v2/> Sincerely, Han Yin > 2025年6月30日 14:49,Shikhar Raje 写道: > > Hi Yin, > > I understand that #2 (adding `enableAsyncState()`) was the fix that I was > looking for. We're in the process of bu

Re: Correct packages for Fraud Detection tutorial?

2025-06-29 Thread Han Yin
Hi, Shikhar It seems you have used state V2 APIs in your code. Please check the imports in your ```FraudDetector.java``` and you may see that ```ValueState``` and ```ValueStateDescriptor``` are under ```org.apache.flink.api.common.state.v2``` package. About your questions: 1. The asynchronous be