Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-29 Thread Jiadong Lu
Congratulations !!! Best, Jiadong Lu On 2023/3/27 17:23, Yu Li wrote: Dear Flinkers, As you may have noticed, we are pleased to announce that Flink Table Store has  joined the Apache Incubator as a separate project called Apache  Paimon(incubating) [1] [2] [3]. The new project still aims at

how to configure window of join operator in batch mode

2023-04-25 Thread Jiadong Lu
}).printToErr(); env.setParallelism(1); env.setRuntimeMode(RuntimeExecutionMode.BATCH); env.execute(); } ``` Thanks in advance. -- Jiadong Lu

Re: how to configure window of join operator in batch mode

2023-04-25 Thread Jiadong Lu
dow. Would you mind writing a demo about it? Your help is greatly appreciated in advance. Best, Jiadong Lu On 2023/4/26 09:53, Shammon FY wrote: Hi Jiadong, I think it depends on the specific role of the window here for you. If this window has no specific business meaning and is only used

Re: how to configure window of join operator in batch mode

2023-04-26 Thread Jiadong Lu
r scenario. Thank you for your time and I look forward to hearing from you soon. Best, Jiadong Lu On 2023/4/26 18:13, Shammon FY wrote: Hi Jiadong Using the process time window in Batch jobs may be a little strange for me. I prefer to partition the data according to the day level, and then

Re: How to know when a pipeline ends

2023-05-13 Thread Jiadong lu
e the flink job. Best, Jiadong Lu On 2023/5/13 2:00, Luke Xiong wrote: Hi Weihua and Shammon, Thanks for the pointers.I tried both, unfortunately neither works. By enabling "execution.attached", there doesn't seem to be any difference than the default settings. doSomeClea

Re: JVM Metaspace for Task Mangers and Job Managers are not getting released.

2023-05-13 Thread Jiadong lu
Hi, Ajinkya Maybe some threads in your job were not shut down when the job was closed? Best, Jiadong Lu On 2023/5/13 4:58, Ajinkya Pathrudkar wrote: Hello, I am observing JVM Metaspace memory for Task Managers and Job Manager is not getting released. Any thoughts? image.png Thanks

Re: Restore from checkpoint

2024-05-19 Thread Jiadong Lu
s:///home/foo/boo" 4. or Win32 directory form Best regards, Jiadong Lu On 2024/5/20 02:28, Phil Stavridis wrote: Hi Lu, Thanks for your reply. In what way are the paths to get passed to the job that needs to used the checkpoint? Is the standard way, using -s :/ or by passing the path in the mo