[jira] [Created] (FLINK-27731) Cannot build documentation with Hugo docker image

2022-05-21 Thread Xintong Song (Jira)
Xintong Song created FLINK-27731: Summary: Cannot build documentation with Hugo docker image Key: FLINK-27731 URL: https://issues.apache.org/jira/browse/FLINK-27731 Project: Flink Issue Type:

Re: Flatmap node at 100%

2022-05-21 Thread JasonLee
Hi Your picture is not visible here. You can put it on one of the Drawing bed, can you send out the memory stack information Best JasonLee Replied Message | From | Zain Haider Nemati | | Date | 05/22/2022 13:41 | | To | yuxia | | Cc | User , dev | | Subject | Re: Flatmap node at 1

Json Deserialize in DataStream API with array length not fixed

2022-05-21 Thread Zain Haider Nemati
Hi Folks, I have data coming in this format: { “data”: { “oid__id”: “61de4f26f01131783f162453”, “array_coordinates”:“[ { \“speed\” : \“xxx\“, \“accuracy\” : \“xxx\“, \“bearing\” : \“xxx\“, \“altitude\” : \“xxx\“, \“longitude\” : \“xxx\“, \“latitude\” : \“xxx\“, \“dateTimeS

Task Manager Heap Memory Overflowing

2022-05-21 Thread Zain Haider Nemati
Hi, I'm running a job with kafka source pulling in million of records with parallelism 16 and Im seeing heap memory on task manager overflowing after the job as ran for some time, no matter how much I increase the memory allocation. Can someone help me out in this regards? Job Stats and memory con

Re: Job Logs - Yarn Application Mode

2022-05-21 Thread Zain Haider Nemati
Hi, Thanks for your response folks. Is it possible to access logs via flink UI in yarn application mode? Similar to how we can access them in standalone mode On Fri, May 20, 2022 at 11:06 AM Shengkai Fang wrote: > Thanks for Biao's explanation. > > Best, > Shengkai > > Biao Geng 于2022年5月20日周五 1

Re: Flatmap node at 100%

2022-05-21 Thread Zain Haider Nemati
Hi Yuxia, I did increase the parallelism to 16 but that is causing memory overflowing issues. Task manager heap memory collapses after a certain point when the job has run. I'm attaching the metrics, the flatmap converts jsons and parses them to comma separated strings. Could you suggest how to opt

Contributing to Apache Flink

2022-05-21 Thread Shubham Bansal
Hi Everyone, I have been looking at some starter tagged JIRA in the last couple of weeks. https://issues.apache.org/jira/browse/FLINK-27506 https://issues.apache.org/jira/browse/FLINK-27508 https://issues.apache.org/jira/browse/FLINK-27507 https://issues.apache.org/jira/browse/FLINK-27509 One of

Request for Review: FLINK-27507 and FLINK-27509

2022-05-21 Thread Shubham Bansal
Hi Everyone, I am not sure who to reach out for the reviews of these changesets, so I am putting this on the mailing list here. I have raised the review for FLINK-27507 - https://github.com/apache/flink-playgrounds/pull/30 FLINK-27509 - https://github.com/apache/flink-playgrounds/pull/29 I would

[jira] [Created] (FLINK-27730) Kafka connector document code sink has an error

2022-05-21 Thread liuwei (Jira)
liuwei created FLINK-27730: -- Summary: Kafka connector document code sink has an error Key: FLINK-27730 URL: https://issues.apache.org/jira/browse/FLINK-27730 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-27729) Support constructing StartCursor and StopCursor from MessageId

2022-05-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-27729: --- Summary: Support constructing StartCursor and StopCursor from MessageId Key: FLINK-27729 URL: https://issues.apache.org/jira/browse/FLINK-27729 Project: Flink Issue