Hello Weihua,
I tried to increase akka.framesize from default to 30MB but I still see few 
logs are missing from down stream operators if there's large amount of data 
processing.

Regards,Madan 
    On Friday, 14 July 2023 at 11:45:36 am GMT-7, Madan D via user 
<user@flink.apache.org> wrote:  
 
  Hello Weihua,
 I see all events are written, which are processed right after the event has 
been consumed (source), but they are missing those that are coming from 
downstream operators.

Regards,Madan  
    On Friday, 14 July 2023 at 02:16:11 am GMT-7, Weihua Hu 
<huweihua....@gmail.com> wrote:  
 
 Hi Madan
Flink UI reads the log file and displays it in the UI, so if the UI is 
accurate, There shouldn't be any issues with Flink writing files.
You can check if there are any issues while transferring log file data to 
Splunk.

Best,
Weihua


On Wed, Jul 12, 2023 at 1:02 AM Madan D via user <user@flink.apache.org> wrote:

Hello Team,
 Recently, we observed that Flink logs were missing while writing to files in 
order to forward them to Splunk to see event metrics, even though the Flink UI 
showed them accurate.Can you please help me understand what might be causing it?

Regards,Madan

    

Reply via email to