Re: Slowness using GenericWriteAheadSink

2022-03-23 Thread James Sandys-Lumsdaine
Sent: 11 March 2022 13:59 To: user@flink.apache.org Subject: Slowness using GenericWriteAheadSink Hello, We are using the GenericWriteAheadSink to buffer up values to then send to a SQL Server database with a fast bulk copy upload. However, when I watch my process running it seems to be a huge

RE: Slowness using GenericWriteAheadSink

2022-03-21 Thread Sandys-Lumsdaine, James
@flink.apache.org Subject: Slowness using GenericWriteAheadSink CAUTION: External email. The email originated outside of our company Hello, We are using the GenericWriteAheadSink to buffer up values to then send to a SQL Server database with a fast bulk copy upload. However, when I watch my

Slowness using GenericWriteAheadSink

2022-03-14 Thread James Sandys-Lumsdaine
Hello, We are using the GenericWriteAheadSink to buffer up values to then send to a SQL Server database with a fast bulk copy upload. However, when I watch my process running it seems to be a huge amount of time iterating the Iterable provided to the sendValues() method. It takes such a long ti

Slowness using GenericWriteAheadSink

2022-03-11 Thread Sandys-Lumsdaine, James
Hello, We are using the GenericWriteAheadSink to buffer up values to then send to a SQL Server database with a fast bulk copy upload. However, when I watch my process running it seems to be a huge amount of time iterating the Iterable provided to the sendValues() method. It takes such a long ti